2026-03-28 12:00:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 12:00:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 12:00:04 [auto1.it] INFO: Batch mode enabled: batch 1/2
2026-03-28 12:00:04 [auto1.it] INFO: Starting spider auto1.it
2026-03-28 12:00:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 12:00:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 12:00:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 12:00:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 12:00:04 [scrapy.extensions.telnet] INFO: Telnet Password: 9dcbcc5a917b8ed6
2026-03-28 12:00:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-28 12:00:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.it/task_24_2026-03-28T12_00_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-28 12:00:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 12:00:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 12:00:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 12:00:04 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 12:00:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 12:00:05 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-28 12:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 12:00:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-28 12:00:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 12:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 12:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 12:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 12:00:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 12:00:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 12:00:05 [scrapy.core.engine] INFO: Spider opened
2026-03-28 12:00:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 12:00:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 12:00:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-28 12:00:05 [scrapy-playwright] INFO: Starting download handler
2026-03-28 12:00:05 [scrapy-playwright] INFO: Starting download handler
2026-03-28 12:00:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 12:00:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 12:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 12:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 12:00:15 [auto1.it] INFO: Channel: 24h | Page: 0 | totalHits: 3672 | hits on page: 40
2026-03-28 12:00:15 [auto1.it] INFO: Found listing with ID: SN56705
2026-03-28 12:00:15 [auto1.it] INFO: Found listing with ID: RK00703
2026-03-28 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK00703%27 HTTP/1.1" 200 None
2026-03-28 12:00:15 [auto1.it] INFO: Scrape type for RK00703: 1
2026-03-28 12:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:15 [auto1.it] INFO: Found listing with ID: KM72059
2026-03-28 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM72059%27 HTTP/1.1" 200 None
2026-03-28 12:00:15 [auto1.it] INFO: Scrape type for KM72059: 1
2026-03-28 12:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:15 [auto1.it] INFO: Found listing with ID: NL56799
2026-03-28 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL56799%27 HTTP/1.1" 200 None
2026-03-28 12:00:15 [auto1.it] INFO: Scrape type for NL56799: 1
2026-03-28 12:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:15 [auto1.it] INFO: Found listing with ID: CZ11346
2026-03-28 12:00:15 [auto1.it] INFO: Found listing with ID: ZV36877
2026-03-28 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV36877%27 HTTP/1.1" 200 None
2026-03-28 12:00:15 [auto1.it] INFO: Scrape type for ZV36877: 2
2026-03-28 12:00:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3174b104-faff-5ae9-8134-5d4f659f2e28 with identifier: ZV36877
2026-03-28 12:00:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3174b104-faff-5ae9-8134-5d4f659f2e28 with scrape type 2
2026-03-28 12:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3174b104-faff-5ae9-8134-5d4f659f2e28 with scrape type 2
2026-03-28 12:00:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3174b104-faff-5ae9-8134-5d4f659f2e28, identifier: ZV36877
2026-03-28 12:00:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3174b104-faff-5ae9-8134-5d4f659f2e28 with identifier: ZV36877
2026-03-28 12:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 12:00:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 12:00:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3174b104-faff-5ae9-8134-5d4f659f2e28 with identifier: ZV36877
2026-03-28 12:00:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3174b104-faff-5ae9-8134-5d4f659f2e28 with identifier: ZV36877 to the API
2026-03-28 12:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 299,
'expiration_date': '2026-03-30T15:27:12Z',
'fuel_type': 'hybrid',
'id': '3174b104-faff-5ae9-8134-5d4f659f2e28',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV36877',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 119173,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-27',
'seller_name': None,
'title': 'Audi Q5 50 TFSIe quattro Business',
'transmission': 'automatic',
'trim': 'quattro Business',
'year': 2020}
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV36877%27 HTTP/1.1" 200 None
2026-03-28 12:00:16 [auto1.it] INFO: Saving data for ZV36877: {'auction_closing_time': 1774884432.0, 'created_time': 1774342908.397117, 'last_price_update_time': 1774699216.128579}
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZV36877') HTTP/1.1" 204 0
2026-03-28 12:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:16 [auto1.it] INFO: Found listing with ID: AW40388
2026-03-28 12:00:16 [auto1.it] INFO: Found listing with ID: UR17084
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR17084%27 HTTP/1.1" 200 None
2026-03-28 12:00:16 [auto1.it] INFO: Scrape type for UR17084: 1
2026-03-28 12:00:16 [auto1.it] INFO: Found listing with ID: DE71304
2026-03-28 12:00:16 [auto1.it] INFO: Found listing with ID: LA00570
2026-03-28 12:00:16 [auto1.it] INFO: Found listing with ID: ST97650
2026-03-28 12:00:16 [auto1.it] INFO: Found listing with ID: CD54959
2026-03-28 12:00:16 [auto1.it] INFO: Found listing with ID: ZH08694
2026-03-28 12:00:16 [auto1.it] INFO: Found listing with ID: WN91380
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN91380%27 HTTP/1.1" 200 None
2026-03-28 12:00:16 [auto1.it] INFO: Scrape type for WN91380: 1
2026-03-28 12:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:16 [auto1.it] INFO: Found listing with ID: RT10721
2026-03-28 12:00:16 [auto1.it] INFO: Found listing with ID: XL68174
2026-03-28 12:00:16 [auto1.it] INFO: Found listing with ID: NR40821
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR40821%27 HTTP/1.1" 200 None
2026-03-28 12:00:16 [auto1.it] INFO: Scrape type for NR40821: 1
2026-03-28 12:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:16 [auto1.it] INFO: Found listing with ID: NR41367
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR41367%27 HTTP/1.1" 200 None
2026-03-28 12:00:16 [auto1.it] INFO: Scrape type for NR41367: 2
2026-03-28 12:00:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 033d8790-ff33-5923-97e7-5ff25f530d02 with identifier: NR41367
2026-03-28 12:00:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 033d8790-ff33-5923-97e7-5ff25f530d02 with scrape type 2
2026-03-28 12:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 033d8790-ff33-5923-97e7-5ff25f530d02 with scrape type 2
2026-03-28 12:00:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 033d8790-ff33-5923-97e7-5ff25f530d02, identifier: NR41367
2026-03-28 12:00:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 033d8790-ff33-5923-97e7-5ff25f530d02 with identifier: NR41367
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 12:00:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 12:00:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 033d8790-ff33-5923-97e7-5ff25f530d02 with identifier: NR41367
2026-03-28 12:00:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 033d8790-ff33-5923-97e7-5ff25f530d02 with identifier: NR41367 to the API
2026-03-28 12:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:49:47Z',
'fuel_type': 'diesel',
'id': '033d8790-ff33-5923-97e7-5ff25f530d02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR41367',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 199776,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-10',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Business Line BlueMotion Tech.',
'transmission': 'automatic',
'trim': 'Business Line BlueMotion Tech.',
'year': 2016}
2026-03-28 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR41367%27 HTTP/1.1" 200 None
2026-03-28 12:00:17 [auto1.it] INFO: Saving data for NR41367: {'auction_closing_time': 1774885787.0, 'created_time': 1773824475.916598, 'last_price_update_time': 1774699217.774168}
2026-03-28 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR41367') HTTP/1.1" 204 0
2026-03-28 12:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:17 [auto1.it] INFO: Found listing with ID: DS09954
2026-03-28 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS09954%27 HTTP/1.1" 200 None
2026-03-28 12:00:17 [auto1.it] INFO: Scrape type for DS09954: 2
2026-03-28 12:00:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05f504f7-cd1f-5b4a-8c4e-c8f5e939fb07 with identifier: DS09954
2026-03-28 12:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05f504f7-cd1f-5b4a-8c4e-c8f5e939fb07 with scrape type 2
2026-03-28 12:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05f504f7-cd1f-5b4a-8c4e-c8f5e939fb07 with scrape type 2
2026-03-28 12:00:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 05f504f7-cd1f-5b4a-8c4e-c8f5e939fb07, identifier: DS09954
2026-03-28 12:00:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 05f504f7-cd1f-5b4a-8c4e-c8f5e939fb07 with identifier: DS09954
2026-03-28 12:00:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 05f504f7-cd1f-5b4a-8c4e-c8f5e939fb07 with identifier: DS09954
2026-03-28 12:00:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 05f504f7-cd1f-5b4a-8c4e-c8f5e939fb07 with identifier: DS09954 to the API
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:04:37Z',
'fuel_type': 'diesel',
'id': '05f504f7-cd1f-5b4a-8c4e-c8f5e939fb07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS09954',
'listing': 'auction',
'make': 'Jaguar',
'model': 'E-Pace',
'odometer': 123155,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-01',
'seller_name': None,
'title': 'Jaguar E-Pace D150 S AWD',
'transmission': 'automatic',
'trim': 'S AWD',
'year': 2019}
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS09954%27 HTTP/1.1" 200 None
2026-03-28 12:00:18 [auto1.it] INFO: Saving data for DS09954: {'auction_closing_time': 1774883077.0, 'created_time': 1773836367.636475, 'last_price_update_time': 1774699218.413617}
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DS09954') HTTP/1.1" 204 0
2026-03-28 12:00:18 [auto1.it] INFO: Found listing with ID: EF37813
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF37813%27 HTTP/1.1" 200 None
2026-03-28 12:00:18 [auto1.it] INFO: Scrape type for EF37813: 1
2026-03-28 12:00:18 [auto1.it] INFO: Found listing with ID: CJ77239
2026-03-28 12:00:18 [auto1.it] INFO: Found listing with ID: BT82313
2026-03-28 12:00:18 [auto1.it] INFO: Found listing with ID: MN04958
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN04958%27 HTTP/1.1" 200 None
2026-03-28 12:00:18 [auto1.it] INFO: Scrape type for MN04958: 1
2026-03-28 12:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:18 [auto1.it] INFO: Found listing with ID: LR68259
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR68259%27 HTTP/1.1" 200 None
2026-03-28 12:00:18 [auto1.it] INFO: Scrape type for LR68259: 1
2026-03-28 12:00:18 [auto1.it] INFO: Found listing with ID: WB58416
2026-03-28 12:00:18 [auto1.it] INFO: Found listing with ID: CS61296
2026-03-28 12:00:18 [auto1.it] INFO: Found listing with ID: HA26837
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA26837%27 HTTP/1.1" 200 None
2026-03-28 12:00:18 [auto1.it] INFO: Scrape type for HA26837: 1
2026-03-28 12:00:18 [auto1.it] INFO: Found listing with ID: DE59865
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE59865%27 HTTP/1.1" 200 None
2026-03-28 12:00:18 [auto1.it] INFO: Scrape type for DE59865: 1
2026-03-28 12:00:18 [auto1.it] INFO: Found listing with ID: JE63706
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE63706%27 HTTP/1.1" 200 None
2026-03-28 12:00:18 [auto1.it] INFO: Scrape type for JE63706: 1
2026-03-28 12:00:18 [auto1.it] INFO: Found listing with ID: CN51839
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN51839%27 HTTP/1.1" 200 None
2026-03-28 12:00:18 [auto1.it] INFO: Scrape type for CN51839: 1
2026-03-28 12:00:18 [auto1.it] INFO: Found listing with ID: JR85955
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR85955%27 HTTP/1.1" 200 None
2026-03-28 12:00:18 [auto1.it] INFO: Scrape type for JR85955: 1
2026-03-28 12:00:18 [auto1.it] INFO: Found listing with ID: MC18601
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC18601%27 HTTP/1.1" 200 None
2026-03-28 12:00:18 [auto1.it] INFO: Scrape type for MC18601: 1
2026-03-28 12:00:18 [auto1.it] INFO: Found listing with ID: JH97185
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH97185%27 HTTP/1.1" 200 None
2026-03-28 12:00:18 [auto1.it] INFO: Scrape type for JH97185: 1
2026-03-28 12:00:18 [auto1.it] INFO: Found listing with ID: SY20877
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY20877%27 HTTP/1.1" 200 None
2026-03-28 12:00:18 [auto1.it] INFO: Scrape type for SY20877: 2
2026-03-28 12:00:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3329e94-cf5d-54de-b418-14f57d4bb411 with identifier: SY20877
2026-03-28 12:00:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3329e94-cf5d-54de-b418-14f57d4bb411 with scrape type 2
2026-03-28 12:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3329e94-cf5d-54de-b418-14f57d4bb411 with scrape type 2
2026-03-28 12:00:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a3329e94-cf5d-54de-b418-14f57d4bb411, identifier: SY20877
2026-03-28 12:00:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a3329e94-cf5d-54de-b418-14f57d4bb411 with identifier: SY20877
2026-03-28 12:00:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a3329e94-cf5d-54de-b418-14f57d4bb411 with identifier: SY20877
2026-03-28 12:00:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a3329e94-cf5d-54de-b418-14f57d4bb411 with identifier: SY20877 to the API
2026-03-28 12:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:51:48Z',
'fuel_type': 'diesel',
'id': 'a3329e94-cf5d-54de-b418-14f57d4bb411',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY20877',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 177255,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-06',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI Admired',
'transmission': 'manual',
'trim': 'Admired',
'year': 2015}
2026-03-28 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY20877%27 HTTP/1.1" 200 None
2026-03-28 12:00:20 [auto1.it] INFO: Saving data for SY20877: {'auction_closing_time': 1774885908.0, 'created_time': 1774342923.128528, 'last_price_update_time': 1774699220.757068}
2026-03-28 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SY20877') HTTP/1.1" 204 0
2026-03-28 12:00:20 [auto1.it] INFO: Found listing with ID: KT14926
2026-03-28 12:00:20 [auto1.it] INFO: Found listing with ID: SD18580
2026-03-28 12:00:20 [auto1.it] INFO: Found listing with ID: TW38851
2026-03-28 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW38851%27 HTTP/1.1" 200 None
2026-03-28 12:00:20 [auto1.it] INFO: Scrape type for TW38851: 1
2026-03-28 12:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR17084/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN91380/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR40821/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:20 [auto1.it] INFO: Found listing with ID: RM24928
2026-03-28 12:00:20 [auto1.it] INFO: Found listing with ID: DF57379
2026-03-28 12:00:20 [auto1.it] INFO: Found listing with ID: VG07643
2026-03-28 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG07643%27 HTTP/1.1" 200 None
2026-03-28 12:00:20 [auto1.it] INFO: Scrape type for VG07643: 1
2026-03-28 12:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KM72059/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK00703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:21 [auto1.it] INFO: Channel: 24h | Page: 1 | totalHits: 3672 | hits on page: 40
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: SN56705
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: RK00703
2026-03-28 12:00:21 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/RK00703/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: KM72059
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: NL56799
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: CZ11346
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: ZV36877
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV36877%27 HTTP/1.1" 200 None
2026-03-28 12:00:21 [auto1.it] INFO: Scrape type for ZV36877: 0
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: AW40388
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: UR17084
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: DE71304
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: LA00570
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: ST97650
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: CD54959
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: ZH08694
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: WN91380
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: RT10721
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: XL68174
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: NR40821
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: NR41367
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR41367%27 HTTP/1.1" 200 None
2026-03-28 12:00:21 [auto1.it] INFO: Scrape type for NR41367: 0
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: DS09954
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS09954%27 HTTP/1.1" 200 None
2026-03-28 12:00:21 [auto1.it] INFO: Scrape type for DS09954: 0
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: EF37813
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: CJ77239
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: BT82313
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: MN04958
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: LR68259
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: WB58416
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: CS61296
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: HA26837
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: DE59865
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: JE63706
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: CN51839
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: JR85955
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: MC18601
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: JH97185
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: SY20877
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY20877%27 HTTP/1.1" 200 None
2026-03-28 12:00:21 [auto1.it] INFO: Scrape type for SY20877: 0
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: KT14926
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: SD18580
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: TW38851
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: RM24928
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: DF57379
2026-03-28 12:00:21 [auto1.it] INFO: Found listing with ID: VG07643
2026-03-28 12:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF37813/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE59865/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN04958/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR68259/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN51839/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA26837/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JE63706/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR85955/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MC18601/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW38851/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG07643/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH97185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR40821> (referer: https://www.auto1.com/v1/car-details-view/NR40821/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN91380> (referer: https://www.auto1.com/v1/car-details-view/WN91380/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e19c65d6-2f92-5910-97de-dff7a3ffa16a with identifier: NR40821
2026-03-28 12:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e19c65d6-2f92-5910-97de-dff7a3ffa16a with scrape type 1
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e19c65d6-2f92-5910-97de-dff7a3ffa16a
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F84%252F2c84af9f4b4d0fe77df23dfe89d25e61%252Fpa%252FNR40821_c77f37faff04b6d6345d896e0c2b2f5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_c77f37faff04b6d6345d896e0c2b2f5a.jpg not downloaded yet
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F84%252F2c84af9f4b4d0fe77df23dfe89d25e61%252Fpa%252FNR40821_8265d311aa95966bec823772346e08e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_8265d311aa95966bec823772346e08e2.jpg not downloaded yet
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F84%252F2c84af9f4b4d0fe77df23dfe89d25e61%252Fpa%252FNR40821_ae6b17e01cbcda2df2512b34ca0c2f45.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_ae6b17e01cbcda2df2512b34ca0c2f45.jpg not downloaded yet
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F84%252F2c84af9f4b4d0fe77df23dfe89d25e61%252Fpa%252FNR40821_8270c2966cfc5b040958dcd4236155a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_8270c2966cfc5b040958dcd4236155a2.jpg not downloaded yet
2026-03-28 12:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcd6a59b-6876-5796-9172-f57fbc177e0c with identifier: WN91380
2026-03-28 12:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcd6a59b-6876-5796-9172-f57fbc177e0c with scrape type 1
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item dcd6a59b-6876-5796-9172-f57fbc177e0c
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F91%252Fd791be708e3eade407e5d423d79dd578%252Fpa%252FWN91380_ab1703bd9a7d3f478ae8706374b1a593.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_ab1703bd9a7d3f478ae8706374b1a593.jpg not downloaded yet
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F84%252F2c84af9f4b4d0fe77df23dfe89d25e61%252Fpa%252FNR40821_970e4517deada8b02d0bf0d914b78f7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_970e4517deada8b02d0bf0d914b78f7a.jpg not downloaded yet
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F91%252Fd791be708e3eade407e5d423d79dd578%252Fpa%252FWN91380_477a071263c315d2011c59f32b88368e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_477a071263c315d2011c59f32b88368e.jpg not downloaded yet
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F84%252F2c84af9f4b4d0fe77df23dfe89d25e61%252Fpa%252FNR40821_898e7571d38ee27c85538c19d986aaa4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_898e7571d38ee27c85538c19d986aaa4.jpg not downloaded yet
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F91%252Fd791be708e3eade407e5d423d79dd578%252Fpa%252FWN91380_bf3df18c671b5cc794a6d60d6c8cc6d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_bf3df18c671b5cc794a6d60d6c8cc6d4.jpg not downloaded yet
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F91%252Fd791be708e3eade407e5d423d79dd578%252Fpa%252FWN91380_70961fee834e01732df41fd3059fb886.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_70961fee834e01732df41fd3059fb886.jpg not downloaded yet
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F91%252Fd791be708e3eade407e5d423d79dd578%252Fpa%252FWN91380_d570ecb386d20b5806d8d2181d77ee93.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_d570ecb386d20b5806d8d2181d77ee93.jpg not downloaded yet
2026-03-28 12:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR17084> (referer: https://www.auto1.com/v1/car-details-view/UR17084/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f80bdab-b6ba-57d6-ac40-43a30cd592af with identifier: UR17084
2026-03-28 12:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af with scrape type 1
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Feb%252Fd8ebf03be867bbc61c41ffbefb5579a9%252Fpa%252FUR17084_36397e4c8da7bffa485b40298ed064b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_36397e4c8da7bffa485b40298ed064b4.jpg not downloaded yet
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Feb%252Fd8ebf03be867bbc61c41ffbefb5579a9%252Fpa%252FUR17084_157c5913c798b4da8c396617463b97eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_157c5913c798b4da8c396617463b97eb.jpg not downloaded yet
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Feb%252Fd8ebf03be867bbc61c41ffbefb5579a9%252Fpa%252FUR17084_57d26ac64e54724316964d8bba16f5fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_57d26ac64e54724316964d8bba16f5fe.jpg not downloaded yet
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Feb%252Fd8ebf03be867bbc61c41ffbefb5579a9%252Fpa%252FUR17084_5af4a7c811370fb5dd09d4e11048374e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_5af4a7c811370fb5dd09d4e11048374e.jpg not downloaded yet
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Feb%252Fd8ebf03be867bbc61c41ffbefb5579a9%252Fpa%252FUR17084_beff3219778722e35478b8a46a995806.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_beff3219778722e35478b8a46a995806.jpg not downloaded yet
2026-03-28 12:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_d570ecb386d20b5806d8d2181d77ee93.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN04958> (referer: https://www.auto1.com/v1/car-details-view/MN04958/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF37813> (referer: https://www.auto1.com/v1/car-details-view/EF37813/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE59865> (referer: https://www.auto1.com/v1/car-details-view/DE59865/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 12:00:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 12:00:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d683b50>
2026-03-28 12:00:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2122
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd6a59b-6876-5796-9172-f57fbc177e0c/dcd6a59b-6876-5796-9172-f57fbc177e0c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F91%252Fd791be708e3eade407e5d423d79dd578%252Fpa%252FWN91380_d570ecb386d20b5806d8d2181d77ee93.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_d570ecb386d20b5806d8d2181d77ee93.jpg saved to cache
2026-03-28 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dcd6a59b-6876-5796-9172-f57fbc177e0c
2026-03-28 12:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_beff3219778722e35478b8a46a995806.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN51839> (referer: https://www.auto1.com/v1/car-details-view/CN51839/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64632782-e5e8-5abf-84d9-ed988f82222b with identifier: MN04958
2026-03-28 12:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64632782-e5e8-5abf-84d9-ed988f82222b with scrape type 1
2026-03-28 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 64632782-e5e8-5abf-84d9-ed988f82222b
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F28%252Ff628f589a04f6956847f22a66b7ad4ca%252Fpa%252FMN04958_ad551efa68666eed74dc96fd7784920c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_ad551efa68666eed74dc96fd7784920c.jpg already downloaded
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F28%252Ff628f589a04f6956847f22a66b7ad4ca%252Fpa%252FMN04958_1787bf565f8a870d096cdec3997819fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_1787bf565f8a870d096cdec3997819fc.jpg already downloaded
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F28%252Ff628f589a04f6956847f22a66b7ad4ca%252Fpa%252FMN04958_f51b4dd645edc7848a561bba32c9617c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_f51b4dd645edc7848a561bba32c9617c.jpg already downloaded
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F28%252Ff628f589a04f6956847f22a66b7ad4ca%252Fpa%252FMN04958_5d413f5da42c07cd04745006d2b2306b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_5d413f5da42c07cd04745006d2b2306b.jpg already downloaded
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F28%252Ff628f589a04f6956847f22a66b7ad4ca%252Fpa%252FMN04958_e187a7d877072efe1f2449dbf40201f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_e187a7d877072efe1f2449dbf40201f5.jpg already downloaded
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F28%252Ff628f589a04f6956847f22a66b7ad4ca%252Fpa%252FMN04958_a694ad5bd33945ae2482a753943c24b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_a694ad5bd33945ae2482a753943c24b3.jpg already downloaded
2026-03-28 12:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 64632782-e5e8-5abf-84d9-ed988f82222b, identifier: MN04958
2026-03-28 12:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99499219-33fa-5c59-ace4-570d5eeefad7 with identifier: EF37813
2026-03-28 12:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99499219-33fa-5c59-ace4-570d5eeefad7 with scrape type 1
2026-03-28 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 99499219-33fa-5c59-ace4-570d5eeefad7
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8db3ec62c4ac46fc322071f363823e%252Fpa%252FEF37813_8246c970d3bac28540a7dd9d8818ae0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_8246c970d3bac28540a7dd9d8818ae0d.jpg not downloaded yet
2026-03-28 12:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8 with identifier: DE59865
2026-03-28 12:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8 with scrape type 1
2026-03-28 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F4f%252F0c4f29a933f307c3bf8779abd6245d6b%252Fpa%252FDE59865_6d63c88018de0029c55a8073eff42a3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_6d63c88018de0029c55a8073eff42a3b.jpg not downloaded yet
2026-03-28 12:00:24 [auto1.it] INFO: Channel: 24h | Page: 2 | totalHits: 3672 | hits on page: 40
2026-03-28 12:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 64632782-e5e8-5abf-84d9-ed988f82222b with identifier: MN04958
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 12:00:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 64632782-e5e8-5abf-84d9-ed988f82222b with identifier: MN04958
2026-03-28 12:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 64632782-e5e8-5abf-84d9-ed988f82222b with identifier: MN04958 to the API
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MN04958>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': 'Rental',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:33:17Z',
'fuel_type': 'diesel',
'id': '64632782-e5e8-5abf-84d9-ed988f82222b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN04958',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Fiat',
'model': 'Qubo',
'odometer': 272898,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_ad551efa68666eed74dc96fd7784920c.jpg',
'https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_1787bf565f8a870d096cdec3997819fc.jpg',
'https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_f51b4dd645edc7848a561bba32c9617c.jpg',
'https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_5d413f5da42c07cd04745006d2b2306b.jpg',
'https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_e187a7d877072efe1f2449dbf40201f5.jpg',
'https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_a694ad5bd33945ae2482a753943c24b3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64632782-e5e8-5abf-84d9-ed988f82222b/64632782-e5e8-5abf-84d9-ed988f82222b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68590,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_ad551efa68666eed74dc96fd7784920c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64632782-e5e8-5abf-84d9-ed988f82222b/64632782-e5e8-5abf-84d9-ed988f82222b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_1787bf565f8a870d096cdec3997819fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64632782-e5e8-5abf-84d9-ed988f82222b/64632782-e5e8-5abf-84d9-ed988f82222b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_f51b4dd645edc7848a561bba32c9617c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64632782-e5e8-5abf-84d9-ed988f82222b/64632782-e5e8-5abf-84d9-ed988f82222b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_5d413f5da42c07cd04745006d2b2306b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64632782-e5e8-5abf-84d9-ed988f82222b/64632782-e5e8-5abf-84d9-ed988f82222b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48524,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_e187a7d877072efe1f2449dbf40201f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64632782-e5e8-5abf-84d9-ed988f82222b/64632782-e5e8-5abf-84d9-ed988f82222b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130434,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/28/f628f589a04f6956847f22a66b7ad4ca/pa/MN04958_a694ad5bd33945ae2482a753943c24b3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Qubo 1.3 JTD MyLife',
'transmission': 'manual',
'trim': 'MyLife',
'year': 2012}
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN04958%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [auto1.it] INFO: Saving data for MN04958: {'created_time': 1774699228.366516, 'last_price_update_time': 1774699228.366525, 'auction_closing_time': 1774884797.0}
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MN04958') HTTP/1.1" 204 0
2026-03-28 12:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_5af4a7c811370fb5dd09d4e11048374e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8db3ec62c4ac46fc322071f363823e%252Fpa%252FEF37813_da42ef4e89084b0cadec6cf4149ac875.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_da42ef4e89084b0cadec6cf4149ac875.jpg not downloaded yet
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F4f%252F0c4f29a933f307c3bf8779abd6245d6b%252Fpa%252FDE59865_c49533d99af3a5db9497f94772decc90.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_c49533d99af3a5db9497f94772decc90.jpg not downloaded yet
2026-03-28 12:00:28 [auto1.it] INFO: Found listing with ID: XB46951
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB46951%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [auto1.it] INFO: Scrape type for XB46951: 1
2026-03-28 12:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_57d26ac64e54724316964d8bba16f5fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK00703> (referer: https://www.auto1.com/v1/car-details-view/RK00703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR68259> (referer: https://www.auto1.com/v1/car-details-view/LR68259/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6616d0>
2026-03-28 12:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Feb%252Fd8ebf03be867bbc61c41ffbefb5579a9%252Fpa%252FUR17084_beff3219778722e35478b8a46a995806.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_beff3219778722e35478b8a46a995806.jpg saved to cache
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af
2026-03-28 12:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b1f7ff3-70a1-5783-b754-315a4f954457 with identifier: CN51839
2026-03-28 12:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b1f7ff3-70a1-5783-b754-315a4f954457 with scrape type 1
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6b1f7ff3-70a1-5783-b754-315a4f954457
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F26%252Fde266645155c607b63ae52b5b0a1d394%252Fpa%252FCN51839_0f2a26da1a2911896a14b4015e6b60b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_0f2a26da1a2911896a14b4015e6b60b4.jpg not downloaded yet
2026-03-28 12:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_70961fee834e01732df41fd3059fb886.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8db3ec62c4ac46fc322071f363823e%252Fpa%252FEF37813_2e2a94c820710db3fba9ecea2b804a05.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_2e2a94c820710db3fba9ecea2b804a05.jpg not downloaded yet
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F4f%252F0c4f29a933f307c3bf8779abd6245d6b%252Fpa%252FDE59865_091993a9309877d3947d7b5d67b41a71.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_091993a9309877d3947d7b5d67b41a71.jpg not downloaded yet
2026-03-28 12:00:28 [auto1.it] INFO: Found listing with ID: UN20093
2026-03-28 12:00:28 [auto1.it] INFO: Found listing with ID: UT21803
2026-03-28 12:00:28 [auto1.it] INFO: Found listing with ID: YJ81563
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ81563%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [auto1.it] INFO: Scrape type for YJ81563: 1
2026-03-28 12:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F26%252Fde266645155c607b63ae52b5b0a1d394%252Fpa%252FCN51839_c4520e8b6c455e5e45db7ca925422131.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_c4520e8b6c455e5e45db7ca925422131.jpg not downloaded yet
2026-03-28 12:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_36397e4c8da7bffa485b40298ed064b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_157c5913c798b4da8c396617463b97eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8db3ec62c4ac46fc322071f363823e%252Fpa%252FEF37813_06ac722b5982abac49e57f7ffdc694da.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_06ac722b5982abac49e57f7ffdc694da.jpg not downloaded yet
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F4f%252F0c4f29a933f307c3bf8779abd6245d6b%252Fpa%252FDE59865_d86ffec2757efe712a4c2336cb2ac163.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_d86ffec2757efe712a4c2336cb2ac163.jpg not downloaded yet
2026-03-28 12:00:28 [auto1.it] INFO: Found listing with ID: RC42052
2026-03-28 12:00:28 [auto1.it] INFO: Found listing with ID: JF24469
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF24469%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [auto1.it] INFO: Scrape type for JF24469: 1
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F26%252Fde266645155c607b63ae52b5b0a1d394%252Fpa%252FCN51839_d3f4e28abc8944b1e5ae41491acc9705.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_d3f4e28abc8944b1e5ae41491acc9705.jpg not downloaded yet
2026-03-28 12:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4ce750>
2026-03-28 12:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Feb%252Fd8ebf03be867bbc61c41ffbefb5579a9%252Fpa%252FUR17084_5af4a7c811370fb5dd09d4e11048374e.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_5af4a7c811370fb5dd09d4e11048374e.jpg saved to cache
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af
2026-03-28 12:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbc6690>
2026-03-28 12:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Feb%252Fd8ebf03be867bbc61c41ffbefb5579a9%252Fpa%252FUR17084_57d26ac64e54724316964d8bba16f5fe.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_57d26ac64e54724316964d8bba16f5fe.jpg saved to cache
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af
2026-03-28 12:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 238aeef4-9f88-5147-96d2-a6d53e923922 with identifier: RK00703
2026-03-28 12:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 238aeef4-9f88-5147-96d2-a6d53e923922 with scrape type 1
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 238aeef4-9f88-5147-96d2-a6d53e923922
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F24%252F21248c6109a558faf0e48d3b8dc210c9%252Fpa%252FRK00703_f4ec6e286ec4a8edaddb84d155186d34.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_f4ec6e286ec4a8edaddb84d155186d34.jpg already downloaded
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F24%252F21248c6109a558faf0e48d3b8dc210c9%252Fpa%252FRK00703_fa652d53977976d48e33c37cd9368f30.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_fa652d53977976d48e33c37cd9368f30.jpg already downloaded
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F24%252F21248c6109a558faf0e48d3b8dc210c9%252Fpa%252FRK00703_61faaa9fb7a50d2f75f6b70fe358d00c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_61faaa9fb7a50d2f75f6b70fe358d00c.jpg already downloaded
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F24%252F21248c6109a558faf0e48d3b8dc210c9%252Fpa%252FRK00703_06d9aebf2bf498c48b933d67e4ebf1ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_06d9aebf2bf498c48b933d67e4ebf1ed.jpg already downloaded
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F24%252F21248c6109a558faf0e48d3b8dc210c9%252Fpa%252FRK00703_38778e856c22410702d011f7a93a97cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_38778e856c22410702d011f7a93a97cd.jpg already downloaded
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F24%252F21248c6109a558faf0e48d3b8dc210c9%252Fpa%252FRK00703_162ea50a8c79148a18ea59bee5d815dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_162ea50a8c79148a18ea59bee5d815dd.jpg already downloaded
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F24%252F21248c6109a558faf0e48d3b8dc210c9%252Fpa%252FRK00703_988167e538a25a6b1f4c3ff257f6f9da.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_988167e538a25a6b1f4c3ff257f6f9da.jpg already downloaded
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F24%252F21248c6109a558faf0e48d3b8dc210c9%252Fpa%252FRK00703_6d469e35fb941e9f5d6f82ac2de11762.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_6d469e35fb941e9f5d6f82ac2de11762.jpg already downloaded
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F24%252F21248c6109a558faf0e48d3b8dc210c9%252Fpa%252FRK00703_6e102b618e4760f325507260670cca42.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_6e102b618e4760f325507260670cca42.jpg already downloaded
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F24%252F21248c6109a558faf0e48d3b8dc210c9%252Fpa%252FRK00703_00096c9beae090ab393aab529fc56560.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_00096c9beae090ab393aab529fc56560.jpg already downloaded
2026-03-28 12:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 238aeef4-9f88-5147-96d2-a6d53e923922, identifier: RK00703
2026-03-28 12:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d6224d1-2a5b-5f43-a3e4-ff06578f698d with identifier: LR68259
2026-03-28 12:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d with scrape type 1
2026-03-28 12:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_523031ee1b7fb70beea74818887b27a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_523031ee1b7fb70beea74818887b27a5.jpg not downloaded yet
2026-03-28 12:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_6d63c88018de0029c55a8073eff42a3b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8db3ec62c4ac46fc322071f363823e%252Fpa%252FEF37813_e473e8ed73a813e696ea44d259751d3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_e473e8ed73a813e696ea44d259751d3e.jpg not downloaded yet
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F4f%252F0c4f29a933f307c3bf8779abd6245d6b%252Fpa%252FDE59865_f8d3aa1166a7d85bdcd07adffc613751.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_f8d3aa1166a7d85bdcd07adffc613751.jpg not downloaded yet
2026-03-28 12:00:29 [auto1.it] INFO: Found listing with ID: VZ90962
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ90962%27 HTTP/1.1" 200 None
2026-03-28 12:00:29 [auto1.it] INFO: Scrape type for VZ90962: 1
2026-03-28 12:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 238aeef4-9f88-5147-96d2-a6d53e923922 with identifier: RK00703
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 12:00:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 238aeef4-9f88-5147-96d2-a6d53e923922 with identifier: RK00703
2026-03-28 12:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 238aeef4-9f88-5147-96d2-a6d53e923922 with identifier: RK00703 to the API
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RK00703>
{'auction_title': '',
'c_o_2_emission_value': 153,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:15:47Z',
'fuel_type': 'diesel',
'id': '238aeef4-9f88-5147-96d2-a6d53e923922',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK00703',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'BMW',
'model': 'X1',
'odometer': 168413,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_f4ec6e286ec4a8edaddb84d155186d34.jpg',
'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_fa652d53977976d48e33c37cd9368f30.jpg',
'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_61faaa9fb7a50d2f75f6b70fe358d00c.jpg',
'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_06d9aebf2bf498c48b933d67e4ebf1ed.jpg',
'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_38778e856c22410702d011f7a93a97cd.jpg',
'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_162ea50a8c79148a18ea59bee5d815dd.jpg',
'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_988167e538a25a6b1f4c3ff257f6f9da.jpg',
'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_6d469e35fb941e9f5d6f82ac2de11762.jpg',
'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_6e102b618e4760f325507260670cca42.jpg',
'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_00096c9beae090ab393aab529fc56560.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238aeef4-9f88-5147-96d2-a6d53e923922/238aeef4-9f88-5147-96d2-a6d53e923922_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_f4ec6e286ec4a8edaddb84d155186d34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238aeef4-9f88-5147-96d2-a6d53e923922/238aeef4-9f88-5147-96d2-a6d53e923922_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64749,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_fa652d53977976d48e33c37cd9368f30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238aeef4-9f88-5147-96d2-a6d53e923922/238aeef4-9f88-5147-96d2-a6d53e923922_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67460,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_61faaa9fb7a50d2f75f6b70fe358d00c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238aeef4-9f88-5147-96d2-a6d53e923922/238aeef4-9f88-5147-96d2-a6d53e923922_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_06d9aebf2bf498c48b933d67e4ebf1ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238aeef4-9f88-5147-96d2-a6d53e923922/238aeef4-9f88-5147-96d2-a6d53e923922_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_38778e856c22410702d011f7a93a97cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238aeef4-9f88-5147-96d2-a6d53e923922/238aeef4-9f88-5147-96d2-a6d53e923922_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61042,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_162ea50a8c79148a18ea59bee5d815dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238aeef4-9f88-5147-96d2-a6d53e923922/238aeef4-9f88-5147-96d2-a6d53e923922_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_988167e538a25a6b1f4c3ff257f6f9da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238aeef4-9f88-5147-96d2-a6d53e923922/238aeef4-9f88-5147-96d2-a6d53e923922_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2751361,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_6d469e35fb941e9f5d6f82ac2de11762.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238aeef4-9f88-5147-96d2-a6d53e923922/238aeef4-9f88-5147-96d2-a6d53e923922_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61087,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_6e102b618e4760f325507260670cca42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238aeef4-9f88-5147-96d2-a6d53e923922/238aeef4-9f88-5147-96d2-a6d53e923922_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/24/21248c6109a558faf0e48d3b8dc210c9/pa/RK00703_00096c9beae090ab393aab529fc56560.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-08-11',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 xDrive 20d',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK00703%27 HTTP/1.1" 200 None
2026-03-28 12:00:29 [auto1.it] INFO: Saving data for RK00703: {'created_time': 1774699229.908076, 'last_price_update_time': 1774699229.908086, 'auction_closing_time': 1774883747.0}
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RK00703') HTTP/1.1" 204 0
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F26%252Fde266645155c607b63ae52b5b0a1d394%252Fpa%252FCN51839_49a1d5227524713f4f62ef760a460765.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_49a1d5227524713f4f62ef760a460765.jpg not downloaded yet
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_8ec45243856c2516dab175892126b4c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_8ec45243856c2516dab175892126b4c6.jpg not downloaded yet
2026-03-28 12:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_da42ef4e89084b0cadec6cf4149ac875.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_c49533d99af3a5db9497f94772decc90.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:29 [auto1.it] INFO: Found listing with ID: FR55532
2026-03-28 12:00:29 [auto1.it] INFO: Found listing with ID: BL56378
2026-03-28 12:00:29 [auto1.it] INFO: Found listing with ID: HF54587
2026-03-28 12:00:29 [auto1.it] INFO: Found listing with ID: AY76833
2026-03-28 12:00:29 [auto1.it] INFO: Found listing with ID: RJ05786
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ05786%27 HTTP/1.1" 200 None
2026-03-28 12:00:29 [auto1.it] INFO: Scrape type for RJ05786: 1
2026-03-28 12:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG07643> (referer: https://www.auto1.com/v1/car-details-view/VG07643/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbcc790>
2026-03-28 12:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd6a59b-6876-5796-9172-f57fbc177e0c/dcd6a59b-6876-5796-9172-f57fbc177e0c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F91%252Fd791be708e3eade407e5d423d79dd578%252Fpa%252FWN91380_70961fee834e01732df41fd3059fb886.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_70961fee834e01732df41fd3059fb886.jpg saved to cache
2026-03-28 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dcd6a59b-6876-5796-9172-f57fbc177e0c
2026-03-28 12:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d611050>
2026-03-28 12:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Feb%252Fd8ebf03be867bbc61c41ffbefb5579a9%252Fpa%252FUR17084_36397e4c8da7bffa485b40298ed064b4.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_36397e4c8da7bffa485b40298ed064b4.jpg saved to cache
2026-03-28 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af
2026-03-28 12:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d430e50>
2026-03-28 12:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Feb%252Fd8ebf03be867bbc61c41ffbefb5579a9%252Fpa%252FUR17084_157c5913c798b4da8c396617463b97eb.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_157c5913c798b4da8c396617463b97eb.jpg saved to cache
2026-03-28 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af
2026-03-28 12:00:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f80bdab-b6ba-57d6-ac40-43a30cd592af, skipping ID generation
2026-03-28 12:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af with scrape type 1
2026-03-28 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af sending to next pipeline
2026-03-28 12:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4f80bdab-b6ba-57d6-ac40-43a30cd592af, identifier: UR17084
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F26%252Fde266645155c607b63ae52b5b0a1d394%252Fpa%252FCN51839_fa50a9f81e0e4df1bc430a309d665a38.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_fa50a9f81e0e4df1bc430a309d665a38.jpg not downloaded yet
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_112d711e90c7e3ff00a2048226a0d973.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_112d711e90c7e3ff00a2048226a0d973.jpg not downloaded yet
2026-03-28 12:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR85955> (referer: https://www.auto1.com/v1/car-details-view/JR85955/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JE63706> (referer: https://www.auto1.com/v1/car-details-view/JE63706/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW38851> (referer: https://www.auto1.com/v1/car-details-view/TW38851/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MC18601> (referer: https://www.auto1.com/v1/car-details-view/MC18601/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4f80bdab-b6ba-57d6-ac40-43a30cd592af with identifier: UR17084
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 12:00:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4f80bdab-b6ba-57d6-ac40-43a30cd592af with identifier: UR17084
2026-03-28 12:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4f80bdab-b6ba-57d6-ac40-43a30cd592af with identifier: UR17084 to the API
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_157c5913c798b4da8c396617463b97eb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 174,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '2.1L',
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:32:33Z',
'fuel_type': 'diesel',
'id': '4f80bdab-b6ba-57d6-ac40-43a30cd592af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR17084',
'listing': 'auction',
'location': 'IT, Crema',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 385252,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_36397e4c8da7bffa485b40298ed064b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86146,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_157c5913c798b4da8c396617463b97eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_57d26ac64e54724316964d8bba16f5fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_5af4a7c811370fb5dd09d4e11048374e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_beff3219778722e35478b8a46a995806.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 CDI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2007}
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR17084%27 HTTP/1.1" 200 None
2026-03-28 12:00:31 [auto1.it] INFO: Saving data for UR17084: {'created_time': 1774699231.515076, 'last_price_update_time': 1774699231.515086, 'auction_closing_time': 1774884753.0}
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UR17084') HTTP/1.1" 204 0
2026-03-28 12:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_bf3df18c671b5cc794a6d60d6c8cc6d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:31 [auto1.it] INFO: Found listing with ID: CV60870
2026-03-28 12:00:31 [auto1.it] INFO: Found listing with ID: PM98470
2026-03-28 12:00:31 [auto1.it] INFO: Found listing with ID: XT30792
2026-03-28 12:00:31 [auto1.it] INFO: Found listing with ID: HD11089
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD11089%27 HTTP/1.1" 200 None
2026-03-28 12:00:31 [auto1.it] INFO: Scrape type for HD11089: 1
2026-03-28 12:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d47cb90>
2026-03-28 12:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8/7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F4f%252F0c4f29a933f307c3bf8779abd6245d6b%252Fpa%252FDE59865_6d63c88018de0029c55a8073eff42a3b.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_6d63c88018de0029c55a8073eff42a3b.jpg saved to cache
2026-03-28 12:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8
2026-03-28 12:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_c4520e8b6c455e5e45db7ca925422131.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_7b758fea3a2a0e2f6ce34032d75279db.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_7b758fea3a2a0e2f6ce34032d75279db.jpg not downloaded yet
2026-03-28 12:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f943bd0>
2026-03-28 12:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99499219-33fa-5c59-ace4-570d5eeefad7/99499219-33fa-5c59-ace4-570d5eeefad7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8db3ec62c4ac46fc322071f363823e%252Fpa%252FEF37813_da42ef4e89084b0cadec6cf4149ac875.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_da42ef4e89084b0cadec6cf4149ac875.jpg saved to cache
2026-03-28 12:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99499219-33fa-5c59-ace4-570d5eeefad7
2026-03-28 12:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca572d0>
2026-03-28 12:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8/7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F4f%252F0c4f29a933f307c3bf8779abd6245d6b%252Fpa%252FDE59865_c49533d99af3a5db9497f94772decc90.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_c49533d99af3a5db9497f94772decc90.jpg saved to cache
2026-03-28 12:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8
2026-03-28 12:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b1e1282-05f1-5451-93d8-17195d2ca8b4 with identifier: VG07643
2026-03-28 12:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b1e1282-05f1-5451-93d8-17195d2ca8b4 with scrape type 1
2026-03-28 12:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5b1e1282-05f1-5451-93d8-17195d2ca8b4
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fc3%252F65c367b33624734b620c77d49458a0eb%252Fpa%252FVG07643_775bcd3794bd28757a447c45b50c197b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_775bcd3794bd28757a447c45b50c197b.jpg not downloaded yet
2026-03-28 12:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_f8d3aa1166a7d85bdcd07adffc613751.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:31 [auto1.it] INFO: Found listing with ID: WM47642
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM47642%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [auto1.it] INFO: Scrape type for WM47642: 1
2026-03-28 12:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0 with identifier: JR85955
2026-03-28 12:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0 with scrape type 1
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc8%252F5ec8ed96d2cedcc8210232a7b142ccf2%252Fpa%252FJR85955_ef64f67049ff0b7d8745c715a0b89327.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_ef64f67049ff0b7d8745c715a0b89327.jpg not downloaded yet
2026-03-28 12:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db0d0188-6941-5d4b-8b86-f97ece41bab3 with identifier: JE63706
2026-03-28 12:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db0d0188-6941-5d4b-8b86-f97ece41bab3 with scrape type 1
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db0d0188-6941-5d4b-8b86-f97ece41bab3
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F51%252Fd6519befd041baca1c2b87056151a621%252Fpa%252FJE63706_e2b22d81601b1e77e481a7d85b41c4ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_e2b22d81601b1e77e481a7d85b41c4ce.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F51%252Fd6519befd041baca1c2b87056151a621%252Fpa%252FJE63706_0001344c46ba5292e3d6769adb0f2f6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_0001344c46ba5292e3d6769adb0f2f6e.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F51%252Fd6519befd041baca1c2b87056151a621%252Fpa%252FJE63706_bb14012a3a23778d4571c96c49ffaebd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_bb14012a3a23778d4571c96c49ffaebd.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F51%252Fd6519befd041baca1c2b87056151a621%252Fpa%252FJE63706_805fcf519807197ef3d8344b6ec879c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_805fcf519807197ef3d8344b6ec879c8.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F51%252Fd6519befd041baca1c2b87056151a621%252Fpa%252FJE63706_686c0b34d9c7530c97779ed023756ec9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_686c0b34d9c7530c97779ed023756ec9.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F51%252Fd6519befd041baca1c2b87056151a621%252Fpa%252FJE63706_51d60408d23e0a7d175d2b36031aac9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_51d60408d23e0a7d175d2b36031aac9e.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F51%252Fd6519befd041baca1c2b87056151a621%252Fpa%252FJE63706_89832bd80e101d23f46308765279f0ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_89832bd80e101d23f46308765279f0ec.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F51%252Fd6519befd041baca1c2b87056151a621%252Fpa%252FJE63706_da316c1c155612e6b0d23dc3350b3e32.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_da316c1c155612e6b0d23dc3350b3e32.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F51%252Fd6519befd041baca1c2b87056151a621%252Fpa%252FJE63706_1d8ce2e64251a67087dad1ff1d3f7459.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_1d8ce2e64251a67087dad1ff1d3f7459.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F51%252Fd6519befd041baca1c2b87056151a621%252Fpa%252FJE63706_3c9bd5fad678ab45c1859edf32d90d2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_3c9bd5fad678ab45c1859edf32d90d2d.jpg already downloaded
2026-03-28 12:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: db0d0188-6941-5d4b-8b86-f97ece41bab3, identifier: JE63706
2026-03-28 12:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a73da510-9b8a-5f67-9ad0-3ec139ec31b8 with identifier: TW38851
2026-03-28 12:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a73da510-9b8a-5f67-9ad0-3ec139ec31b8 with scrape type 1
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a73da510-9b8a-5f67-9ad0-3ec139ec31b8
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F3a%252F6a3a238680486db42a2fb0d4da5283bb%252Fpa%252FTW38851_35fdefb46fb905ccf78a13b81a829176.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_35fdefb46fb905ccf78a13b81a829176.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F3a%252F6a3a238680486db42a2fb0d4da5283bb%252Fpa%252FTW38851_4600c4df446ceb5a3d0e47c95346e77e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_4600c4df446ceb5a3d0e47c95346e77e.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F3a%252F6a3a238680486db42a2fb0d4da5283bb%252Fpa%252FTW38851_5bff8fb651a49879aa2e611e658f462d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_5bff8fb651a49879aa2e611e658f462d.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F3a%252F6a3a238680486db42a2fb0d4da5283bb%252Fpa%252FTW38851_1815d2149fb69e86690c79ebc62e4a75.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_1815d2149fb69e86690c79ebc62e4a75.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F3a%252F6a3a238680486db42a2fb0d4da5283bb%252Fpa%252FTW38851_dfd6e8551d41b0df44058f8729d9cf87.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_dfd6e8551d41b0df44058f8729d9cf87.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F3a%252F6a3a238680486db42a2fb0d4da5283bb%252Fpa%252FTW38851_813c256ee939a3d0d044d6f83471b8a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_813c256ee939a3d0d044d6f83471b8a9.jpg already downloaded
2026-03-28 12:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a73da510-9b8a-5f67-9ad0-3ec139ec31b8, identifier: TW38851
2026-03-28 12:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5 with identifier: MC18601
2026-03-28 12:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5 with scrape type 1
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb0%252Ff0b0559e70cddccec95a1e2795dba437%252Fpa%252FMC18601_ce5ad0a217e45e1271c981a061a59452.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_ce5ad0a217e45e1271c981a061a59452.jpg not downloaded yet
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_bcd875a92198728227af70a3da2a964f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_bcd875a92198728227af70a3da2a964f.jpg not downloaded yet
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fc3%252F65c367b33624734b620c77d49458a0eb%252Fpa%252FVG07643_40585806d3c845c718e7a16db028027f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_40585806d3c845c718e7a16db028027f.jpg not downloaded yet
2026-03-28 12:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: db0d0188-6941-5d4b-8b86-f97ece41bab3 with identifier: JE63706
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: db0d0188-6941-5d4b-8b86-f97ece41bab3 with identifier: JE63706
2026-03-28 12:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: db0d0188-6941-5d4b-8b86-f97ece41bab3 with identifier: JE63706 to the API
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JE63706>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:23:48Z',
'fuel_type': 'petrol',
'id': 'db0d0188-6941-5d4b-8b86-f97ece41bab3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE63706',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 35429,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_e2b22d81601b1e77e481a7d85b41c4ce.jpg',
'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_0001344c46ba5292e3d6769adb0f2f6e.jpg',
'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_bb14012a3a23778d4571c96c49ffaebd.jpg',
'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_805fcf519807197ef3d8344b6ec879c8.jpg',
'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_686c0b34d9c7530c97779ed023756ec9.jpg',
'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_51d60408d23e0a7d175d2b36031aac9e.jpg',
'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_89832bd80e101d23f46308765279f0ec.jpg',
'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_da316c1c155612e6b0d23dc3350b3e32.jpg',
'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_1d8ce2e64251a67087dad1ff1d3f7459.jpg',
'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_3c9bd5fad678ab45c1859edf32d90d2d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0d0188-6941-5d4b-8b86-f97ece41bab3/db0d0188-6941-5d4b-8b86-f97ece41bab3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_e2b22d81601b1e77e481a7d85b41c4ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0d0188-6941-5d4b-8b86-f97ece41bab3/db0d0188-6941-5d4b-8b86-f97ece41bab3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80943,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_0001344c46ba5292e3d6769adb0f2f6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0d0188-6941-5d4b-8b86-f97ece41bab3/db0d0188-6941-5d4b-8b86-f97ece41bab3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_bb14012a3a23778d4571c96c49ffaebd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0d0188-6941-5d4b-8b86-f97ece41bab3/db0d0188-6941-5d4b-8b86-f97ece41bab3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_805fcf519807197ef3d8344b6ec879c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0d0188-6941-5d4b-8b86-f97ece41bab3/db0d0188-6941-5d4b-8b86-f97ece41bab3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_686c0b34d9c7530c97779ed023756ec9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0d0188-6941-5d4b-8b86-f97ece41bab3/db0d0188-6941-5d4b-8b86-f97ece41bab3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74019,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_51d60408d23e0a7d175d2b36031aac9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0d0188-6941-5d4b-8b86-f97ece41bab3/db0d0188-6941-5d4b-8b86-f97ece41bab3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_89832bd80e101d23f46308765279f0ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0d0188-6941-5d4b-8b86-f97ece41bab3/db0d0188-6941-5d4b-8b86-f97ece41bab3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88424,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_da316c1c155612e6b0d23dc3350b3e32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0d0188-6941-5d4b-8b86-f97ece41bab3/db0d0188-6941-5d4b-8b86-f97ece41bab3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_1d8ce2e64251a67087dad1ff1d3f7459.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0d0188-6941-5d4b-8b86-f97ece41bab3/db0d0188-6941-5d4b-8b86-f97ece41bab3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/51/d6519befd041baca1c2b87056151a621/pa/JE63706_3c9bd5fad678ab45c1859edf32d90d2d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-02-08',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2023}
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE63706%27 HTTP/1.1" 200 None
2026-03-28 12:00:33 [auto1.it] INFO: Saving data for JE63706: {'created_time': 1774699233.232668, 'last_price_update_time': 1774699233.232679, 'auction_closing_time': 1774884228.0}
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JE63706') HTTP/1.1" 204 0
2026-03-28 12:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a73da510-9b8a-5f67-9ad0-3ec139ec31b8 with identifier: TW38851
2026-03-28 12:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a73da510-9b8a-5f67-9ad0-3ec139ec31b8 with identifier: TW38851
2026-03-28 12:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a73da510-9b8a-5f67-9ad0-3ec139ec31b8 with identifier: TW38851 to the API
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TW38851>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:31:17Z',
'fuel_type': 'diesel',
'id': 'a73da510-9b8a-5f67-9ad0-3ec139ec31b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW38851',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Ford',
'model': 'C-Max',
'odometer': 303601,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_35fdefb46fb905ccf78a13b81a829176.jpg',
'https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_4600c4df446ceb5a3d0e47c95346e77e.jpg',
'https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_5bff8fb651a49879aa2e611e658f462d.jpg',
'https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_1815d2149fb69e86690c79ebc62e4a75.jpg',
'https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_dfd6e8551d41b0df44058f8729d9cf87.jpg',
'https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_813c256ee939a3d0d044d6f83471b8a9.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73da510-9b8a-5f67-9ad0-3ec139ec31b8/a73da510-9b8a-5f67-9ad0-3ec139ec31b8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_35fdefb46fb905ccf78a13b81a829176.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73da510-9b8a-5f67-9ad0-3ec139ec31b8/a73da510-9b8a-5f67-9ad0-3ec139ec31b8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_4600c4df446ceb5a3d0e47c95346e77e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73da510-9b8a-5f67-9ad0-3ec139ec31b8/a73da510-9b8a-5f67-9ad0-3ec139ec31b8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_5bff8fb651a49879aa2e611e658f462d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73da510-9b8a-5f67-9ad0-3ec139ec31b8/a73da510-9b8a-5f67-9ad0-3ec139ec31b8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87350,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_1815d2149fb69e86690c79ebc62e4a75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73da510-9b8a-5f67-9ad0-3ec139ec31b8/a73da510-9b8a-5f67-9ad0-3ec139ec31b8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_dfd6e8551d41b0df44058f8729d9cf87.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73da510-9b8a-5f67-9ad0-3ec139ec31b8/a73da510-9b8a-5f67-9ad0-3ec139ec31b8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71341,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/3a/6a3a238680486db42a2fb0d4da5283bb/pa/TW38851_813c256ee939a3d0d044d6f83471b8a9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-09-22',
'seats_number': 5,
'seller_name': None,
'title': 'Ford C-Max 1.6 TDCi Ikon',
'transmission': 'manual',
'trim': 'Ikon',
'year': 2010}
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW38851%27 HTTP/1.1" 200 None
2026-03-28 12:00:33 [auto1.it] INFO: Saving data for TW38851: {'created_time': 1774699233.584172, 'last_price_update_time': 1774699233.584184, 'auction_closing_time': 1774884677.0}
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TW38851') HTTP/1.1" 204 0
2026-03-28 12:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_8ec45243856c2516dab175892126b4c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:33 [auto1.it] INFO: Found listing with ID: KH13960
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH13960%27 HTTP/1.1" 200 None
2026-03-28 12:00:33 [auto1.it] INFO: Scrape type for KH13960: 1
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc8%252F5ec8ed96d2cedcc8210232a7b142ccf2%252Fpa%252FJR85955_caaf365940c3a25d47cd6e30d914c981.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_caaf365940c3a25d47cd6e30d914c981.jpg not downloaded yet
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb0%252Ff0b0559e70cddccec95a1e2795dba437%252Fpa%252FMC18601_4eba8df7ccc713ea653c67247d31b61c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_4eba8df7ccc713ea653c67247d31b61c.jpg not downloaded yet
2026-03-28 12:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH97185> (referer: https://www.auto1.com/v1/car-details-view/JH97185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA26837> (referer: https://www.auto1.com/v1/car-details-view/HA26837/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb86350>
2026-03-28 12:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd6a59b-6876-5796-9172-f57fbc177e0c/dcd6a59b-6876-5796-9172-f57fbc177e0c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F91%252Fd791be708e3eade407e5d423d79dd578%252Fpa%252FWN91380_bf3df18c671b5cc794a6d60d6c8cc6d4.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_bf3df18c671b5cc794a6d60d6c8cc6d4.jpg saved to cache
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dcd6a59b-6876-5796-9172-f57fbc177e0c
2026-03-28 12:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4d6dd0>
2026-03-28 12:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1f7ff3-70a1-5783-b754-315a4f954457/6b1f7ff3-70a1-5783-b754-315a4f954457_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F26%252Fde266645155c607b63ae52b5b0a1d394%252Fpa%252FCN51839_c4520e8b6c455e5e45db7ca925422131.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_c4520e8b6c455e5e45db7ca925422131.jpg saved to cache
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b1f7ff3-70a1-5783-b754-315a4f954457
2026-03-28 12:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_523031ee1b7fb70beea74818887b27a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_e473e8ed73a813e696ea44d259751d3e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_49a1d5227524713f4f62ef760a460765.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_e4fbad55a2f522f63c1915e1e647177b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_e4fbad55a2f522f63c1915e1e647177b.jpg not downloaded yet
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fc3%252F65c367b33624734b620c77d49458a0eb%252Fpa%252FVG07643_7292c548c9e7a511baba7363bd8dcaf8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_7292c548c9e7a511baba7363bd8dcaf8.jpg not downloaded yet
2026-03-28 12:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbdeb50>
2026-03-28 12:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8/7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F4f%252F0c4f29a933f307c3bf8779abd6245d6b%252Fpa%252FDE59865_f8d3aa1166a7d85bdcd07adffc613751.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_f8d3aa1166a7d85bdcd07adffc613751.jpg saved to cache
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8
2026-03-28 12:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_112d711e90c7e3ff00a2048226a0d973.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:33 [auto1.it] INFO: Found listing with ID: JU86722
2026-03-28 12:00:33 [auto1.it] INFO: Found listing with ID: WS77593
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS77593%27 HTTP/1.1" 200 None
2026-03-28 12:00:33 [auto1.it] INFO: Scrape type for WS77593: 2
2026-03-28 12:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 346a1960-d04f-5071-b2a0-6ec2ee81fbc3 with identifier: WS77593
2026-03-28 12:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 346a1960-d04f-5071-b2a0-6ec2ee81fbc3 with scrape type 2
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 346a1960-d04f-5071-b2a0-6ec2ee81fbc3 with scrape type 2
2026-03-28 12:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 346a1960-d04f-5071-b2a0-6ec2ee81fbc3, identifier: WS77593
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc8%252F5ec8ed96d2cedcc8210232a7b142ccf2%252Fpa%252FJR85955_b187e61c40954f102d75087b7abf6e9b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_b187e61c40954f102d75087b7abf6e9b.jpg not downloaded yet
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb0%252Ff0b0559e70cddccec95a1e2795dba437%252Fpa%252FMC18601_7560b62e6bfd13d0577a620a492c6e22.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_7560b62e6bfd13d0577a620a492c6e22.jpg not downloaded yet
2026-03-28 12:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 346a1960-d04f-5071-b2a0-6ec2ee81fbc3 with identifier: WS77593
2026-03-28 12:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 346a1960-d04f-5071-b2a0-6ec2ee81fbc3 with identifier: WS77593
2026-03-28 12:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 346a1960-d04f-5071-b2a0-6ec2ee81fbc3 with identifier: WS77593 to the API
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:06:12Z',
'fuel_type': 'diesel',
'id': '346a1960-d04f-5071-b2a0-6ec2ee81fbc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS77593',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 168449,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-19',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2011}
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS77593%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [auto1.it] INFO: Saving data for WS77593: {'auction_closing_time': 1774883172.0, 'created_time': 1773867696.245745, 'last_price_update_time': 1774699234.304968}
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WS77593') HTTP/1.1" 204 0
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_37d3ff74cc7ee5ad43e250150424e91e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_37d3ff74cc7ee5ad43e250150424e91e.jpg not downloaded yet
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fc3%252F65c367b33624734b620c77d49458a0eb%252Fpa%252FVG07643_5aee640c06e93225a95695606ee9eaa2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_5aee640c06e93225a95695606ee9eaa2.jpg not downloaded yet
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d65d3d0>
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_8ec45243856c2516dab175892126b4c6.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_8ec45243856c2516dab175892126b4c6.jpg saved to cache
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-03-28 12:00:34 [auto1.it] INFO: Found listing with ID: KM48378
2026-03-28 12:00:34 [auto1.it] INFO: Found listing with ID: ET22397
2026-03-28 12:00:34 [auto1.it] INFO: Found listing with ID: ML76939
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML76939%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [auto1.it] INFO: Scrape type for ML76939: 1
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc8%252F5ec8ed96d2cedcc8210232a7b142ccf2%252Fpa%252FJR85955_8322065f95c6bcb51b337837fae81995.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_8322065f95c6bcb51b337837fae81995.jpg not downloaded yet
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb0%252Ff0b0559e70cddccec95a1e2795dba437%252Fpa%252FMC18601_731caf622410693a7655423a3754a848.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_731caf622410693a7655423a3754a848.jpg not downloaded yet
2026-03-28 12:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daaa3a0f-e46a-51da-a933-0dc6a86f8dd8 with identifier: JH97185
2026-03-28 12:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8 with scrape type 1
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_694d6dafa2baf25ad09ccf0e4ca72deb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_694d6dafa2baf25ad09ccf0e4ca72deb.jpg not downloaded yet
2026-03-28 12:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3c876ba-8c5c-5a96-b9ef-da114c2fbe33 with identifier: HA26837
2026-03-28 12:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3c876ba-8c5c-5a96-b9ef-da114c2fbe33 with scrape type 1
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3c876ba-8c5c-5a96-b9ef-da114c2fbe33
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_11a06101d0d8b82a14cd533e5e10c346.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_11a06101d0d8b82a14cd533e5e10c346.jpg not downloaded yet
2026-03-28 12:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_ce5ad0a217e45e1271c981a061a59452.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_89a51aab0e0de5e54f7f053710d3986b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_89a51aab0e0de5e54f7f053710d3986b.jpg not downloaded yet
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fc3%252F65c367b33624734b620c77d49458a0eb%252Fpa%252FVG07643_6604600878dbbc9b598fc231f50b5bdb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_6604600878dbbc9b598fc231f50b5bdb.jpg not downloaded yet
2026-03-28 12:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_40585806d3c845c718e7a16db028027f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_775bcd3794bd28757a447c45b50c197b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_ef64f67049ff0b7d8745c715a0b89327.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_bcd875a92198728227af70a3da2a964f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:34 [auto1.it] INFO: Found listing with ID: TB64568
2026-03-28 12:00:34 [auto1.it] INFO: Found listing with ID: ZU99068
2026-03-28 12:00:34 [auto1.it] INFO: Found listing with ID: VL91397
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL91397%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [auto1.it] INFO: Scrape type for VL91397: 1
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc8%252F5ec8ed96d2cedcc8210232a7b142ccf2%252Fpa%252FJR85955_1e338986092c590877153a308779bb8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_1e338986092c590877153a308779bb8b.jpg not downloaded yet
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb0%252Ff0b0559e70cddccec95a1e2795dba437%252Fpa%252FMC18601_f8867447e59e39b8556c96c39fcd7f08.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_f8867447e59e39b8556c96c39fcd7f08.jpg not downloaded yet
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_ccb0f110fea56dcc5c78bf2ab0a27c69.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_ccb0f110fea56dcc5c78bf2ab0a27c69.jpg not downloaded yet
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_73ebbb776479748e514eeb8c0a8eff67.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_73ebbb776479748e514eeb8c0a8eff67.jpg not downloaded yet
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d566a90>
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_523031ee1b7fb70beea74818887b27a5.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_523031ee1b7fb70beea74818887b27a5.jpg saved to cache
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cabbf90>
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99499219-33fa-5c59-ace4-570d5eeefad7/99499219-33fa-5c59-ace4-570d5eeefad7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8db3ec62c4ac46fc322071f363823e%252Fpa%252FEF37813_e473e8ed73a813e696ea44d259751d3e.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_e473e8ed73a813e696ea44d259751d3e.jpg saved to cache
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99499219-33fa-5c59-ace4-570d5eeefad7
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb78e50>
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1f7ff3-70a1-5783-b754-315a4f954457/6b1f7ff3-70a1-5783-b754-315a4f954457_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F26%252Fde266645155c607b63ae52b5b0a1d394%252Fpa%252FCN51839_49a1d5227524713f4f62ef760a460765.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_49a1d5227524713f4f62ef760a460765.jpg saved to cache
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b1f7ff3-70a1-5783-b754-315a4f954457
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d79b450>
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_112d711e90c7e3ff00a2048226a0d973.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_112d711e90c7e3ff00a2048226a0d973.jpg saved to cache
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-03-28 12:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_4eba8df7ccc713ea653c67247d31b61c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_c5e6501157e5ca54b3e9e63fc4b1e6c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_c5e6501157e5ca54b3e9e63fc4b1e6c6.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fc3%252F65c367b33624734b620c77d49458a0eb%252Fpa%252FVG07643_014d14e07076062989c6d4e1a2c9006f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_014d14e07076062989c6d4e1a2c9006f.jpg not downloaded yet
2026-03-28 12:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:35 [auto1.it] INFO: Found listing with ID: WG77442
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG77442%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [auto1.it] INFO: Scrape type for WG77442: 2
2026-03-28 12:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cb153c8-ae49-5f1e-a302-13b265655703 with identifier: WG77442
2026-03-28 12:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cb153c8-ae49-5f1e-a302-13b265655703 with scrape type 2
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cb153c8-ae49-5f1e-a302-13b265655703 with scrape type 2
2026-03-28 12:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0cb153c8-ae49-5f1e-a302-13b265655703, identifier: WG77442
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc8%252F5ec8ed96d2cedcc8210232a7b142ccf2%252Fpa%252FJR85955_4d138f41fab376dbdf349b8a8cdd67da.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_4d138f41fab376dbdf349b8a8cdd67da.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb0%252Ff0b0559e70cddccec95a1e2795dba437%252Fpa%252FMC18601_792ee207a2125b25fdc5c0680d525a95.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_792ee207a2125b25fdc5c0680d525a95.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_ec0169198c9cbc44a1b5d661664fca48.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_ec0169198c9cbc44a1b5d661664fca48.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_205db914472903375a1272d085c3035d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_205db914472903375a1272d085c3035d.jpg not downloaded yet
2026-03-28 12:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_d3f4e28abc8944b1e5ae41491acc9705.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0cb153c8-ae49-5f1e-a302-13b265655703 with identifier: WG77442
2026-03-28 12:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0cb153c8-ae49-5f1e-a302-13b265655703 with identifier: WG77442
2026-03-28 12:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0cb153c8-ae49-5f1e-a302-13b265655703 with identifier: WG77442 to the API
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:58:40Z',
'fuel_type': 'diesel',
'id': '0cb153c8-ae49-5f1e-a302-13b265655703',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG77442',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 131561,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-22',
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Energy Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2018}
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG77442%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [auto1.it] INFO: Saving data for WG77442: {'auction_closing_time': 1774886320.0, 'created_time': 1773134460.273326, 'last_price_update_time': 1774699235.696093}
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WG77442') HTTP/1.1" 204 0
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_f6c3a4cb6e862654ad2ed9a8f7258a3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_f6c3a4cb6e862654ad2ed9a8f7258a3f.jpg not downloaded yet
2026-03-28 12:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL56799/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb71e10>
2026-03-28 12:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5/ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb0%252Ff0b0559e70cddccec95a1e2795dba437%252Fpa%252FMC18601_ce5ad0a217e45e1271c981a061a59452.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_ce5ad0a217e45e1271c981a061a59452.jpg saved to cache
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5
2026-03-28 12:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca82cd0>
2026-03-28 12:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b1e1282-05f1-5451-93d8-17195d2ca8b4/5b1e1282-05f1-5451-93d8-17195d2ca8b4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fc3%252F65c367b33624734b620c77d49458a0eb%252Fpa%252FVG07643_40585806d3c845c718e7a16db028027f.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_40585806d3c845c718e7a16db028027f.jpg saved to cache
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b1e1282-05f1-5451-93d8-17195d2ca8b4
2026-03-28 12:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca82150>
2026-03-28 12:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b1e1282-05f1-5451-93d8-17195d2ca8b4/5b1e1282-05f1-5451-93d8-17195d2ca8b4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fc3%252F65c367b33624734b620c77d49458a0eb%252Fpa%252FVG07643_775bcd3794bd28757a447c45b50c197b.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_775bcd3794bd28757a447c45b50c197b.jpg saved to cache
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b1e1282-05f1-5451-93d8-17195d2ca8b4
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c95c590>
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0/c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc8%252F5ec8ed96d2cedcc8210232a7b142ccf2%252Fpa%252FJR85955_ef64f67049ff0b7d8745c715a0b89327.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_ef64f67049ff0b7d8745c715a0b89327.jpg saved to cache
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cc10790>
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_bcd875a92198728227af70a3da2a964f.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_bcd875a92198728227af70a3da2a964f.jpg saved to cache
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-03-28 12:00:36 [auto1.it] INFO: Found listing with ID: LE72169
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE72169%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [auto1.it] INFO: Scrape type for LE72169: 2
2026-03-28 12:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82158984-0158-549f-832e-167f24e67297 with identifier: LE72169
2026-03-28 12:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82158984-0158-549f-832e-167f24e67297 with scrape type 2
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82158984-0158-549f-832e-167f24e67297 with scrape type 2
2026-03-28 12:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 82158984-0158-549f-832e-167f24e67297, identifier: LE72169
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_1d7047e2934fc693c809c2337e9f3ae8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_1d7047e2934fc693c809c2337e9f3ae8.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_28fe5570daa61a4fc3fc099e2e16c3ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_28fe5570daa61a4fc3fc099e2e16c3ef.jpg not downloaded yet
2026-03-28 12:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_6604600878dbbc9b598fc231f50b5bdb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_8322065f95c6bcb51b337837fae81995.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_731caf622410693a7655423a3754a848.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 82158984-0158-549f-832e-167f24e67297 with identifier: LE72169
2026-03-28 12:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 82158984-0158-549f-832e-167f24e67297 with identifier: LE72169
2026-03-28 12:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 82158984-0158-549f-832e-167f24e67297 with identifier: LE72169 to the API
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:38:36Z',
'fuel_type': 'petrol',
'id': '82158984-0158-549f-832e-167f24e67297',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE72169',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 185390,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-11',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Highline',
'transmission': 'automatic',
'trim': 'Highline',
'year': 2021}
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE72169%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [auto1.it] INFO: Saving data for LE72169: {'auction_closing_time': 1774885116.0, 'created_time': 1774342964.140672, 'last_price_update_time': 1774699236.712864}
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LE72169') HTTP/1.1" 204 0
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca73010>
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5/ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb0%252Ff0b0559e70cddccec95a1e2795dba437%252Fpa%252FMC18601_4eba8df7ccc713ea653c67247d31b61c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_4eba8df7ccc713ea653c67247d31b61c.jpg saved to cache
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5
2026-03-28 12:00:36 [auto1.it] INFO: Channel: 24h | Page: 3 | totalHits: 3672 | hits on page: 40
2026-03-28 12:00:36 [auto1.it] INFO: Found listing with ID: UR17462
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR17462%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [auto1.it] INFO: Scrape type for UR17462: 1
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_bd6a537dfe16635ecddeaee96b5e1dc6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_bd6a537dfe16635ecddeaee96b5e1dc6.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_1035287b1f88d83fbcf0ef3d476b2468.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_1035287b1f88d83fbcf0ef3d476b2468.jpg not downloaded yet
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d44b850>
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1f7ff3-70a1-5783-b754-315a4f954457/6b1f7ff3-70a1-5783-b754-315a4f954457_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F26%252Fde266645155c607b63ae52b5b0a1d394%252Fpa%252FCN51839_d3f4e28abc8944b1e5ae41491acc9705.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_d3f4e28abc8944b1e5ae41491acc9705.jpg saved to cache
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b1f7ff3-70a1-5783-b754-315a4f954457
2026-03-28 12:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_73ebbb776479748e514eeb8c0a8eff67.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:36 [auto1.it] INFO: Found listing with ID: WE07120
2026-03-28 12:00:36 [auto1.it] INFO: Found listing with ID: NF75023
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF75023%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [auto1.it] INFO: Scrape type for NF75023: 1
2026-03-28 12:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_014d14e07076062989c6d4e1a2c9006f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:36 [auto1.it] INFO: Found listing with ID: DU34377
2026-03-28 12:00:36 [auto1.it] INFO: Found listing with ID: EV59116
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV59116%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [auto1.it] INFO: Scrape type for EV59116: 1
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_146cd9fa7876dfe9b4535d2c69e617fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_146cd9fa7876dfe9b4535d2c69e617fe.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_4ce32c3b60f730701361e07b8acae8b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_4ce32c3b60f730701361e07b8acae8b7.jpg not downloaded yet
2026-03-28 12:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RJ05786/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB46951/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD11089/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cae5390>
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b1e1282-05f1-5451-93d8-17195d2ca8b4/5b1e1282-05f1-5451-93d8-17195d2ca8b4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fc3%252F65c367b33624734b620c77d49458a0eb%252Fpa%252FVG07643_6604600878dbbc9b598fc231f50b5bdb.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_6604600878dbbc9b598fc231f50b5bdb.jpg saved to cache
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b1e1282-05f1-5451-93d8-17195d2ca8b4
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5223d0>
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0/c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc8%252F5ec8ed96d2cedcc8210232a7b142ccf2%252Fpa%252FJR85955_8322065f95c6bcb51b337837fae81995.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_8322065f95c6bcb51b337837fae81995.jpg saved to cache
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c92aa10>
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5/ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb0%252Ff0b0559e70cddccec95a1e2795dba437%252Fpa%252FMC18601_731caf622410693a7655423a3754a848.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_731caf622410693a7655423a3754a848.jpg saved to cache
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: VZ92626
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: TF83722
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: BA01278
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: PW47751
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: CU74500
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: SB06120
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: VC50043
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC50043%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [auto1.it] INFO: Scrape type for VC50043: 1
2026-03-28 12:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: UY41081
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY41081%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [auto1.it] INFO: Scrape type for UY41081: 1
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_972945a1a35bd6d477c2569182469c9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_972945a1a35bd6d477c2569182469c9a.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_7a3a80cb36d1635b1cb7b4684c566633.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_7a3a80cb36d1635b1cb7b4684c566633.jpg not downloaded yet
2026-03-28 12:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_792ee207a2125b25fdc5c0680d525a95.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_ec0169198c9cbc44a1b5d661664fca48.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_f6c3a4cb6e862654ad2ed9a8f7258a3f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: ZK25339
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: ZX07478
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX07478%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [auto1.it] INFO: Scrape type for ZX07478: 1
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d799710>
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_73ebbb776479748e514eeb8c0a8eff67.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_73ebbb776479748e514eeb8c0a8eff67.jpg saved to cache
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3c876ba-8c5c-5a96-b9ef-da114c2fbe33
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb35dd0>
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b1e1282-05f1-5451-93d8-17195d2ca8b4/5b1e1282-05f1-5451-93d8-17195d2ca8b4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fc3%252F65c367b33624734b620c77d49458a0eb%252Fpa%252FVG07643_014d14e07076062989c6d4e1a2c9006f.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_014d14e07076062989c6d4e1a2c9006f.jpg saved to cache
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b1e1282-05f1-5451-93d8-17195d2ca8b4
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: VK68045
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: YN18335
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN18335%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [auto1.it] INFO: Scrape type for YN18335: 1
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_2ea81aee3b233e4c7db67d19cf41a57d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_2ea81aee3b233e4c7db67d19cf41a57d.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_390859eaca11c5c1b536422d8068b318.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_390859eaca11c5c1b536422d8068b318.jpg not downloaded yet
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: VY27693
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: JZ77925
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: YY84618
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY84618%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [auto1.it] INFO: Scrape type for YY84618: 1
2026-03-28 12:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_1035287b1f88d83fbcf0ef3d476b2468.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: NA95464
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: WA05506
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: PW96424
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: CZ80815
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ80815%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [auto1.it] INFO: Scrape type for CZ80815: 1
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_12dcfd0597cafab9cdc4313eef621a52.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_12dcfd0597cafab9cdc4313eef621a52.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_0618366d3016ad33965e48d930950379.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_0618366d3016ad33965e48d930950379.jpg not downloaded yet
2026-03-28 12:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF24469/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbce390>
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5/ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb0%252Ff0b0559e70cddccec95a1e2795dba437%252Fpa%252FMC18601_792ee207a2125b25fdc5c0680d525a95.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_792ee207a2125b25fdc5c0680d525a95.jpg saved to cache
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb55510>
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_ec0169198c9cbc44a1b5d661664fca48.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_ec0169198c9cbc44a1b5d661664fca48.jpg saved to cache
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbb5d90>
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_f6c3a4cb6e862654ad2ed9a8f7258a3f.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_f6c3a4cb6e862654ad2ed9a8f7258a3f.jpg saved to cache
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: LN66513
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: CE47539
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: ET05908
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: YH77376
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH77376%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [auto1.it] INFO: Scrape type for YH77376: 1
2026-03-28 12:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_205db914472903375a1272d085c3035d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_4ce32c3b60f730701361e07b8acae8b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:37 [auto1.it] INFO: Found listing with ID: YT14499
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT14499%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [auto1.it] INFO: Scrape type for YT14499: 2
2026-03-28 12:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88ae8c38-1069-5901-856d-8382759e0fd7 with identifier: YT14499
2026-03-28 12:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88ae8c38-1069-5901-856d-8382759e0fd7 with scrape type 2
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88ae8c38-1069-5901-856d-8382759e0fd7 with scrape type 2
2026-03-28 12:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 88ae8c38-1069-5901-856d-8382759e0fd7, identifier: YT14499
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_7debe2fa3a6bb2a8be58eb1b4c22e709.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_7debe2fa3a6bb2a8be58eb1b4c22e709.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_1fd30cd7847fc50a5b34bf61e0a5eeea.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_1fd30cd7847fc50a5b34bf61e0a5eeea.jpg not downloaded yet
2026-03-28 12:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_146cd9fa7876dfe9b4535d2c69e617fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 88ae8c38-1069-5901-856d-8382759e0fd7 with identifier: YT14499
2026-03-28 12:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 88ae8c38-1069-5901-856d-8382759e0fd7 with identifier: YT14499
2026-03-28 12:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 88ae8c38-1069-5901-856d-8382759e0fd7 with identifier: YT14499 to the API
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:03:34Z',
'fuel_type': 'diesel',
'id': '88ae8c38-1069-5901-856d-8382759e0fd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT14499',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 64329,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-26',
'seller_name': None,
'title': 'BMW X1 xDrive 18d Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2018}
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT14499%27 HTTP/1.1" 200 None
2026-03-28 12:00:38 [auto1.it] INFO: Saving data for YT14499: {'auction_closing_time': 1774883014.0, 'created_time': 1773910878.565524, 'last_price_update_time': 1774699238.276348}
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YT14499') HTTP/1.1" 204 0
2026-03-28 12:00:38 [auto1.it] INFO: Found listing with ID: YF75384
2026-03-28 12:00:38 [auto1.it] INFO: Found listing with ID: YP53845
2026-03-28 12:00:38 [auto1.it] INFO: Found listing with ID: MU44225
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU44225%27 HTTP/1.1" 200 None
2026-03-28 12:00:38 [auto1.it] INFO: Scrape type for MU44225: 1
2026-03-28 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ90962/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ81563/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb64f50>
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_1035287b1f88d83fbcf0ef3d476b2468.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_1035287b1f88d83fbcf0ef3d476b2468.jpg saved to cache
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3c876ba-8c5c-5a96-b9ef-da114c2fbe33
2026-03-28 12:00:38 [auto1.it] INFO: Found listing with ID: BU30300
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU30300%27 HTTP/1.1" 200 None
2026-03-28 12:00:38 [auto1.it] INFO: Scrape type for BU30300: 1
2026-03-28 12:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:38 [auto1.it] INFO: Found listing with ID: DV89996
2026-03-28 12:00:38 [auto1.it] INFO: Found listing with ID: GC21308
2026-03-28 12:00:38 [auto1.it] INFO: Found listing with ID: WN69179
2026-03-28 12:00:38 [auto1.it] INFO: Found listing with ID: RT68139
2026-03-28 12:00:38 [auto1.it] INFO: Found listing with ID: GU07540
2026-03-28 12:00:38 [auto1.it] INFO: Found listing with ID: BW81707
2026-03-28 12:00:38 [auto1.it] INFO: Found listing with ID: MJ56294
2026-03-28 12:00:38 [auto1.it] INFO: Found listing with ID: ND60676
2026-03-28 12:00:38 [auto1.it] INFO: Found listing with ID: RD34551
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD34551%27 HTTP/1.1" 200 None
2026-03-28 12:00:38 [auto1.it] INFO: Scrape type for RD34551: 1
2026-03-28 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WM47642/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb7d190>
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_205db914472903375a1272d085c3035d.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_205db914472903375a1272d085c3035d.jpg saved to cache
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3c876ba-8c5c-5a96-b9ef-da114c2fbe33
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7c67d0>
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_4ce32c3b60f730701361e07b8acae8b7.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_4ce32c3b60f730701361e07b8acae8b7.jpg saved to cache
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3c876ba-8c5c-5a96-b9ef-da114c2fbe33
2026-03-28 12:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML76939/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:38 [auto1.it] INFO: Found listing with ID: MX89615
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX89615%27 HTTP/1.1" 200 None
2026-03-28 12:00:38 [auto1.it] INFO: Scrape type for MX89615: 1
2026-03-28 12:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cad7810>
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_146cd9fa7876dfe9b4535d2c69e617fe.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_146cd9fa7876dfe9b4535d2c69e617fe.jpg saved to cache
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-03-28 12:00:38 [auto1.it] INFO: Found listing with ID: DC79577
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC79577%27 HTTP/1.1" 200 None
2026-03-28 12:00:38 [auto1.it] INFO: Scrape type for DC79577: 2
2026-03-28 12:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fef41e68-176f-54a4-b8b1-4028da3259f6 with identifier: DC79577
2026-03-28 12:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fef41e68-176f-54a4-b8b1-4028da3259f6 with scrape type 2
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fef41e68-176f-54a4-b8b1-4028da3259f6 with scrape type 2
2026-03-28 12:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fef41e68-176f-54a4-b8b1-4028da3259f6, identifier: DC79577
2026-03-28 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_0618366d3016ad33965e48d930950379.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_12dcfd0597cafab9cdc4313eef621a52.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fef41e68-176f-54a4-b8b1-4028da3259f6 with identifier: DC79577
2026-03-28 12:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fef41e68-176f-54a4-b8b1-4028da3259f6 with identifier: DC79577
2026-03-28 12:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fef41e68-176f-54a4-b8b1-4028da3259f6 with identifier: DC79577 to the API
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:36:11Z',
'fuel_type': 'diesel',
'id': 'fef41e68-176f-54a4-b8b1-4028da3259f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC79577',
'listing': 'auction',
'make': 'Fiat',
'model': '500L',
'odometer': 180434,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-18',
'seller_name': None,
'title': 'Fiat 500L 1.3 M-Jet Trekking',
'transmission': 'automatic',
'trim': 'Trekking',
'year': 2016}
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC79577%27 HTTP/1.1" 200 None
2026-03-28 12:00:39 [auto1.it] INFO: Saving data for DC79577: {'auction_closing_time': 1774884971.0, 'created_time': 1774342931.896144, 'last_price_update_time': 1774699239.272225}
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DC79577') HTTP/1.1" 204 0
2026-03-28 12:00:39 [auto1.it] INFO: Found listing with ID: DF10030
2026-03-28 12:00:39 [auto1.it] INFO: Found listing with ID: FJ19911
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ19911%27 HTTP/1.1" 200 None
2026-03-28 12:00:39 [auto1.it] INFO: Scrape type for FJ19911: 1
2026-03-28 12:00:39 [auto1.it] INFO: Found listing with ID: DP83591
2026-03-28 12:00:39 [auto1.it] INFO: Found listing with ID: RF53888
2026-03-28 12:00:39 [auto1.it] INFO: Found listing with ID: XC35499
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC35499%27 HTTP/1.1" 200 None
2026-03-28 12:00:39 [auto1.it] INFO: Scrape type for XC35499: 2
2026-03-28 12:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93b7829c-1671-5c69-9339-1e1b47225970 with identifier: XC35499
2026-03-28 12:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93b7829c-1671-5c69-9339-1e1b47225970 with scrape type 2
2026-03-28 12:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93b7829c-1671-5c69-9339-1e1b47225970 with scrape type 2
2026-03-28 12:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 93b7829c-1671-5c69-9339-1e1b47225970, identifier: XC35499
2026-03-28 12:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL56799> (referer: https://www.auto1.com/v1/car-details-view/NL56799/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF75023/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 93b7829c-1671-5c69-9339-1e1b47225970 with identifier: XC35499
2026-03-28 12:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 93b7829c-1671-5c69-9339-1e1b47225970 with identifier: XC35499
2026-03-28 12:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 93b7829c-1671-5c69-9339-1e1b47225970 with identifier: XC35499 to the API
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:42:28Z',
'fuel_type': 'diesel',
'id': '93b7829c-1671-5c69-9339-1e1b47225970',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC35499',
'listing': 'auction',
'make': 'Jeep',
'model': 'Cherokee',
'odometer': 172214,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-15',
'seller_name': None,
'title': 'Jeep Cherokee 2.8 CRD Extreme Sport',
'transmission': 'automatic',
'trim': 'Extreme Sport',
'year': 2006}
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC35499%27 HTTP/1.1" 200 None
2026-03-28 12:00:39 [auto1.it] INFO: Saving data for XC35499: {'auction_closing_time': 1774885348.0, 'created_time': 1774040640.828618, 'last_price_update_time': 1774699239.861895}
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XC35499') HTTP/1.1" 204 0
2026-03-28 12:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbc7a90>
2026-03-28 12:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_0618366d3016ad33965e48d930950379.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_0618366d3016ad33965e48d930950379.jpg saved to cache
2026-03-28 12:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3c876ba-8c5c-5a96-b9ef-da114c2fbe33
2026-03-28 12:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d483e50>
2026-03-28 12:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_12dcfd0597cafab9cdc4313eef621a52.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_12dcfd0597cafab9cdc4313eef621a52.jpg saved to cache
2026-03-28 12:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-03-28 12:00:39 [auto1.it] INFO: Found listing with ID: KW13943
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW13943%27 HTTP/1.1" 200 None
2026-03-28 12:00:39 [auto1.it] INFO: Scrape type for KW13943: 1
2026-03-28 12:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_390859eaca11c5c1b536422d8068b318.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:40 [auto1.it] INFO: Found listing with ID: CK02940
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK02940%27 HTTP/1.1" 200 None
2026-03-28 12:00:40 [auto1.it] INFO: Scrape type for CK02940: 1
2026-03-28 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC50043/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:40 [auto1.it] INFO: Channel: 24h | Page: 4 | totalHits: 3672 | hits on page: 40
2026-03-28 12:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e20f307-15b9-531c-a295-805ffed5fb8e with identifier: NL56799
2026-03-28 12:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e20f307-15b9-531c-a295-805ffed5fb8e with scrape type 1
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1e20f307-15b9-531c-a295-805ffed5fb8e
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fe9%252F23e9f91f5ef896a1bc59bfebb7ff805b%252Fpa%252FNL56799_249880620cec79e487e50b8d87cfe1d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_249880620cec79e487e50b8d87cfe1d6.jpg not downloaded yet
2026-03-28 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:40 [auto1.it] INFO: Found listing with ID: NW63690
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW63690%27 HTTP/1.1" 200 None
2026-03-28 12:00:40 [auto1.it] INFO: Scrape type for NW63690: 1
2026-03-28 12:00:40 [auto1.it] INFO: Found listing with ID: CR10860
2026-03-28 12:00:40 [auto1.it] INFO: Found listing with ID: PX02634
2026-03-28 12:00:40 [auto1.it] INFO: Found listing with ID: RZ14942
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ14942%27 HTTP/1.1" 200 None
2026-03-28 12:00:40 [auto1.it] INFO: Scrape type for RZ14942: 1
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fe9%252F23e9f91f5ef896a1bc59bfebb7ff805b%252Fpa%252FNL56799_ff46c2e60e87b4bead2b1bc463f130e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_ff46c2e60e87b4bead2b1bc463f130e8.jpg not downloaded yet
2026-03-28 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_11a06101d0d8b82a14cd533e5e10c346.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:40 [auto1.it] INFO: Found listing with ID: NE68522
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE68522%27 HTTP/1.1" 200 None
2026-03-28 12:00:40 [auto1.it] INFO: Scrape type for NE68522: 2
2026-03-28 12:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ffd3d16-229e-54b1-bb90-04b6a8ee6903 with identifier: NE68522
2026-03-28 12:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ffd3d16-229e-54b1-bb90-04b6a8ee6903 with scrape type 2
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ffd3d16-229e-54b1-bb90-04b6a8ee6903 with scrape type 2
2026-03-28 12:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0ffd3d16-229e-54b1-bb90-04b6a8ee6903, identifier: NE68522
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fe9%252F23e9f91f5ef896a1bc59bfebb7ff805b%252Fpa%252FNL56799_080b5256bfe294f3e228ddcf84ca824f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_080b5256bfe294f3e228ddcf84ca824f.jpg not downloaded yet
2026-03-28 12:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0ffd3d16-229e-54b1-bb90-04b6a8ee6903 with identifier: NE68522
2026-03-28 12:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0ffd3d16-229e-54b1-bb90-04b6a8ee6903 with identifier: NE68522
2026-03-28 12:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0ffd3d16-229e-54b1-bb90-04b6a8ee6903 with identifier: NE68522 to the API
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:54:31Z',
'fuel_type': 'petrol',
'id': '0ffd3d16-229e-54b1-bb90-04b6a8ee6903',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE68522',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 133835,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-19',
'seller_name': None,
'title': 'BMW 2er 218i Gran Tourer Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2019}
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE68522%27 HTTP/1.1" 200 None
2026-03-28 12:00:40 [auto1.it] INFO: Saving data for NE68522: {'auction_closing_time': 1774886071.0, 'created_time': 1773135407.078429, 'last_price_update_time': 1774699240.649845}
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NE68522') HTTP/1.1" 204 0
2026-03-28 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY84618/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH77376/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:40 [auto1.it] INFO: Found listing with ID: HB76167
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB76167%27 HTTP/1.1" 200 None
2026-03-28 12:00:40 [auto1.it] INFO: Scrape type for HB76167: 1
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fe9%252F23e9f91f5ef896a1bc59bfebb7ff805b%252Fpa%252FNL56799_e890e121f59f9f0d0151cdb43e41e461.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_e890e121f59f9f0d0151cdb43e41e461.jpg not downloaded yet
2026-03-28 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbd29d0>
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_390859eaca11c5c1b536422d8068b318.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_390859eaca11c5c1b536422d8068b318.jpg saved to cache
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3c876ba-8c5c-5a96-b9ef-da114c2fbe33
2026-03-28 12:00:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d49e590>
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_11a06101d0d8b82a14cd533e5e10c346.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_11a06101d0d8b82a14cd533e5e10c346.jpg saved to cache
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3c876ba-8c5c-5a96-b9ef-da114c2fbe33
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_694d6dafa2baf25ad09ccf0e4ca72deb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:41 [auto1.it] INFO: Found listing with ID: LW42205
2026-03-28 12:00:41 [auto1.it] INFO: Found listing with ID: YU39946
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU39946%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [auto1.it] INFO: Scrape type for YU39946: 1
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fe9%252F23e9f91f5ef896a1bc59bfebb7ff805b%252Fpa%252FNL56799_26a0fd274b6f382c8cdbfff37ac6b677.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_26a0fd274b6f382c8cdbfff37ac6b677.jpg not downloaded yet
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MU44225/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_ff46c2e60e87b4bead2b1bc463f130e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:41 [auto1.it] INFO: Found listing with ID: JX99167
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX99167%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [auto1.it] INFO: Scrape type for JX99167: 1
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF24469> (referer: https://www.auto1.com/v1/car-details-view/JF24469/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:41 [auto1.it] INFO: Found listing with ID: PR01158
2026-03-28 12:00:41 [auto1.it] INFO: Found listing with ID: PB77964
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB77964%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [auto1.it] INFO: Scrape type for PB77964: 1
2026-03-28 12:00:41 [auto1.it] INFO: Found listing with ID: LU04143
2026-03-28 12:00:41 [auto1.it] INFO: Found listing with ID: VX06371
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX06371%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [auto1.it] INFO: Scrape type for VX06371: 1
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_bd6a537dfe16635ecddeaee96b5e1dc6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:41 [auto1.it] INFO: Found listing with ID: XU75020
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU75020%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [auto1.it] INFO: Scrape type for XU75020: 1
2026-03-28 12:00:41 [auto1.it] INFO: Found listing with ID: RT78827
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT78827%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [auto1.it] INFO: Scrape type for RT78827: 1
2026-03-28 12:00:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d424710>
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_694d6dafa2baf25ad09ccf0e4ca72deb.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_694d6dafa2baf25ad09ccf0e4ca72deb.jpg saved to cache
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-03-28 12:00:41 [auto1.it] INFO: Found listing with ID: ZX02617
2026-03-28 12:00:41 [auto1.it] INFO: Found listing with ID: GF04401
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF04401%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [auto1.it] INFO: Scrape type for GF04401: 1
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_080b5256bfe294f3e228ddcf84ca824f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_26a0fd274b6f382c8cdbfff37ac6b677.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_e890e121f59f9f0d0151cdb43e41e461.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:41 [auto1.it] INFO: Found listing with ID: LF71839
2026-03-28 12:00:41 [auto1.it] INFO: Found listing with ID: KV81214
2026-03-28 12:00:41 [auto1.it] INFO: Found listing with ID: NZ66288
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ66288%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [auto1.it] INFO: Scrape type for NZ66288: 1
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d48c790>
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e20f307-15b9-531c-a295-805ffed5fb8e/1e20f307-15b9-531c-a295-805ffed5fb8e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fe9%252F23e9f91f5ef896a1bc59bfebb7ff805b%252Fpa%252FNL56799_ff46c2e60e87b4bead2b1bc463f130e8.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_ff46c2e60e87b4bead2b1bc463f130e8.jpg saved to cache
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e20f307-15b9-531c-a295-805ffed5fb8e
2026-03-28 12:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6830e04-1deb-5562-bf2a-de16d390ba96 with identifier: JF24469
2026-03-28 12:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6830e04-1deb-5562-bf2a-de16d390ba96 with scrape type 1
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6830e04-1deb-5562-bf2a-de16d390ba96
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Feb%252F8deb0f43a5d5f1f466e8b7454bfcddf7%252Fpa%252FJF24469_eb804c35eb179f2bf4ed5eedf3c27e22.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_eb804c35eb179f2bf4ed5eedf3c27e22.jpg already downloaded
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Feb%252F8deb0f43a5d5f1f466e8b7454bfcddf7%252Fpa%252FJF24469_085fe328a901b3b1540c7ebbd75d06f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_085fe328a901b3b1540c7ebbd75d06f3.jpg already downloaded
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Feb%252F8deb0f43a5d5f1f466e8b7454bfcddf7%252Fpa%252FJF24469_bd1eb100d87a583ee792cd08251b2e62.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_bd1eb100d87a583ee792cd08251b2e62.jpg already downloaded
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Feb%252F8deb0f43a5d5f1f466e8b7454bfcddf7%252Fpa%252FJF24469_052f32ce922a7bd72ec71474c1fe8785.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_052f32ce922a7bd72ec71474c1fe8785.jpg already downloaded
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Feb%252F8deb0f43a5d5f1f466e8b7454bfcddf7%252Fpa%252FJF24469_0cfb753a6ec4f82fdc240d81d56c0fa6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_0cfb753a6ec4f82fdc240d81d56c0fa6.jpg already downloaded
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Feb%252F8deb0f43a5d5f1f466e8b7454bfcddf7%252Fpa%252FJF24469_65de59d3ce5261cc91a75de97bbfdb9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_65de59d3ce5261cc91a75de97bbfdb9e.jpg already downloaded
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Feb%252F8deb0f43a5d5f1f466e8b7454bfcddf7%252Fpa%252FJF24469_edaeda1b84ed913683271047f7bb1baf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_edaeda1b84ed913683271047f7bb1baf.jpg already downloaded
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Feb%252F8deb0f43a5d5f1f466e8b7454bfcddf7%252Fpa%252FJF24469_487b480572a6d6afd0277f48453901b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_487b480572a6d6afd0277f48453901b0.jpg already downloaded
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Feb%252F8deb0f43a5d5f1f466e8b7454bfcddf7%252Fpa%252FJF24469_ab151964feed2b35f55ef36c57a27cd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_ab151964feed2b35f55ef36c57a27cd5.jpg already downloaded
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Feb%252F8deb0f43a5d5f1f466e8b7454bfcddf7%252Fpa%252FJF24469_06b2231c308e350dc058b2c1bfdd7248.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_06b2231c308e350dc058b2c1bfdd7248.jpg already downloaded
2026-03-28 12:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c6830e04-1deb-5562-bf2a-de16d390ba96, identifier: JF24469
2026-03-28 12:00:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f881610>
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_bd6a537dfe16635ecddeaee96b5e1dc6.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_bd6a537dfe16635ecddeaee96b5e1dc6.jpg saved to cache
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-03-28 12:00:41 [auto1.it] INFO: Found listing with ID: LC50167
2026-03-28 12:00:41 [auto1.it] INFO: Found listing with ID: RB44165
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB44165%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [auto1.it] INFO: Scrape type for RB44165: 1
2026-03-28 12:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c6830e04-1deb-5562-bf2a-de16d390ba96 with identifier: JF24469
2026-03-28 12:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c6830e04-1deb-5562-bf2a-de16d390ba96 with identifier: JF24469
2026-03-28 12:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c6830e04-1deb-5562-bf2a-de16d390ba96 with identifier: JF24469 to the API
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JF24469>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:25:29Z',
'fuel_type': 'diesel',
'id': 'c6830e04-1deb-5562-bf2a-de16d390ba96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF24469',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'BMW',
'model': 'X3',
'odometer': 246188,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_eb804c35eb179f2bf4ed5eedf3c27e22.jpg',
'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_085fe328a901b3b1540c7ebbd75d06f3.jpg',
'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_bd1eb100d87a583ee792cd08251b2e62.jpg',
'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_052f32ce922a7bd72ec71474c1fe8785.jpg',
'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_0cfb753a6ec4f82fdc240d81d56c0fa6.jpg',
'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_65de59d3ce5261cc91a75de97bbfdb9e.jpg',
'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_edaeda1b84ed913683271047f7bb1baf.jpg',
'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_487b480572a6d6afd0277f48453901b0.jpg',
'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_ab151964feed2b35f55ef36c57a27cd5.jpg',
'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_06b2231c308e350dc058b2c1bfdd7248.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6830e04-1deb-5562-bf2a-de16d390ba96/c6830e04-1deb-5562-bf2a-de16d390ba96_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69618,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_eb804c35eb179f2bf4ed5eedf3c27e22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6830e04-1deb-5562-bf2a-de16d390ba96/c6830e04-1deb-5562-bf2a-de16d390ba96_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68941,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_085fe328a901b3b1540c7ebbd75d06f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6830e04-1deb-5562-bf2a-de16d390ba96/c6830e04-1deb-5562-bf2a-de16d390ba96_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64192,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_bd1eb100d87a583ee792cd08251b2e62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6830e04-1deb-5562-bf2a-de16d390ba96/c6830e04-1deb-5562-bf2a-de16d390ba96_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55384,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_052f32ce922a7bd72ec71474c1fe8785.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6830e04-1deb-5562-bf2a-de16d390ba96/c6830e04-1deb-5562-bf2a-de16d390ba96_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61789,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_0cfb753a6ec4f82fdc240d81d56c0fa6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6830e04-1deb-5562-bf2a-de16d390ba96/c6830e04-1deb-5562-bf2a-de16d390ba96_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_65de59d3ce5261cc91a75de97bbfdb9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6830e04-1deb-5562-bf2a-de16d390ba96/c6830e04-1deb-5562-bf2a-de16d390ba96_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58779,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_edaeda1b84ed913683271047f7bb1baf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6830e04-1deb-5562-bf2a-de16d390ba96/c6830e04-1deb-5562-bf2a-de16d390ba96_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56522,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_487b480572a6d6afd0277f48453901b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6830e04-1deb-5562-bf2a-de16d390ba96/c6830e04-1deb-5562-bf2a-de16d390ba96_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_ab151964feed2b35f55ef36c57a27cd5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6830e04-1deb-5562-bf2a-de16d390ba96/c6830e04-1deb-5562-bf2a-de16d390ba96_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/eb/8deb0f43a5d5f1f466e8b7454bfcddf7/pa/JF24469_06b2231c308e350dc058b2c1bfdd7248.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF24469%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [auto1.it] INFO: Saving data for JF24469: {'created_time': 1774699242.119855, 'last_price_update_time': 1774699242.119864, 'auction_closing_time': 1774884329.0}
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JF24469') HTTP/1.1" 204 0
2026-03-28 12:00:42 [auto1.it] INFO: Found listing with ID: KG10642
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG10642%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [auto1.it] INFO: Scrape type for KG10642: 1
2026-03-28 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU30300/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML76939> (referer: https://www.auto1.com/v1/car-details-view/ML76939/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ81563> (referer: https://www.auto1.com/v1/car-details-view/YJ81563/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD34551/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ90962> (referer: https://www.auto1.com/v1/car-details-view/VZ90962/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:42 [auto1.it] INFO: Found listing with ID: VU78996
2026-03-28 12:00:42 [auto1.it] INFO: Found listing with ID: JC58161
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC58161%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [auto1.it] INFO: Scrape type for JC58161: 1
2026-03-28 12:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb7fd10>
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e20f307-15b9-531c-a295-805ffed5fb8e/1e20f307-15b9-531c-a295-805ffed5fb8e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fe9%252F23e9f91f5ef896a1bc59bfebb7ff805b%252Fpa%252FNL56799_080b5256bfe294f3e228ddcf84ca824f.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_080b5256bfe294f3e228ddcf84ca824f.jpg saved to cache
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e20f307-15b9-531c-a295-805ffed5fb8e
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cc077d0>
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e20f307-15b9-531c-a295-805ffed5fb8e/1e20f307-15b9-531c-a295-805ffed5fb8e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fe9%252F23e9f91f5ef896a1bc59bfebb7ff805b%252Fpa%252FNL56799_26a0fd274b6f382c8cdbfff37ac6b677.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_26a0fd274b6f382c8cdbfff37ac6b677.jpg saved to cache
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e20f307-15b9-531c-a295-805ffed5fb8e
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cabe390>
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e20f307-15b9-531c-a295-805ffed5fb8e/1e20f307-15b9-531c-a295-805ffed5fb8e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fe9%252F23e9f91f5ef896a1bc59bfebb7ff805b%252Fpa%252FNL56799_e890e121f59f9f0d0151cdb43e41e461.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_e890e121f59f9f0d0151cdb43e41e461.jpg saved to cache
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e20f307-15b9-531c-a295-805ffed5fb8e
2026-03-28 12:00:42 [auto1.it] INFO: Found listing with ID: NB09244
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB09244%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [auto1.it] INFO: Scrape type for NB09244: 1
2026-03-28 12:00:42 [auto1.it] INFO: Found listing with ID: CG41342
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG41342%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [auto1.it] INFO: Scrape type for CG41342: 0
2026-03-28 12:00:42 [auto1.it] INFO: Found listing with ID: XC50936
2026-03-28 12:00:42 [auto1.it] INFO: Found listing with ID: PU47641
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU47641%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [auto1.it] INFO: Scrape type for PU47641: 0
2026-03-28 12:00:42 [auto1.it] INFO: Found listing with ID: TV36442
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV36442%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [auto1.it] INFO: Scrape type for TV36442: 0
2026-03-28 12:00:42 [auto1.it] INFO: Found listing with ID: YG59194
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG59194%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [auto1.it] INFO: Scrape type for YG59194: 2
2026-03-28 12:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36aee4e9-8001-55f9-8ce3-adc8cfd68b83 with identifier: YG59194
2026-03-28 12:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36aee4e9-8001-55f9-8ce3-adc8cfd68b83 with scrape type 2
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36aee4e9-8001-55f9-8ce3-adc8cfd68b83 with scrape type 2
2026-03-28 12:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 36aee4e9-8001-55f9-8ce3-adc8cfd68b83, identifier: YG59194
2026-03-28 12:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 36aee4e9-8001-55f9-8ce3-adc8cfd68b83 with identifier: YG59194
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 12:00:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 36aee4e9-8001-55f9-8ce3-adc8cfd68b83 with identifier: YG59194
2026-03-28 12:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 36aee4e9-8001-55f9-8ce3-adc8cfd68b83 with identifier: YG59194 to the API
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:29:29Z',
'fuel_type': 'petrol',
'id': '36aee4e9-8001-55f9-8ce3-adc8cfd68b83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG59194',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 115319,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-17',
'seller_name': None,
'title': 'Renault Espace 1.6 TCe Energy Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2015}
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG59194%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [auto1.it] INFO: Saving data for YG59194: {'auction_closing_time': 1774884569.0, 'created_time': 1773954600.822853, 'last_price_update_time': 1774699243.059313}
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YG59194') HTTP/1.1" 204 0
2026-03-28 12:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88614e76-2d00-5bf2-8bfd-bef3b21e2a31 with identifier: ML76939
2026-03-28 12:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88614e76-2d00-5bf2-8bfd-bef3b21e2a31 with scrape type 1
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 88614e76-2d00-5bf2-8bfd-bef3b21e2a31
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb1%252F06b193c16e6c31516ded0d736f4b8e0e%252Fpa%252FML76939_74aaf622847fc49304932cf418a75cdd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_74aaf622847fc49304932cf418a75cdd.jpg not downloaded yet
2026-03-28 12:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 453f202c-8f5b-5971-b8cd-72c41834e578 with identifier: YJ81563
2026-03-28 12:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 453f202c-8f5b-5971-b8cd-72c41834e578 with scrape type 1
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 453f202c-8f5b-5971-b8cd-72c41834e578
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_574f4cd6168c4150f05fbf6870b837ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_574f4cd6168c4150f05fbf6870b837ff.jpg not downloaded yet
2026-03-28 12:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81767e69-3eea-5db5-8b31-f60881e1b5e9 with identifier: VZ90962
2026-03-28 12:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81767e69-3eea-5db5-8b31-f60881e1b5e9 with scrape type 1
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 81767e69-3eea-5db5-8b31-f60881e1b5e9
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F33%252Fee3323f56bb1f406e4db5d076e4d90d8%252Fpa%252FVZ90962_90d767e1d0a0ee2d35a2fa0a1e66f6c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_90d767e1d0a0ee2d35a2fa0a1e66f6c2.jpg not downloaded yet
2026-03-28 12:00:43 [auto1.it] INFO: Found listing with ID: NZ89280
2026-03-28 12:00:43 [auto1.it] INFO: Found listing with ID: DV86201
2026-03-28 12:00:43 [auto1.it] INFO: Found listing with ID: MR47105
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR47105%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [auto1.it] INFO: Scrape type for MR47105: 1
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ19911/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb1%252F06b193c16e6c31516ded0d736f4b8e0e%252Fpa%252FML76939_1871a7d326dd7e051adabc371788ab05.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_1871a7d326dd7e051adabc371788ab05.jpg not downloaded yet
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_412eae4e693eef8186cbcce5fa0f5f22.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_412eae4e693eef8186cbcce5fa0f5f22.jpg not downloaded yet
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F33%252Fee3323f56bb1f406e4db5d076e4d90d8%252Fpa%252FVZ90962_3f58d615183e1e84e793be956acd05f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_3f58d615183e1e84e793be956acd05f0.jpg not downloaded yet
2026-03-28 12:00:43 [auto1.it] INFO: Found listing with ID: CP63934
2026-03-28 12:00:43 [auto1.it] INFO: Found listing with ID: WA70865
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA70865%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [auto1.it] INFO: Scrape type for WA70865: 1
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KW13943/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WM47642> (referer: https://www.auto1.com/v1/car-details-view/WM47642/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb1%252F06b193c16e6c31516ded0d736f4b8e0e%252Fpa%252FML76939_7de0750dd812b57eb079be7207dcb8b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_7de0750dd812b57eb079be7207dcb8b8.jpg not downloaded yet
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_94b8e9a318a6bcabde72cb285623494d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_94b8e9a318a6bcabde72cb285623494d.jpg not downloaded yet
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F33%252Fee3323f56bb1f406e4db5d076e4d90d8%252Fpa%252FVZ90962_47398831f3871f94b2dd204a329dc0bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_47398831f3871f94b2dd204a329dc0bc.jpg not downloaded yet
2026-03-28 12:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:43 [auto1.it] INFO: Found listing with ID: ZB75356
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB75356%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [auto1.it] INFO: Scrape type for ZB75356: 1
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb1%252F06b193c16e6c31516ded0d736f4b8e0e%252Fpa%252FML76939_8dbb83a2ce43dd263465706ce991be99.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_8dbb83a2ce43dd263465706ce991be99.jpg not downloaded yet
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_130fc08d0ce79f24e07190ea55727db5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_130fc08d0ce79f24e07190ea55727db5.jpg not downloaded yet
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F33%252Fee3323f56bb1f406e4db5d076e4d90d8%252Fpa%252FVZ90962_16596295c8e920ff8879250d617b6249.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_16596295c8e920ff8879250d617b6249.jpg not downloaded yet
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_90d767e1d0a0ee2d35a2fa0a1e66f6c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [auto1.it] INFO: Found listing with ID: SM49398
2026-03-28 12:00:43 [auto1.it] INFO: Found listing with ID: ND99251
2026-03-28 12:00:43 [auto1.it] INFO: Found listing with ID: RE64067
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE64067%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [auto1.it] INFO: Scrape type for RE64067: 1
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb1%252F06b193c16e6c31516ded0d736f4b8e0e%252Fpa%252FML76939_8b728b8e4f8923bbac5698948b809fb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_8b728b8e4f8923bbac5698948b809fb8.jpg not downloaded yet
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_7f69509a47dd93cfec0bdc8fbdb20834.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_7f69509a47dd93cfec0bdc8fbdb20834.jpg not downloaded yet
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F33%252Fee3323f56bb1f406e4db5d076e4d90d8%252Fpa%252FVZ90962_81b867e7f37cad03b918d599699c11d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_81b867e7f37cad03b918d599699c11d2.jpg not downloaded yet
2026-03-28 12:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62388a83-9e2c-5e6f-9e49-a2bd5432727c with identifier: WM47642
2026-03-28 12:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62388a83-9e2c-5e6f-9e49-a2bd5432727c with scrape type 1
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 62388a83-9e2c-5e6f-9e49-a2bd5432727c
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F95%252Ffc95a509d275f5d1cf1765afcba43471%252Fpa%252FWM47642_595a48a412371fbe65f3745208acd9fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/95/fc95a509d275f5d1cf1765afcba43471/pa/WM47642_595a48a412371fbe65f3745208acd9fc.jpg not downloaded yet
2026-03-28 12:00:43 [auto1.it] INFO: Found listing with ID: DE18860
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_3f58d615183e1e84e793be956acd05f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_391d6048acf882853c305e5d2ccc9d76.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_391d6048acf882853c305e5d2ccc9d76.jpg not downloaded yet
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F95%252Ffc95a509d275f5d1cf1765afcba43471%252Fpa%252FWM47642_421092d0406146f10dfc6ea9f7e0e50b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/95/fc95a509d275f5d1cf1765afcba43471/pa/WM47642_421092d0406146f10dfc6ea9f7e0e50b.jpg not downloaded yet
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_3701a94737ca788872ec60baa074c481.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_3701a94737ca788872ec60baa074c481.jpg not downloaded yet
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F95%252Ffc95a509d275f5d1cf1765afcba43471%252Fpa%252FWM47642_75afcbd4bac0d6bf5e64d5111b480f42.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/95/fc95a509d275f5d1cf1765afcba43471/pa/WM47642_75afcbd4bac0d6bf5e64d5111b480f42.jpg not downloaded yet
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_16596295c8e920ff8879250d617b6249.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cc05710>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81767e69-3eea-5db5-8b31-f60881e1b5e9/81767e69-3eea-5db5-8b31-f60881e1b5e9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F33%252Fee3323f56bb1f406e4db5d076e4d90d8%252Fpa%252FVZ90962_90d767e1d0a0ee2d35a2fa0a1e66f6c2.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_90d767e1d0a0ee2d35a2fa0a1e66f6c2.jpg saved to cache
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81767e69-3eea-5db5-8b31-f60881e1b5e9
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_e49699e89d3db85f6ea8891beb162f34.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_e49699e89d3db85f6ea8891beb162f34.jpg not downloaded yet
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F95%252Ffc95a509d275f5d1cf1765afcba43471%252Fpa%252FWM47642_48cacefedbe72476378e1a9614a25c7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/95/fc95a509d275f5d1cf1765afcba43471/pa/WM47642_48cacefedbe72476378e1a9614a25c7d.jpg not downloaded yet
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_7012ea4397e82cf1e8b1683b8991aebb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_7012ea4397e82cf1e8b1683b8991aebb.jpg not downloaded yet
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cc07e90>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81767e69-3eea-5db5-8b31-f60881e1b5e9/81767e69-3eea-5db5-8b31-f60881e1b5e9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F33%252Fee3323f56bb1f406e4db5d076e4d90d8%252Fpa%252FVZ90962_3f58d615183e1e84e793be956acd05f0.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_3f58d615183e1e84e793be956acd05f0.jpg saved to cache
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 81767e69-3eea-5db5-8b31-f60881e1b5e9
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_7bd044f9b8de6527a3b5ce6240e38134.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_7bd044f9b8de6527a3b5ce6240e38134.jpg not downloaded yet
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/95/fc95a509d275f5d1cf1765afcba43471/pa/WM47642_595a48a412371fbe65f3745208acd9fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/95/fc95a509d275f5d1cf1765afcba43471/pa/WM47642_421092d0406146f10dfc6ea9f7e0e50b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d53bad0>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81767e69-3eea-5db5-8b31-f60881e1b5e9/81767e69-3eea-5db5-8b31-f60881e1b5e9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F33%252Fee3323f56bb1f406e4db5d076e4d90d8%252Fpa%252FVZ90962_16596295c8e920ff8879250d617b6249.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_16596295c8e920ff8879250d617b6249.jpg saved to cache
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81767e69-3eea-5db5-8b31-f60881e1b5e9
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU39946/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d625410>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62388a83-9e2c-5e6f-9e49-a2bd5432727c/62388a83-9e2c-5e6f-9e49-a2bd5432727c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F95%252Ffc95a509d275f5d1cf1765afcba43471%252Fpa%252FWM47642_595a48a412371fbe65f3745208acd9fc.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/95/fc95a509d275f5d1cf1765afcba43471/pa/WM47642_595a48a412371fbe65f3745208acd9fc.jpg saved to cache
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62388a83-9e2c-5e6f-9e49-a2bd5432727c
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d536fd0>
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62388a83-9e2c-5e6f-9e49-a2bd5432727c/62388a83-9e2c-5e6f-9e49-a2bd5432727c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F95%252Ffc95a509d275f5d1cf1765afcba43471%252Fpa%252FWM47642_421092d0406146f10dfc6ea9f7e0e50b.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/95/fc95a509d275f5d1cf1765afcba43471/pa/WM47642_421092d0406146f10dfc6ea9f7e0e50b.jpg saved to cache
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 62388a83-9e2c-5e6f-9e49-a2bd5432727c
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF75023> (referer: https://www.auto1.com/v1/car-details-view/NF75023/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RZ14942/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_7bd044f9b8de6527a3b5ce6240e38134.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/95/fc95a509d275f5d1cf1765afcba43471/pa/WM47642_48cacefedbe72476378e1a9614a25c7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB77964/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC50043> (referer: https://www.auto1.com/v1/car-details-view/VC50043/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_7012ea4397e82cf1e8b1683b8991aebb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/95/fc95a509d275f5d1cf1765afcba43471/pa/WM47642_75afcbd4bac0d6bf5e64d5111b480f42.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ae57b21-2147-51b8-a2b0-3ccaceba3baf with identifier: NF75023
2026-03-28 12:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ae57b21-2147-51b8-a2b0-3ccaceba3baf with scrape type 1
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2ae57b21-2147-51b8-a2b0-3ccaceba3baf
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fbc%252Fc5bc9691fa39e67c74c0f8528664327e%252Fpa%252FNF75023_d0acf00473e4528ed9cf973f6bc0419c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/bc/c5bc9691fa39e67c74c0f8528664327e/pa/NF75023_d0acf00473e4528ed9cf973f6bc0419c.jpg already downloaded
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fbc%252Fc5bc9691fa39e67c74c0f8528664327e%252Fpa%252FNF75023_a1d284fd9ef46ff73438d826289ad758.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/bc/c5bc9691fa39e67c74c0f8528664327e/pa/NF75023_a1d284fd9ef46ff73438d826289ad758.jpg already downloaded
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fbc%252Fc5bc9691fa39e67c74c0f8528664327e%252Fpa%252FNF75023_5763eb3df1b02c6fea756a550663fc7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/bc/c5bc9691fa39e67c74c0f8528664327e/pa/NF75023_5763eb3df1b02c6fea756a550663fc7f.jpg already downloaded
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fbc%252Fc5bc9691fa39e67c74c0f8528664327e%252Fpa%252FNF75023_525dc2b98dea674dd7a4745a91fd38b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/bc/c5bc9691fa39e67c74c0f8528664327e/pa/NF75023_525dc2b98dea674dd7a4745a91fd38b3.jpg already downloaded
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fbc%252Fc5bc9691fa39e67c74c0f8528664327e%252Fpa%252FNF75023_f79f11055e3d9b8604c959fa4fdc7529.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/bc/c5bc9691fa39e67c74c0f8528664327e/pa/NF75023_f79f11055e3d9b8604c959fa4fdc7529.jpg already downloaded
2026-03-28 12:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2ae57b21-2147-51b8-a2b0-3ccaceba3baf, identifier: NF75023
2026-03-28 12:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2ae57b21-2147-51b8-a2b0-3ccaceba3baf with identifier: NF75023
2026-03-28 12:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2ae57b21-2147-51b8-a2b0-3ccaceba3baf with identifier: NF75023
2026-03-28 12:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2ae57b21-2147-51b8-a2b0-3ccaceba3baf with identifier: NF75023 to the API
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NF75023>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': 'Rental',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:24:27Z',
'fuel_type': 'diesel',
'id': '2ae57b21-2147-51b8-a2b0-3ccaceba3baf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF75023',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Peugeot',
'model': '308',
'odometer': 216475,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgc5/bc/c5bc9691fa39e67c74c0f8528664327e/pa/NF75023_d0acf00473e4528ed9cf973f6bc0419c.jpg',
'https://img-pa.auto1.com/imgc5/bc/c5bc9691fa39e67c74c0f8528664327e/pa/NF75023_a1d284fd9ef46ff73438d826289ad758.jpg',
'https://img-pa.auto1.com/imgc5/bc/c5bc9691fa39e67c74c0f8528664327e/pa/NF75023_5763eb3df1b02c6fea756a550663fc7f.jpg',
'https://img-pa.auto1.com/imgc5/bc/c5bc9691fa39e67c74c0f8528664327e/pa/NF75023_525dc2b98dea674dd7a4745a91fd38b3.jpg',
'https://img-pa.auto1.com/imgc5/bc/c5bc9691fa39e67c74c0f8528664327e/pa/NF75023_f79f11055e3d9b8604c959fa4fdc7529.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ae57b21-2147-51b8-a2b0-3ccaceba3baf/2ae57b21-2147-51b8-a2b0-3ccaceba3baf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/bc/c5bc9691fa39e67c74c0f8528664327e/pa/NF75023_d0acf00473e4528ed9cf973f6bc0419c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ae57b21-2147-51b8-a2b0-3ccaceba3baf/2ae57b21-2147-51b8-a2b0-3ccaceba3baf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89707,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/bc/c5bc9691fa39e67c74c0f8528664327e/pa/NF75023_a1d284fd9ef46ff73438d826289ad758.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ae57b21-2147-51b8-a2b0-3ccaceba3baf/2ae57b21-2147-51b8-a2b0-3ccaceba3baf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77879,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/bc/c5bc9691fa39e67c74c0f8528664327e/pa/NF75023_5763eb3df1b02c6fea756a550663fc7f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ae57b21-2147-51b8-a2b0-3ccaceba3baf/2ae57b21-2147-51b8-a2b0-3ccaceba3baf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/bc/c5bc9691fa39e67c74c0f8528664327e/pa/NF75023_525dc2b98dea674dd7a4745a91fd38b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ae57b21-2147-51b8-a2b0-3ccaceba3baf/2ae57b21-2147-51b8-a2b0-3ccaceba3baf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/bc/c5bc9691fa39e67c74c0f8528664327e/pa/NF75023_f79f11055e3d9b8604c959fa4fdc7529.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 HDi Tecno',
'transmission': 'manual',
'trim': 'Tecno',
'year': 2010}
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF75023%27 HTTP/1.1" 200 None
2026-03-28 12:00:44 [auto1.it] INFO: Saving data for NF75023: {'created_time': 1774699244.754411, 'last_price_update_time': 1774699244.754422, 'auction_closing_time': 1774884267.0}
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF75023') HTTP/1.1" 204 0
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_81b867e7f37cad03b918d599699c11d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_391d6048acf882853c305e5d2ccc9d76.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF04401/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT78827/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU75020/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d432a50>
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_7bd044f9b8de6527a3b5ce6240e38134.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_7bd044f9b8de6527a3b5ce6240e38134.jpg saved to cache
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 453f202c-8f5b-5971-b8cd-72c41834e578
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3caf6110>
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62388a83-9e2c-5e6f-9e49-a2bd5432727c/62388a83-9e2c-5e6f-9e49-a2bd5432727c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F95%252Ffc95a509d275f5d1cf1765afcba43471%252Fpa%252FWM47642_48cacefedbe72476378e1a9614a25c7d.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/95/fc95a509d275f5d1cf1765afcba43471/pa/WM47642_48cacefedbe72476378e1a9614a25c7d.jpg saved to cache
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 62388a83-9e2c-5e6f-9e49-a2bd5432727c
2026-03-28 12:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63d019c5-ea33-5212-a31c-6d0cc848f1e8 with identifier: VC50043
2026-03-28 12:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63d019c5-ea33-5212-a31c-6d0cc848f1e8 with scrape type 1
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63d019c5-ea33-5212-a31c-6d0cc848f1e8
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_47bdb3f237eee4beb066028977d62102.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_47bdb3f237eee4beb066028977d62102.jpg not downloaded yet
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c96c390>
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_7012ea4397e82cf1e8b1683b8991aebb.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_7012ea4397e82cf1e8b1683b8991aebb.jpg saved to cache
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 453f202c-8f5b-5971-b8cd-72c41834e578
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d45a550>
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62388a83-9e2c-5e6f-9e49-a2bd5432727c/62388a83-9e2c-5e6f-9e49-a2bd5432727c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F95%252Ffc95a509d275f5d1cf1765afcba43471%252Fpa%252FWM47642_75afcbd4bac0d6bf5e64d5111b480f42.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/95/fc95a509d275f5d1cf1765afcba43471/pa/WM47642_75afcbd4bac0d6bf5e64d5111b480f42.jpg saved to cache
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 62388a83-9e2c-5e6f-9e49-a2bd5432727c
2026-03-28 12:00:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62388a83-9e2c-5e6f-9e49-a2bd5432727c, skipping ID generation
2026-03-28 12:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62388a83-9e2c-5e6f-9e49-a2bd5432727c with scrape type 1
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62388a83-9e2c-5e6f-9e49-a2bd5432727c sending to next pipeline
2026-03-28 12:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 62388a83-9e2c-5e6f-9e49-a2bd5432727c, identifier: WM47642
2026-03-28 12:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 62388a83-9e2c-5e6f-9e49-a2bd5432727c with identifier: WM47642
2026-03-28 12:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 62388a83-9e2c-5e6f-9e49-a2bd5432727c with identifier: WM47642
2026-03-28 12:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 62388a83-9e2c-5e6f-9e49-a2bd5432727c with identifier: WM47642 to the API
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/95/fc95a509d275f5d1cf1765afcba43471/pa/WM47642_75afcbd4bac0d6bf5e64d5111b480f42.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.2L',
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:54:53Z',
'fuel_type': 'diesel',
'id': '62388a83-9e2c-5e6f-9e49-a2bd5432727c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM47642',
'listing': 'auction',
'location': 'IT, Napoli',
'make': 'Opel',
'model': 'Corsa',
'odometer': 95326,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 4,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62388a83-9e2c-5e6f-9e49-a2bd5432727c/62388a83-9e2c-5e6f-9e49-a2bd5432727c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80789,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/95/fc95a509d275f5d1cf1765afcba43471/pa/WM47642_595a48a412371fbe65f3745208acd9fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62388a83-9e2c-5e6f-9e49-a2bd5432727c/62388a83-9e2c-5e6f-9e49-a2bd5432727c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/95/fc95a509d275f5d1cf1765afcba43471/pa/WM47642_421092d0406146f10dfc6ea9f7e0e50b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62388a83-9e2c-5e6f-9e49-a2bd5432727c/62388a83-9e2c-5e6f-9e49-a2bd5432727c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56708,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/95/fc95a509d275f5d1cf1765afcba43471/pa/WM47642_75afcbd4bac0d6bf5e64d5111b480f42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62388a83-9e2c-5e6f-9e49-a2bd5432727c/62388a83-9e2c-5e6f-9e49-a2bd5432727c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57183,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/95/fc95a509d275f5d1cf1765afcba43471/pa/WM47642_48cacefedbe72476378e1a9614a25c7d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-03-09',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.3 CDTI Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2011}
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM47642%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [auto1.it] INFO: Saving data for WM47642: {'created_time': 1774699245.636611, 'last_price_update_time': 1774699245.636622, 'auction_closing_time': 1774886093.0}
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WM47642') HTTP/1.1" 204 0
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_7f69509a47dd93cfec0bdc8fbdb20834.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_0d087464134db705d7823b736f8fecfb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_0d087464134db705d7823b736f8fecfb.jpg not downloaded yet
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d68b010>
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81767e69-3eea-5db5-8b31-f60881e1b5e9/81767e69-3eea-5db5-8b31-f60881e1b5e9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F33%252Fee3323f56bb1f406e4db5d076e4d90d8%252Fpa%252FVZ90962_81b867e7f37cad03b918d599699c11d2.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_81b867e7f37cad03b918d599699c11d2.jpg saved to cache
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81767e69-3eea-5db5-8b31-f60881e1b5e9
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d695290>
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_391d6048acf882853c305e5d2ccc9d76.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_391d6048acf882853c305e5d2ccc9d76.jpg saved to cache
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 453f202c-8f5b-5971-b8cd-72c41834e578
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_9b060e96693bc4bdd6937a4bd1ed108f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_9b060e96693bc4bdd6937a4bd1ed108f.jpg not downloaded yet
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KG10642/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_8b728b8e4f8923bbac5698948b809fb8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_295ad885c05dc35535e3049adc40bd8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_295ad885c05dc35535e3049adc40bd8b.jpg not downloaded yet
2026-03-28 12:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4f1890>
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_7f69509a47dd93cfec0bdc8fbdb20834.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_7f69509a47dd93cfec0bdc8fbdb20834.jpg saved to cache
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 453f202c-8f5b-5971-b8cd-72c41834e578
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_130fc08d0ce79f24e07190ea55727db5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_4877d62a8d8145801e47af8283ee057e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_4877d62a8d8145801e47af8283ee057e.jpg not downloaded yet
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_47bdb3f237eee4beb066028977d62102.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_f2f38c40dd57f8220132863af00bc965.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_f2f38c40dd57f8220132863af00bc965.jpg not downloaded yet
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_e6f380002446e374528645a5d49ae006.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_e6f380002446e374528645a5d49ae006.jpg not downloaded yet
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d598e90>
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88614e76-2d00-5bf2-8bfd-bef3b21e2a31/88614e76-2d00-5bf2-8bfd-bef3b21e2a31_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb1%252F06b193c16e6c31516ded0d736f4b8e0e%252Fpa%252FML76939_8b728b8e4f8923bbac5698948b809fb8.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_8b728b8e4f8923bbac5698948b809fb8.jpg saved to cache
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88614e76-2d00-5bf2-8bfd-bef3b21e2a31
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_9b060e96693bc4bdd6937a4bd1ed108f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_c40ebe0c1343c36c3a280738601579e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_c40ebe0c1343c36c3a280738601579e4.jpg not downloaded yet
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_c2369facc6e98e30797e2cff3a5e7080.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_c2369facc6e98e30797e2cff3a5e7080.jpg not downloaded yet
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_c440390a4231fb9704104584673b705f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_c440390a4231fb9704104584673b705f.jpg not downloaded yet
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d438d10>
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_130fc08d0ce79f24e07190ea55727db5.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_130fc08d0ce79f24e07190ea55727db5.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 453f202c-8f5b-5971-b8cd-72c41834e578
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d8030d0>
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_47bdb3f237eee4beb066028977d62102.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_47bdb3f237eee4beb066028977d62102.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63d019c5-ea33-5212-a31c-6d0cc848f1e8
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ66288/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_3701a94737ca788872ec60baa074c481.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f531810>
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_9b060e96693bc4bdd6937a4bd1ed108f.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_9b060e96693bc4bdd6937a4bd1ed108f.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63d019c5-ea33-5212-a31c-6d0cc848f1e8
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_e49699e89d3db85f6ea8891beb162f34.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_4877d62a8d8145801e47af8283ee057e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_295ad885c05dc35535e3049adc40bd8b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6fb950>
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_3701a94737ca788872ec60baa074c481.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_3701a94737ca788872ec60baa074c481.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 453f202c-8f5b-5971-b8cd-72c41834e578
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_c40ebe0c1343c36c3a280738601579e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d607910>
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_e49699e89d3db85f6ea8891beb162f34.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_e49699e89d3db85f6ea8891beb162f34.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 453f202c-8f5b-5971-b8cd-72c41834e578
2026-03-28 12:00:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca42c90>
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_4877d62a8d8145801e47af8283ee057e.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_4877d62a8d8145801e47af8283ee057e.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63d019c5-ea33-5212-a31c-6d0cc848f1e8
2026-03-28 12:00:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cad4f90>
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_295ad885c05dc35535e3049adc40bd8b.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_295ad885c05dc35535e3049adc40bd8b.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63d019c5-ea33-5212-a31c-6d0cc848f1e8
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX06371/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RB44165/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MU44225> (referer: https://www.auto1.com/v1/car-details-view/MU44225/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA70865/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7040d0>
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_c40ebe0c1343c36c3a280738601579e4.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_c40ebe0c1343c36c3a280738601579e4.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63d019c5-ea33-5212-a31c-6d0cc848f1e8
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU39946> (referer: https://www.auto1.com/v1/car-details-view/YU39946/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KW13943> (referer: https://www.auto1.com/v1/car-details-view/KW13943/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_c440390a4231fb9704104584673b705f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_c2369facc6e98e30797e2cff3a5e7080.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 154ec7f7-09d6-508b-8a44-8d6030b71dc9 with identifier: MU44225
2026-03-28 12:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 154ec7f7-09d6-508b-8a44-8d6030b71dc9 with scrape type 1
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 154ec7f7-09d6-508b-8a44-8d6030b71dc9
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_a6689e46de57b822280117bf0e802b57.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_a6689e46de57b822280117bf0e802b57.jpg not downloaded yet
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_8dbb83a2ce43dd263465706ce991be99.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_0d087464134db705d7823b736f8fecfb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_47398831f3871f94b2dd204a329dc0bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_7bfc8fa8a2517d587a14a7156b6a2059.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_7bfc8fa8a2517d587a14a7156b6a2059.jpg not downloaded yet
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_f2f38c40dd57f8220132863af00bc965.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_e6f380002446e374528645a5d49ae006.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_de7bab107dbf951f1c87dcb249629082.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_de7bab107dbf951f1c87dcb249629082.jpg not downloaded yet
2026-03-28 12:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f36a363d-16e8-55e1-9438-200bfc854b53 with identifier: YU39946
2026-03-28 12:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f36a363d-16e8-55e1-9438-200bfc854b53 with scrape type 1
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f36a363d-16e8-55e1-9438-200bfc854b53
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_765ae610f73c443e3ca34b4ef40ed42a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_765ae610f73c443e3ca34b4ef40ed42a.jpg not downloaded yet
2026-03-28 12:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dadf2e7-5a75-55cd-a568-19ae97860a47 with identifier: KW13943
2026-03-28 12:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dadf2e7-5a75-55cd-a568-19ae97860a47 with scrape type 1
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2dadf2e7-5a75-55cd-a568-19ae97860a47
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F0f%252Faa0f583a09375dd5622c2f2e9df3b7f1%252Fpa%252FKW13943_fe3e656ea7a78ce1f240af9ca72775ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_fe3e656ea7a78ce1f240af9ca72775ae.jpg not downloaded yet
2026-03-28 12:00:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d68c790>
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_c440390a4231fb9704104584673b705f.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_c440390a4231fb9704104584673b705f.jpg saved to cache
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63d019c5-ea33-5212-a31c-6d0cc848f1e8
2026-03-28 12:00:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbb7fd0>
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_c2369facc6e98e30797e2cff3a5e7080.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_c2369facc6e98e30797e2cff3a5e7080.jpg saved to cache
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63d019c5-ea33-5212-a31c-6d0cc848f1e8
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_43b9a7b8fbe48b58e635996f4c32245d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_43b9a7b8fbe48b58e635996f4c32245d.jpg not downloaded yet
2026-03-28 12:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_a6689e46de57b822280117bf0e802b57.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_eede851eb01b3bff000482179cec94b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_eede851eb01b3bff000482179cec94b2.jpg not downloaded yet
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F0f%252Faa0f583a09375dd5622c2f2e9df3b7f1%252Fpa%252FKW13943_76dfc7d7610d89d504a079f7a0d84595.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_76dfc7d7610d89d504a079f7a0d84595.jpg not downloaded yet
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_39e4b7b224df73d7105b30982b85c510.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_39e4b7b224df73d7105b30982b85c510.jpg not downloaded yet
2026-03-28 12:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ19911> (referer: https://www.auto1.com/v1/car-details-view/FJ19911/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d67b610>
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88614e76-2d00-5bf2-8bfd-bef3b21e2a31/88614e76-2d00-5bf2-8bfd-bef3b21e2a31_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb1%252F06b193c16e6c31516ded0d736f4b8e0e%252Fpa%252FML76939_8dbb83a2ce43dd263465706ce991be99.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_8dbb83a2ce43dd263465706ce991be99.jpg saved to cache
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88614e76-2d00-5bf2-8bfd-bef3b21e2a31
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c9282d0>
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_0d087464134db705d7823b736f8fecfb.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_0d087464134db705d7823b736f8fecfb.jpg saved to cache
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63d019c5-ea33-5212-a31c-6d0cc848f1e8
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cabfa90>
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81767e69-3eea-5db5-8b31-f60881e1b5e9/81767e69-3eea-5db5-8b31-f60881e1b5e9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F33%252Fee3323f56bb1f406e4db5d076e4d90d8%252Fpa%252FVZ90962_47398831f3871f94b2dd204a329dc0bc.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_47398831f3871f94b2dd204a329dc0bc.jpg saved to cache
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 81767e69-3eea-5db5-8b31-f60881e1b5e9
2026-03-28 12:00:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81767e69-3eea-5db5-8b31-f60881e1b5e9, skipping ID generation
2026-03-28 12:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81767e69-3eea-5db5-8b31-f60881e1b5e9 with scrape type 1
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81767e69-3eea-5db5-8b31-f60881e1b5e9 sending to next pipeline
2026-03-28 12:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 81767e69-3eea-5db5-8b31-f60881e1b5e9, identifier: VZ90962
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d585450>
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_f2f38c40dd57f8220132863af00bc965.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_f2f38c40dd57f8220132863af00bc965.jpg saved to cache
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63d019c5-ea33-5212-a31c-6d0cc848f1e8
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4f0c10>
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ffb%252Fd6fbb656b61b85c416505d5a1f91c179%252Fpa%252FVC50043_e6f380002446e374528645a5d49ae006.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_e6f380002446e374528645a5d49ae006.jpg saved to cache
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63d019c5-ea33-5212-a31c-6d0cc848f1e8
2026-03-28 12:00:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63d019c5-ea33-5212-a31c-6d0cc848f1e8, skipping ID generation
2026-03-28 12:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63d019c5-ea33-5212-a31c-6d0cc848f1e8 with scrape type 1
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63d019c5-ea33-5212-a31c-6d0cc848f1e8 sending to next pipeline
2026-03-28 12:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 63d019c5-ea33-5212-a31c-6d0cc848f1e8, identifier: VC50043
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_2ec21f2adcb0fc5a226976561373702d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_2ec21f2adcb0fc5a226976561373702d.jpg not downloaded yet
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F0f%252Faa0f583a09375dd5622c2f2e9df3b7f1%252Fpa%252FKW13943_c48ea3043fc4c67a873727e79b457680.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_c48ea3043fc4c67a873727e79b457680.jpg not downloaded yet
2026-03-28 12:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 81767e69-3eea-5db5-8b31-f60881e1b5e9 with identifier: VZ90962
2026-03-28 12:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 81767e69-3eea-5db5-8b31-f60881e1b5e9 with identifier: VZ90962
2026-03-28 12:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 81767e69-3eea-5db5-8b31-f60881e1b5e9 with identifier: VZ90962 to the API
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_47398831f3871f94b2dd204a329dc0bc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '1.2L',
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:10:34Z',
'fuel_type': 'petrol',
'id': '81767e69-3eea-5db5-8b31-f60881e1b5e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ90962',
'listing': 'auction',
'location': 'IT, Roma RM',
'make': 'Opel',
'model': 'Corsa',
'odometer': 24736,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81767e69-3eea-5db5-8b31-f60881e1b5e9/81767e69-3eea-5db5-8b31-f60881e1b5e9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_90d767e1d0a0ee2d35a2fa0a1e66f6c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81767e69-3eea-5db5-8b31-f60881e1b5e9/81767e69-3eea-5db5-8b31-f60881e1b5e9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59083,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_3f58d615183e1e84e793be956acd05f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81767e69-3eea-5db5-8b31-f60881e1b5e9/81767e69-3eea-5db5-8b31-f60881e1b5e9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55436,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_47398831f3871f94b2dd204a329dc0bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81767e69-3eea-5db5-8b31-f60881e1b5e9/81767e69-3eea-5db5-8b31-f60881e1b5e9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_16596295c8e920ff8879250d617b6249.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81767e69-3eea-5db5-8b31-f60881e1b5e9/81767e69-3eea-5db5-8b31-f60881e1b5e9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/33/ee3323f56bb1f406e4db5d076e4d90d8/pa/VZ90962_81b867e7f37cad03b918d599699c11d2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2006}
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ90962%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [auto1.it] INFO: Saving data for VZ90962: {'created_time': 1774699248.337593, 'last_price_update_time': 1774699248.337604, 'auction_closing_time': 1774883434.0}
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VZ90962') HTTP/1.1" 204 0
2026-03-28 12:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 63d019c5-ea33-5212-a31c-6d0cc848f1e8 with identifier: VC50043
2026-03-28 12:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 63d019c5-ea33-5212-a31c-6d0cc848f1e8 with identifier: VC50043
2026-03-28 12:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 63d019c5-ea33-5212-a31c-6d0cc848f1e8 with identifier: VC50043 to the API
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_e6f380002446e374528645a5d49ae006.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:20:37Z',
'fuel_type': 'diesel',
'id': '63d019c5-ea33-5212-a31c-6d0cc848f1e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC50043',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Peugeot',
'model': '508',
'odometer': 255963,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_47bdb3f237eee4beb066028977d62102.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_0d087464134db705d7823b736f8fecfb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_9b060e96693bc4bdd6937a4bd1ed108f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2532703,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_295ad885c05dc35535e3049adc40bd8b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2475479,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_4877d62a8d8145801e47af8283ee057e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66399,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_f2f38c40dd57f8220132863af00bc965.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_e6f380002446e374528645a5d49ae006.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_c40ebe0c1343c36c3a280738601579e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2442955,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_c2369facc6e98e30797e2cff3a5e7080.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d019c5-ea33-5212-a31c-6d0cc848f1e8/63d019c5-ea33-5212-a31c-6d0cc848f1e8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2264672,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/fb/d6fbb656b61b85c416505d5a1f91c179/pa/VC50043_c440390a4231fb9704104584673b705f.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-07-24',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 508 2.0 Blue-HDi Féline',
'transmission': 'automatic',
'trim': 'Féline',
'year': 2016}
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC50043%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [auto1.it] INFO: Saving data for VC50043: {'created_time': 1774699248.728823, 'last_price_update_time': 1774699248.728835, 'auction_closing_time': 1774884037.0}
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VC50043') HTTP/1.1" 204 0
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_0c90e0302905fb6dfd3b5d873bf1cf92.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_0c90e0302905fb6dfd3b5d873bf1cf92.jpg not downloaded yet
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_95fcc52a36fd7f86da0b7ea7e605b90f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_95fcc52a36fd7f86da0b7ea7e605b90f.jpg not downloaded yet
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F0f%252Faa0f583a09375dd5622c2f2e9df3b7f1%252Fpa%252FKW13943_503981f5e04c60144be8775c297bbea5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_503981f5e04c60144be8775c297bbea5.jpg not downloaded yet
2026-03-28 12:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU75020> (referer: https://www.auto1.com/v1/car-details-view/XU75020/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT78827> (referer: https://www.auto1.com/v1/car-details-view/RT78827/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KG10642> (referer: https://www.auto1.com/v1/car-details-view/KG10642/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF04401> (referer: https://www.auto1.com/v1/car-details-view/GF04401/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RZ14942> (referer: https://www.auto1.com/v1/car-details-view/RZ14942/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca67b50>
2026-03-28 12:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_a6689e46de57b822280117bf0e802b57.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_a6689e46de57b822280117bf0e802b57.jpg saved to cache
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 154ec7f7-09d6-508b-8a44-8d6030b71dc9
2026-03-28 12:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4e98a58-475d-538f-938e-ff24bc88082c with identifier: FJ19911
2026-03-28 12:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4e98a58-475d-538f-938e-ff24bc88082c with scrape type 1
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4e98a58-475d-538f-938e-ff24bc88082c
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_f45aba372c10acf4fe7b68fcda8f8c45.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_f45aba372c10acf4fe7b68fcda8f8c45.jpg not downloaded yet
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_6239b9f4e41e6f4212af50d7e45ae306.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_6239b9f4e41e6f4212af50d7e45ae306.jpg not downloaded yet
2026-03-28 12:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_c204f61ea78bb1558c59b58fc9548b0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_c204f61ea78bb1558c59b58fc9548b0c.jpg not downloaded yet
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F0f%252Faa0f583a09375dd5622c2f2e9df3b7f1%252Fpa%252FKW13943_01f6b27256d9d1259a985fca7bb50a59.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_01f6b27256d9d1259a985fca7bb50a59.jpg not downloaded yet
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_9c6e97b7f86af9b078624b665f5fb5a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_9c6e97b7f86af9b078624b665f5fb5a0.jpg not downloaded yet
2026-03-28 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_fe3e656ea7a78ce1f240af9ca72775ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_60ddb89c046a0113a74ed5b4bc2ba9e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_60ddb89c046a0113a74ed5b4bc2ba9e7.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_b7ea9faa318f4b918d04b30dbcc79abf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_b7ea9faa318f4b918d04b30dbcc79abf.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F0f%252Faa0f583a09375dd5622c2f2e9df3b7f1%252Fpa%252FKW13943_2e9bc24a30b6a38f15c91a6403ebfd5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_2e9bc24a30b6a38f15c91a6403ebfd5b.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_325db82a00887eb771091f3bc03f3953.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_325db82a00887eb771091f3bc03f3953.jpg not downloaded yet
2026-03-28 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_43b9a7b8fbe48b58e635996f4c32245d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_76dfc7d7610d89d504a079f7a0d84595.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_b8e46042d4a9cecdd409a4ffd37181f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_b8e46042d4a9cecdd409a4ffd37181f9.jpg not downloaded yet
2026-03-28 12:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 803d0771-4d91-5995-922f-1f077c458772 with identifier: XU75020
2026-03-28 12:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 803d0771-4d91-5995-922f-1f077c458772 with scrape type 1
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 803d0771-4d91-5995-922f-1f077c458772
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_c0764bfd0703009672faa78f57c86020.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_c0764bfd0703009672faa78f57c86020.jpg not downloaded yet
2026-03-28 12:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f170aece-4cfc-5491-87f1-8a7f088d1a9d with identifier: RT78827
2026-03-28 12:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f170aece-4cfc-5491-87f1-8a7f088d1a9d with scrape type 1
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f170aece-4cfc-5491-87f1-8a7f088d1a9d
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3f%252F153f8479072d855d743e30316c270512%252Fpa%252FRT78827_4574c669b504e41c5225d2a0b68d96fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_4574c669b504e41c5225d2a0b68d96fa.jpg not downloaded yet
2026-03-28 12:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dd67a57-127c-521b-8014-e98e5957b61b with identifier: KG10642
2026-03-28 12:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dd67a57-127c-521b-8014-e98e5957b61b with scrape type 1
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6dd67a57-127c-521b-8014-e98e5957b61b
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_08e8651e7e9fde88f3b911e31aeef428.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_08e8651e7e9fde88f3b911e31aeef428.jpg not downloaded yet
2026-03-28 12:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 920052c9-44bd-53b5-8280-f5dbba9a16e1 with identifier: GF04401
2026-03-28 12:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 920052c9-44bd-53b5-8280-f5dbba9a16e1 with scrape type 1
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 920052c9-44bd-53b5-8280-f5dbba9a16e1
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F52%252F4d5275842b55ae030a8dee116855102a%252Fpa%252FGF04401_4e39856e1693aa2a360c6ba45a389e38.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_4e39856e1693aa2a360c6ba45a389e38.jpg already downloaded
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F52%252F4d5275842b55ae030a8dee116855102a%252Fpa%252FGF04401_9dd9e2145efd4c3cfb14c4eb760adc3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_9dd9e2145efd4c3cfb14c4eb760adc3d.jpg already downloaded
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F52%252F4d5275842b55ae030a8dee116855102a%252Fpa%252FGF04401_1e18b2077aa0e25ac70b8ab4ed9dab83.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_1e18b2077aa0e25ac70b8ab4ed9dab83.jpg already downloaded
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F52%252F4d5275842b55ae030a8dee116855102a%252Fpa%252FGF04401_3a99a619b0539f0a5145e481b46b5259.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_3a99a619b0539f0a5145e481b46b5259.jpg already downloaded
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F52%252F4d5275842b55ae030a8dee116855102a%252Fpa%252FGF04401_fbfac208e4e6be9315c860709551166e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_fbfac208e4e6be9315c860709551166e.jpg already downloaded
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F52%252F4d5275842b55ae030a8dee116855102a%252Fpa%252FGF04401_8f420490f55be4ebfae501c03a3f1f6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_8f420490f55be4ebfae501c03a3f1f6f.jpg already downloaded
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F52%252F4d5275842b55ae030a8dee116855102a%252Fpa%252FGF04401_e6720087d3e049b7c3b430aadac32852.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_e6720087d3e049b7c3b430aadac32852.jpg already downloaded
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F52%252F4d5275842b55ae030a8dee116855102a%252Fpa%252FGF04401_fe1c81872bd0cd55c61ade38efbf62d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_fe1c81872bd0cd55c61ade38efbf62d9.jpg already downloaded
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F52%252F4d5275842b55ae030a8dee116855102a%252Fpa%252FGF04401_c7333f47a13101a154c50db6a774ea2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_c7333f47a13101a154c50db6a774ea2f.jpg already downloaded
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F52%252F4d5275842b55ae030a8dee116855102a%252Fpa%252FGF04401_98541a9b47a23bb6f83df283a7fc4f8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_98541a9b47a23bb6f83df283a7fc4f8b.jpg already downloaded
2026-03-28 12:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 920052c9-44bd-53b5-8280-f5dbba9a16e1, identifier: GF04401
2026-03-28 12:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed9d7807-f9bb-5dbe-a22a-98f72d7028c7 with identifier: RZ14942
2026-03-28 12:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed9d7807-f9bb-5dbe-a22a-98f72d7028c7 with scrape type 1
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed9d7807-f9bb-5dbe-a22a-98f72d7028c7
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_e9e027d4fa6577cad9cee9016c0f84a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_e9e027d4fa6577cad9cee9016c0f84a7.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_b12235b1e9864cb94a4e61c06a4270c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_b12235b1e9864cb94a4e61c06a4270c8.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_b77d26b533ca8a354466670d79a05592.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_b77d26b533ca8a354466670d79a05592.jpg not downloaded yet
2026-03-28 12:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 920052c9-44bd-53b5-8280-f5dbba9a16e1 with identifier: GF04401
2026-03-28 12:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 920052c9-44bd-53b5-8280-f5dbba9a16e1 with identifier: GF04401
2026-03-28 12:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 920052c9-44bd-53b5-8280-f5dbba9a16e1 with identifier: GF04401 to the API
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GF04401>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '0.9L',
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:58:54Z',
'fuel_type': 'petrol',
'id': '920052c9-44bd-53b5-8280-f5dbba9a16e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF04401',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Fiat',
'model': 'Panda',
'odometer': 112278,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_4e39856e1693aa2a360c6ba45a389e38.jpg',
'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_9dd9e2145efd4c3cfb14c4eb760adc3d.jpg',
'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_1e18b2077aa0e25ac70b8ab4ed9dab83.jpg',
'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_3a99a619b0539f0a5145e481b46b5259.jpg',
'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_fbfac208e4e6be9315c860709551166e.jpg',
'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_8f420490f55be4ebfae501c03a3f1f6f.jpg',
'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_e6720087d3e049b7c3b430aadac32852.jpg',
'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_fe1c81872bd0cd55c61ade38efbf62d9.jpg',
'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_c7333f47a13101a154c50db6a774ea2f.jpg',
'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_98541a9b47a23bb6f83df283a7fc4f8b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_920052c9-44bd-53b5-8280-f5dbba9a16e1/920052c9-44bd-53b5-8280-f5dbba9a16e1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77780,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_4e39856e1693aa2a360c6ba45a389e38.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_920052c9-44bd-53b5-8280-f5dbba9a16e1/920052c9-44bd-53b5-8280-f5dbba9a16e1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68785,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_9dd9e2145efd4c3cfb14c4eb760adc3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_920052c9-44bd-53b5-8280-f5dbba9a16e1/920052c9-44bd-53b5-8280-f5dbba9a16e1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_1e18b2077aa0e25ac70b8ab4ed9dab83.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_920052c9-44bd-53b5-8280-f5dbba9a16e1/920052c9-44bd-53b5-8280-f5dbba9a16e1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2355960,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_3a99a619b0539f0a5145e481b46b5259.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_920052c9-44bd-53b5-8280-f5dbba9a16e1/920052c9-44bd-53b5-8280-f5dbba9a16e1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2634300,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_fbfac208e4e6be9315c860709551166e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_920052c9-44bd-53b5-8280-f5dbba9a16e1/920052c9-44bd-53b5-8280-f5dbba9a16e1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_8f420490f55be4ebfae501c03a3f1f6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_920052c9-44bd-53b5-8280-f5dbba9a16e1/920052c9-44bd-53b5-8280-f5dbba9a16e1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60975,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_e6720087d3e049b7c3b430aadac32852.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_920052c9-44bd-53b5-8280-f5dbba9a16e1/920052c9-44bd-53b5-8280-f5dbba9a16e1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_fe1c81872bd0cd55c61ade38efbf62d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_920052c9-44bd-53b5-8280-f5dbba9a16e1/920052c9-44bd-53b5-8280-f5dbba9a16e1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2657947,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_c7333f47a13101a154c50db6a774ea2f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_920052c9-44bd-53b5-8280-f5dbba9a16e1/920052c9-44bd-53b5-8280-f5dbba9a16e1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/52/4d5275842b55ae030a8dee116855102a/pa/GF04401_98541a9b47a23bb6f83df283a7fc4f8b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-28',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat Panda 0.9 4x4',
'transmission': 'manual',
'trim': '4x4',
'year': 2016}
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF04401%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [auto1.it] INFO: Saving data for GF04401: {'created_time': 1774699249.945229, 'last_price_update_time': 1774699249.945238, 'auction_closing_time': 1774886334.0}
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GF04401') HTTP/1.1" 204 0
2026-03-28 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_0c90e0302905fb6dfd3b5d873bf1cf92.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_f45aba372c10acf4fe7b68fcda8f8c45.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_503981f5e04c60144be8775c297bbea5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_b48b6741ba4a968e55b7c95368c81ad1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_b48b6741ba4a968e55b7c95368c81ad1.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_64fa198504992959e315944f25f2943d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_64fa198504992959e315944f25f2943d.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3f%252F153f8479072d855d743e30316c270512%252Fpa%252FRT78827_2b1ecd900486bc26cb84861f5129ec7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_2b1ecd900486bc26cb84861f5129ec7f.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_f29c8bb57a902359ef3b470cba748e5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_f29c8bb57a902359ef3b470cba748e5f.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_84bd3d11b7d658259183e8e755fef2a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_84bd3d11b7d658259183e8e755fef2a4.jpg not downloaded yet
2026-03-28 12:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_6239b9f4e41e6f4212af50d7e45ae306.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_a44d0dfe9c3e12aa3cfc9075f6c2af6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_a44d0dfe9c3e12aa3cfc9075f6c2af6b.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_aa687c7829461d8e967b7ed8f9eb0098.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_aa687c7829461d8e967b7ed8f9eb0098.jpg not downloaded yet
2026-03-28 12:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_c48ea3043fc4c67a873727e79b457680.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_100ae47cc73817ff0cd43c80f1098c87.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_100ae47cc73817ff0cd43c80f1098c87.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3f%252F153f8479072d855d743e30316c270512%252Fpa%252FRT78827_fdec8d06f472782add4e20f9a0aefe9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_fdec8d06f472782add4e20f9a0aefe9e.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_dd18ee589c556acfe2ab55e836f5dc64.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_dd18ee589c556acfe2ab55e836f5dc64.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_cd72c1ffeeb8417e37e343f61ce22b48.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_cd72c1ffeeb8417e37e343f61ce22b48.jpg not downloaded yet
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d79f550>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dadf2e7-5a75-55cd-a568-19ae97860a47/2dadf2e7-5a75-55cd-a568-19ae97860a47_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F0f%252Faa0f583a09375dd5622c2f2e9df3b7f1%252Fpa%252FKW13943_fe3e656ea7a78ce1f240af9ca72775ae.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_fe3e656ea7a78ce1f240af9ca72775ae.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2dadf2e7-5a75-55cd-a568-19ae97860a47
2026-03-28 12:00:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f571490>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_43b9a7b8fbe48b58e635996f4c32245d.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_43b9a7b8fbe48b58e635996f4c32245d.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 154ec7f7-09d6-508b-8a44-8d6030b71dc9
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4f8dd0>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dadf2e7-5a75-55cd-a568-19ae97860a47/2dadf2e7-5a75-55cd-a568-19ae97860a47_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F0f%252Faa0f583a09375dd5622c2f2e9df3b7f1%252Fpa%252FKW13943_76dfc7d7610d89d504a079f7a0d84595.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_76dfc7d7610d89d504a079f7a0d84595.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2dadf2e7-5a75-55cd-a568-19ae97860a47
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_d3fbc8c2c7b0a1c2a351b7c21cff11fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_d3fbc8c2c7b0a1c2a351b7c21cff11fe.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_76cb98a8ce2296351c2efeaa132faf8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_76cb98a8ce2296351c2efeaa132faf8a.jpg not downloaded yet
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6c42d0>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_0c90e0302905fb6dfd3b5d873bf1cf92.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_0c90e0302905fb6dfd3b5d873bf1cf92.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 154ec7f7-09d6-508b-8a44-8d6030b71dc9
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c81d390>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_f45aba372c10acf4fe7b68fcda8f8c45.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_f45aba372c10acf4fe7b68fcda8f8c45.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4e98a58-475d-538f-938e-ff24bc88082c
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c81f810>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dadf2e7-5a75-55cd-a568-19ae97860a47/2dadf2e7-5a75-55cd-a568-19ae97860a47_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F0f%252Faa0f583a09375dd5622c2f2e9df3b7f1%252Fpa%252FKW13943_503981f5e04c60144be8775c297bbea5.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_503981f5e04c60144be8775c297bbea5.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2dadf2e7-5a75-55cd-a568-19ae97860a47
2026-03-28 12:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_60ddb89c046a0113a74ed5b4bc2ba9e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_9c6e97b7f86af9b078624b665f5fb5a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_5a1d5617ad1c84e084e104ba2ffb34c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_5a1d5617ad1c84e084e104ba2ffb34c5.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3f%252F153f8479072d855d743e30316c270512%252Fpa%252FRT78827_4d75aedef7fac34c368588b40b2a69a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_4d75aedef7fac34c368588b40b2a69a9.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_5875e789a946364b0d7ab03ca4c1dd1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_5875e789a946364b0d7ab03ca4c1dd1c.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_96949616b7e97710311cd5c16cdd9e92.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_96949616b7e97710311cd5c16cdd9e92.jpg not downloaded yet
2026-03-28 12:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_08e8651e7e9fde88f3b911e31aeef428.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_a9c6169c7cc92aae1721898ef7cc4a37.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_a9c6169c7cc92aae1721898ef7cc4a37.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_f3ddc144316e23dd351198a385c2880f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_f3ddc144316e23dd351198a385c2880f.jpg not downloaded yet
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d559310>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_6239b9f4e41e6f4212af50d7e45ae306.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_6239b9f4e41e6f4212af50d7e45ae306.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 154ec7f7-09d6-508b-8a44-8d6030b71dc9
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6e3710>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dadf2e7-5a75-55cd-a568-19ae97860a47/2dadf2e7-5a75-55cd-a568-19ae97860a47_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F0f%252Faa0f583a09375dd5622c2f2e9df3b7f1%252Fpa%252FKW13943_c48ea3043fc4c67a873727e79b457680.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_c48ea3043fc4c67a873727e79b457680.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2dadf2e7-5a75-55cd-a568-19ae97860a47
2026-03-28 12:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_4574c669b504e41c5225d2a0b68d96fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_dd9e2071649aa4926f13ca2a6340aa00.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_dd9e2071649aa4926f13ca2a6340aa00.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3f%252F153f8479072d855d743e30316c270512%252Fpa%252FRT78827_84f19c24f6b2caf08918ca673d057362.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_84f19c24f6b2caf08918ca673d057362.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_1a37df1fe0db17fb6c04091732d5e15b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_1a37df1fe0db17fb6c04091732d5e15b.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_c50fb8348dbbc9862f93ba740533266b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_c50fb8348dbbc9862f93ba740533266b.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_f1c421d337c7e212342553154e6ff3e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_f1c421d337c7e212342553154e6ff3e2.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_7e8c9c649a5754562aba6a7328516414.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_7e8c9c649a5754562aba6a7328516414.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_9c443bd5f9914430e995fda3298411b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_9c443bd5f9914430e995fda3298411b4.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_ed07159c6a34a682047eac3499d7f655.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_ed07159c6a34a682047eac3499d7f655.jpg not downloaded yet
2026-03-28 12:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB77964> (referer: https://www.auto1.com/v1/car-details-view/PB77964/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca06610>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_60ddb89c046a0113a74ed5b4bc2ba9e7.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_60ddb89c046a0113a74ed5b4bc2ba9e7.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 154ec7f7-09d6-508b-8a44-8d6030b71dc9
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d65f0d0>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_9c6e97b7f86af9b078624b665f5fb5a0.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_9c6e97b7f86af9b078624b665f5fb5a0.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4e98a58-475d-538f-938e-ff24bc88082c
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb5b750>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_08e8651e7e9fde88f3b911e31aeef428.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_08e8651e7e9fde88f3b911e31aeef428.jpg saved to cache
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6dd67a57-127c-521b-8014-e98e5957b61b
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_41414c5b859fba21baffdbe054ded9a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_41414c5b859fba21baffdbe054ded9a1.jpg not downloaded yet
2026-03-28 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_d3fbc8c2c7b0a1c2a351b7c21cff11fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_a69cb1041ab8ababefac1a6c22e1b704.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_a69cb1041ab8ababefac1a6c22e1b704.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_f038dc26e28c9d7054ad953399a067ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_f038dc26e28c9d7054ad953399a067ff.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_89ba0ad66f30d3f5150425f7e2e46eb0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_89ba0ad66f30d3f5150425f7e2e46eb0.jpg not downloaded yet
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7f7890>
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f170aece-4cfc-5491-87f1-8a7f088d1a9d/f170aece-4cfc-5491-87f1-8a7f088d1a9d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3f%252F153f8479072d855d743e30316c270512%252Fpa%252FRT78827_4574c669b504e41c5225d2a0b68d96fa.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_4574c669b504e41c5225d2a0b68d96fa.jpg saved to cache
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f170aece-4cfc-5491-87f1-8a7f088d1a9d
2026-03-28 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_b77d26b533ca8a354466670d79a05592.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_76cb98a8ce2296351c2efeaa132faf8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_bfa8f119a2f0bdad8cd8eebe1d2f1247.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_bfa8f119a2f0bdad8cd8eebe1d2f1247.jpg not downloaded yet
2026-03-28 12:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22d0c89b-198a-59f9-99ec-c2dd1465dab9 with identifier: PB77964
2026-03-28 12:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22d0c89b-198a-59f9-99ec-c2dd1465dab9 with scrape type 1
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 22d0c89b-198a-59f9-99ec-c2dd1465dab9
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F54%252F2554b78c8003bf488a04e77323ce3338%252Fpa%252FPB77964_cd7919a8e852fca15b0e0fb3e69c4150.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_cd7919a8e852fca15b0e0fb3e69c4150.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_656319d7756352b905e54c8742ce3477.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_656319d7756352b905e54c8742ce3477.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_debde9675e07a37cc76e45e2222fdbaf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_debde9675e07a37cc76e45e2222fdbaf.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_ed03ffc3dc1ee8ce48da5fcb03313b07.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_ed03ffc3dc1ee8ce48da5fcb03313b07.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F54%252F2554b78c8003bf488a04e77323ce3338%252Fpa%252FPB77964_1eef3f02d0020b6928cee94fb3da2cb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_1eef3f02d0020b6928cee94fb3da2cb7.jpg not downloaded yet
2026-03-28 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE64067/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7f6d90>
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_d3fbc8c2c7b0a1c2a351b7c21cff11fe.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_d3fbc8c2c7b0a1c2a351b7c21cff11fe.jpg saved to cache
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f36a363d-16e8-55e1-9438-200bfc854b53
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_5554123385052135250c89fcd6c1783a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_5554123385052135250c89fcd6c1783a.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_10835ccdb49c217d832c1300d1fb0067.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_10835ccdb49c217d832c1300d1fb0067.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_38bf053982c855acc92734b5e2e481f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_38bf053982c855acc92734b5e2e481f7.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F54%252F2554b78c8003bf488a04e77323ce3338%252Fpa%252FPB77964_5918e3e1c0008f524e649bc70aebad27.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_5918e3e1c0008f524e649bc70aebad27.jpg not downloaded yet
2026-03-28 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_96949616b7e97710311cd5c16cdd9e92.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_f1c421d337c7e212342553154e6ff3e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_0d66a739e1045005ed8f10d2e0f353a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_0d66a739e1045005ed8f10d2e0f353a4.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_3d38e851e97e069a559f53f706762835.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_3d38e851e97e069a559f53f706762835.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_aaa58b8ed6770819fd5fb1ed9e7845cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_aaa58b8ed6770819fd5fb1ed9e7845cb.jpg not downloaded yet
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c847690>
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_b77d26b533ca8a354466670d79a05592.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_b77d26b533ca8a354466670d79a05592.jpg saved to cache
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4e98a58-475d-538f-938e-ff24bc88082c
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d68a810>
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_76cb98a8ce2296351c2efeaa132faf8a.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_76cb98a8ce2296351c2efeaa132faf8a.jpg saved to cache
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4e98a58-475d-538f-938e-ff24bc88082c
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F54%252F2554b78c8003bf488a04e77323ce3338%252Fpa%252FPB77964_b2f11b3dc8e9096333d3967861bd635c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_b2f11b3dc8e9096333d3967861bd635c.jpg not downloaded yet
2026-03-28 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB75356/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA70865> (referer: https://www.auto1.com/v1/car-details-view/WA70865/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_94b8e9a318a6bcabde72cb285623494d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F54%252F2554b78c8003bf488a04e77323ce3338%252Fpa%252FPB77964_b7c89c36e5096e72cd7025f2dea68112.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_b7c89c36e5096e72cd7025f2dea68112.jpg not downloaded yet
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb6e590>
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_96949616b7e97710311cd5c16cdd9e92.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_96949616b7e97710311cd5c16cdd9e92.jpg saved to cache
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed9d7807-f9bb-5dbe-a22a-98f72d7028c7
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3fa47d50>
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_f1c421d337c7e212342553154e6ff3e2.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_f1c421d337c7e212342553154e6ff3e2.jpg saved to cache
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4e98a58-475d-538f-938e-ff24bc88082c
2026-03-28 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RB44165> (referer: https://www.auto1.com/v1/car-details-view/RB44165/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa401efd-dc2b-5988-979c-e6a31b6195fb with identifier: WA70865
2026-03-28 12:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa401efd-dc2b-5988-979c-e6a31b6195fb with scrape type 1
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa401efd-dc2b-5988-979c-e6a31b6195fb
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_bf56255b0112d98806beb9f52d1f7cc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_bf56255b0112d98806beb9f52d1f7cc1.jpg not downloaded yet
2026-03-28 12:00:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cc11a10>
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_94b8e9a318a6bcabde72cb285623494d.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_94b8e9a318a6bcabde72cb285623494d.jpg saved to cache
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 453f202c-8f5b-5971-b8cd-72c41834e578
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_1c685722490d9bc2df80911c4aaf169f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_1c685722490d9bc2df80911c4aaf169f.jpg not downloaded yet
2026-03-28 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_41414c5b859fba21baffdbe054ded9a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_ed07159c6a34a682047eac3499d7f655.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_8fb963b2bf39948f71a00178a2e89178.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_8fb963b2bf39948f71a00178a2e89178.jpg not downloaded yet
2026-03-28 12:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adb99871-4687-5a40-a7ef-6077d46438d6 with identifier: RB44165
2026-03-28 12:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adb99871-4687-5a40-a7ef-6077d46438d6 with scrape type 1
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item adb99871-4687-5a40-a7ef-6077d46438d6
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_8ff02250c7cf06e957b60dbc068c1e79.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_8ff02250c7cf06e957b60dbc068c1e79.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_10cdc49dcceb9290d064da751dd38dc4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_10cdc49dcceb9290d064da751dd38dc4.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_e6f96ee58ed9aed8a480716a19d3b90c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_e6f96ee58ed9aed8a480716a19d3b90c.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_2600390f257a10237e34e787049704bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_2600390f257a10237e34e787049704bb.jpg not downloaded yet
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_6fd63d461bb7435b14a4945c020a5024.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_6fd63d461bb7435b14a4945c020a5024.jpg not downloaded yet
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_271697a343f7d011a0907e6d406ee919.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_271697a343f7d011a0907e6d406ee919.jpg not downloaded yet
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_721ec9b4840f43d9d2ca23ce7d0509c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_721ec9b4840f43d9d2ca23ce7d0509c9.jpg not downloaded yet
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6cb790>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_41414c5b859fba21baffdbe054ded9a1.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_41414c5b859fba21baffdbe054ded9a1.jpg saved to cache
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4e98a58-475d-538f-938e-ff24bc88082c
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca80610>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_ed07159c6a34a682047eac3499d7f655.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_ed07159c6a34a682047eac3499d7f655.jpg saved to cache
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed9d7807-f9bb-5dbe-a22a-98f72d7028c7
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_dc6d83c9364f45633e4d21bf52d251eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_dc6d83c9364f45633e4d21bf52d251eb.jpg not downloaded yet
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_38bf053982c855acc92734b5e2e481f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_ed03ffc3dc1ee8ce48da5fcb03313b07.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_a0a7b1e057281acf2dba178caf98dc3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_a0a7b1e057281acf2dba178caf98dc3d.jpg not downloaded yet
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_0ec96036f13a15fc201cabbf7e9da7aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_0ec96036f13a15fc201cabbf7e9da7aa.jpg not downloaded yet
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_e9e027d4fa6577cad9cee9016c0f84a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_7f58a0269fdcf0d99957d5f1f81ada6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_7f58a0269fdcf0d99957d5f1f81ada6c.jpg not downloaded yet
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_977e48239d939d7d54032931627831ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_977e48239d939d7d54032931627831ae.jpg not downloaded yet
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_a6cce923bec583489673aadab6997a64.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_a6cce923bec583489673aadab6997a64.jpg not downloaded yet
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_ca0f851fad480f8b15aa39939a01a95c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_ca0f851fad480f8b15aa39939a01a95c.jpg not downloaded yet
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_2d587771a4234860bb68bff1f29377fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_2d587771a4234860bb68bff1f29377fc.jpg not downloaded yet
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_84bd3d11b7d658259183e8e755fef2a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_40b6cb6de57ddd05dc04de9faf6b918d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_40b6cb6de57ddd05dc04de9faf6b918d.jpg not downloaded yet
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7f4a50>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_38bf053982c855acc92734b5e2e481f7.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_38bf053982c855acc92734b5e2e481f7.jpg saved to cache
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed9d7807-f9bb-5dbe-a22a-98f72d7028c7
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca45590>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_ed03ffc3dc1ee8ce48da5fcb03313b07.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_ed03ffc3dc1ee8ce48da5fcb03313b07.jpg saved to cache
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed9d7807-f9bb-5dbe-a22a-98f72d7028c7
2026-03-28 12:00:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d65fa90>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_e9e027d4fa6577cad9cee9016c0f84a7.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_e9e027d4fa6577cad9cee9016c0f84a7.jpg saved to cache
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed9d7807-f9bb-5dbe-a22a-98f72d7028c7
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_986aed69603804eb3630c309ecbbd356.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_986aed69603804eb3630c309ecbbd356.jpg not downloaded yet
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_b2f11b3dc8e9096333d3967861bd635c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_10835ccdb49c217d832c1300d1fb0067.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_eede851eb01b3bff000482179cec94b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7a66d0>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_84bd3d11b7d658259183e8e755fef2a4.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_84bd3d11b7d658259183e8e755fef2a4.jpg saved to cache
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed9d7807-f9bb-5dbe-a22a-98f72d7028c7
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_95fcc52a36fd7f86da0b7ea7e605b90f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_cd72c1ffeeb8417e37e343f61ce22b48.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6c9d10>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d0c89b-198a-59f9-99ec-c2dd1465dab9/22d0c89b-198a-59f9-99ec-c2dd1465dab9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F54%252F2554b78c8003bf488a04e77323ce3338%252Fpa%252FPB77964_b2f11b3dc8e9096333d3967861bd635c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_b2f11b3dc8e9096333d3967861bd635c.jpg saved to cache
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22d0c89b-198a-59f9-99ec-c2dd1465dab9
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb47350>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_10835ccdb49c217d832c1300d1fb0067.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_10835ccdb49c217d832c1300d1fb0067.jpg saved to cache
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6dd67a57-127c-521b-8014-e98e5957b61b
2026-03-28 12:00:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c835150>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_eede851eb01b3bff000482179cec94b2.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_eede851eb01b3bff000482179cec94b2.jpg saved to cache
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f36a363d-16e8-55e1-9438-200bfc854b53
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_bf56255b0112d98806beb9f52d1f7cc1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_9c443bd5f9914430e995fda3298411b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_271697a343f7d011a0907e6d406ee919.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5bf7d0>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_95fcc52a36fd7f86da0b7ea7e605b90f.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_95fcc52a36fd7f86da0b7ea7e605b90f.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f36a363d-16e8-55e1-9438-200bfc854b53
2026-03-28 12:00:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca230d0>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_cd72c1ffeeb8417e37e343f61ce22b48.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_cd72c1ffeeb8417e37e343f61ce22b48.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed9d7807-f9bb-5dbe-a22a-98f72d7028c7
2026-03-28 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_0ec96036f13a15fc201cabbf7e9da7aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_721ec9b4840f43d9d2ca23ce7d0509c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE64067> (referer: https://www.auto1.com/v1/car-details-view/RE64067/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB75356> (referer: https://www.auto1.com/v1/car-details-view/ZB75356/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca83290>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_bf56255b0112d98806beb9f52d1f7cc1.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_bf56255b0112d98806beb9f52d1f7cc1.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa401efd-dc2b-5988-979c-e6a31b6195fb
2026-03-28 12:00:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca73310>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_9c443bd5f9914430e995fda3298411b4.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_9c443bd5f9914430e995fda3298411b4.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6dd67a57-127c-521b-8014-e98e5957b61b
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca823d0>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_271697a343f7d011a0907e6d406ee919.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_271697a343f7d011a0907e6d406ee919.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa401efd-dc2b-5988-979c-e6a31b6195fb
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4fb3d0>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_0ec96036f13a15fc201cabbf7e9da7aa.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_0ec96036f13a15fc201cabbf7e9da7aa.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa401efd-dc2b-5988-979c-e6a31b6195fb
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d571490>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_721ec9b4840f43d9d2ca23ce7d0509c9.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_721ec9b4840f43d9d2ca23ce7d0509c9.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item adb99871-4687-5a40-a7ef-6077d46438d6
2026-03-28 12:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f59a852d-75b6-5a99-b52c-3f588cb5c5c6 with identifier: RE64067
2026-03-28 12:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59a852d-75b6-5a99-b52c-3f588cb5c5c6 with scrape type 1
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f59a852d-75b6-5a99-b52c-3f588cb5c5c6
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Feb%252F00eb71600f18906cfbca281d64a41366%252Fpa%252FRE64067_35d121cd75ebe08ad0c25547d3bcf39c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_35d121cd75ebe08ad0c25547d3bcf39c.jpg already downloaded
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Feb%252F00eb71600f18906cfbca281d64a41366%252Fpa%252FRE64067_b6fe3662072533876db619305459e5db.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_b6fe3662072533876db619305459e5db.jpg already downloaded
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Feb%252F00eb71600f18906cfbca281d64a41366%252Fpa%252FRE64067_b47a11c4b2d0478014778b6d8049beb0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_b47a11c4b2d0478014778b6d8049beb0.jpg already downloaded
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Feb%252F00eb71600f18906cfbca281d64a41366%252Fpa%252FRE64067_f3c48d593d780d000ff4535064bf1b97.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_f3c48d593d780d000ff4535064bf1b97.jpg already downloaded
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Feb%252F00eb71600f18906cfbca281d64a41366%252Fpa%252FRE64067_b2b19ae98817bd5f9db0529bb38978c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_b2b19ae98817bd5f9db0529bb38978c0.jpg already downloaded
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Feb%252F00eb71600f18906cfbca281d64a41366%252Fpa%252FRE64067_e89a54f8ccb492a7aa83d6db0360e035.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_e89a54f8ccb492a7aa83d6db0360e035.jpg already downloaded
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Feb%252F00eb71600f18906cfbca281d64a41366%252Fpa%252FRE64067_371eba5a44fbb68dceaa8533ae62cd62.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_371eba5a44fbb68dceaa8533ae62cd62.jpg already downloaded
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Feb%252F00eb71600f18906cfbca281d64a41366%252Fpa%252FRE64067_aadc0270354f8b9a53dccaa4aeca4712.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_aadc0270354f8b9a53dccaa4aeca4712.jpg already downloaded
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Feb%252F00eb71600f18906cfbca281d64a41366%252Fpa%252FRE64067_53bc51992413185caf5916de4ffedd64.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_53bc51992413185caf5916de4ffedd64.jpg already downloaded
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Feb%252F00eb71600f18906cfbca281d64a41366%252Fpa%252FRE64067_b86aeaf2f7979859e21a062588592f52.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_b86aeaf2f7979859e21a062588592f52.jpg already downloaded
2026-03-28 12:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f59a852d-75b6-5a99-b52c-3f588cb5c5c6, identifier: RE64067
2026-03-28 12:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6501c20-9e7c-500a-8873-823fe95fda05 with identifier: ZB75356
2026-03-28 12:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6501c20-9e7c-500a-8873-823fe95fda05 with scrape type 1
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6501c20-9e7c-500a-8873-823fe95fda05
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_119608546c298b75ef60d0ba5de430d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_119608546c298b75ef60d0ba5de430d0.jpg not downloaded yet
2026-03-28 12:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f59a852d-75b6-5a99-b52c-3f588cb5c5c6 with identifier: RE64067
2026-03-28 12:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f59a852d-75b6-5a99-b52c-3f588cb5c5c6 with identifier: RE64067
2026-03-28 12:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f59a852d-75b6-5a99-b52c-3f588cb5c5c6 with identifier: RE64067 to the API
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RE64067>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:39:12Z',
'fuel_type': 'hybrid',
'id': 'f59a852d-75b6-5a99-b52c-3f588cb5c5c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE64067',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 57110,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_35d121cd75ebe08ad0c25547d3bcf39c.jpg',
'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_b6fe3662072533876db619305459e5db.jpg',
'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_b47a11c4b2d0478014778b6d8049beb0.jpg',
'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_f3c48d593d780d000ff4535064bf1b97.jpg',
'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_b2b19ae98817bd5f9db0529bb38978c0.jpg',
'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_e89a54f8ccb492a7aa83d6db0360e035.jpg',
'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_371eba5a44fbb68dceaa8533ae62cd62.jpg',
'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_aadc0270354f8b9a53dccaa4aeca4712.jpg',
'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_53bc51992413185caf5916de4ffedd64.jpg',
'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_b86aeaf2f7979859e21a062588592f52.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a852d-75b6-5a99-b52c-3f588cb5c5c6/f59a852d-75b6-5a99-b52c-3f588cb5c5c6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_35d121cd75ebe08ad0c25547d3bcf39c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a852d-75b6-5a99-b52c-3f588cb5c5c6/f59a852d-75b6-5a99-b52c-3f588cb5c5c6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68332,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_b6fe3662072533876db619305459e5db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a852d-75b6-5a99-b52c-3f588cb5c5c6/f59a852d-75b6-5a99-b52c-3f588cb5c5c6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_b47a11c4b2d0478014778b6d8049beb0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a852d-75b6-5a99-b52c-3f588cb5c5c6/f59a852d-75b6-5a99-b52c-3f588cb5c5c6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53772,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_f3c48d593d780d000ff4535064bf1b97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a852d-75b6-5a99-b52c-3f588cb5c5c6/f59a852d-75b6-5a99-b52c-3f588cb5c5c6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_b2b19ae98817bd5f9db0529bb38978c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a852d-75b6-5a99-b52c-3f588cb5c5c6/f59a852d-75b6-5a99-b52c-3f588cb5c5c6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_e89a54f8ccb492a7aa83d6db0360e035.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a852d-75b6-5a99-b52c-3f588cb5c5c6/f59a852d-75b6-5a99-b52c-3f588cb5c5c6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52268,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_371eba5a44fbb68dceaa8533ae62cd62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a852d-75b6-5a99-b52c-3f588cb5c5c6/f59a852d-75b6-5a99-b52c-3f588cb5c5c6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92613,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_aadc0270354f8b9a53dccaa4aeca4712.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a852d-75b6-5a99-b52c-3f588cb5c5c6/f59a852d-75b6-5a99-b52c-3f588cb5c5c6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68879,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_53bc51992413185caf5916de4ffedd64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a852d-75b6-5a99-b52c-3f588cb5c5c6/f59a852d-75b6-5a99-b52c-3f588cb5c5c6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64371,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/eb/00eb71600f18906cfbca281d64a41366/pa/RE64067_b86aeaf2f7979859e21a062588592f52.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Adventure',
'transmission': 'automatic',
'trim': '2WD Adventure',
'year': 2023}
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE64067%27 HTTP/1.1" 200 None
2026-03-28 12:00:54 [auto1.it] INFO: Saving data for RE64067: {'created_time': 1774699254.433116, 'last_price_update_time': 1774699254.433127, 'auction_closing_time': 1774885152.0}
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RE64067') HTTP/1.1" 204 0
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_772ee3d151f66b5aba6228e9a046a5e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_772ee3d151f66b5aba6228e9a046a5e4.jpg not downloaded yet
2026-03-28 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_a6cce923bec583489673aadab6997a64.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_977e48239d939d7d54032931627831ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_986aed69603804eb3630c309ecbbd356.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_2d587771a4234860bb68bff1f29377fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_3cfd7c6f5e7a3bad437e359ec3069b43.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_3cfd7c6f5e7a3bad437e359ec3069b43.jpg not downloaded yet
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_15f5bc66011b6d6341f01dc5c6c1ddcc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_15f5bc66011b6d6341f01dc5c6c1ddcc.jpg not downloaded yet
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_769380fac77c35ef8c11a8e827de2504.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_769380fac77c35ef8c11a8e827de2504.jpg not downloaded yet
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_24dc841e780812b13561dcbc0fa8aa22.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_24dc841e780812b13561dcbc0fa8aa22.jpg not downloaded yet
2026-03-28 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_3d38e851e97e069a559f53f706762835.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_aaa58b8ed6770819fd5fb1ed9e7845cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_df7fa08f4ef6711799c82e1d49883fbe.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_df7fa08f4ef6711799c82e1d49883fbe.jpg not downloaded yet
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_7c17e4c18b600cb1d5946deff72b76bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_7c17e4c18b600cb1d5946deff72b76bc.jpg not downloaded yet
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cc066d0>
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_a6cce923bec583489673aadab6997a64.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_a6cce923bec583489673aadab6997a64.jpg saved to cache
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item adb99871-4687-5a40-a7ef-6077d46438d6
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c9af250>
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_977e48239d939d7d54032931627831ae.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_977e48239d939d7d54032931627831ae.jpg saved to cache
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa401efd-dc2b-5988-979c-e6a31b6195fb
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbd7090>
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_986aed69603804eb3630c309ecbbd356.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_986aed69603804eb3630c309ecbbd356.jpg saved to cache
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item adb99871-4687-5a40-a7ef-6077d46438d6
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d65dcd0>
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_2d587771a4234860bb68bff1f29377fc.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_2d587771a4234860bb68bff1f29377fc.jpg saved to cache
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item adb99871-4687-5a40-a7ef-6077d46438d6
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_e1d74883b326e4b23ffd5b889614026e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_e1d74883b326e4b23ffd5b889614026e.jpg not downloaded yet
2026-03-28 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_a0a7b1e057281acf2dba178caf98dc3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_dc6d83c9364f45633e4d21bf52d251eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_7f58a0269fdcf0d99957d5f1f81ada6c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_6fd63d461bb7435b14a4945c020a5024.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_5bbf54604ce1b47d409356003db030e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_5bbf54604ce1b47d409356003db030e2.jpg not downloaded yet
2026-03-28 12:00:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c978fd0>
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_3d38e851e97e069a559f53f706762835.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_3d38e851e97e069a559f53f706762835.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6dd67a57-127c-521b-8014-e98e5957b61b
2026-03-28 12:00:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbc32d0>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_aaa58b8ed6770819fd5fb1ed9e7845cb.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_aaa58b8ed6770819fd5fb1ed9e7845cb.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed9d7807-f9bb-5dbe-a22a-98f72d7028c7
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_10cdc49dcceb9290d064da751dd38dc4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_8ff02250c7cf06e957b60dbc068c1e79.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_8fb963b2bf39948f71a00178a2e89178.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_119608546c298b75ef60d0ba5de430d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d635d90>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_a0a7b1e057281acf2dba178caf98dc3d.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_a0a7b1e057281acf2dba178caf98dc3d.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item adb99871-4687-5a40-a7ef-6077d46438d6
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d68b150>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_dc6d83c9364f45633e4d21bf52d251eb.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_dc6d83c9364f45633e4d21bf52d251eb.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa401efd-dc2b-5988-979c-e6a31b6195fb
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4a9810>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_7f58a0269fdcf0d99957d5f1f81ada6c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_7f58a0269fdcf0d99957d5f1f81ada6c.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item adb99871-4687-5a40-a7ef-6077d46438d6
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c840c10>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_6fd63d461bb7435b14a4945c020a5024.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_6fd63d461bb7435b14a4945c020a5024.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item adb99871-4687-5a40-a7ef-6077d46438d6
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4decd0>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_10cdc49dcceb9290d064da751dd38dc4.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_10cdc49dcceb9290d064da751dd38dc4.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa401efd-dc2b-5988-979c-e6a31b6195fb
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6ca450>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_8ff02250c7cf06e957b60dbc068c1e79.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_8ff02250c7cf06e957b60dbc068c1e79.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item adb99871-4687-5a40-a7ef-6077d46438d6
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb2bfd0>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_8fb963b2bf39948f71a00178a2e89178.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_8fb963b2bf39948f71a00178a2e89178.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa401efd-dc2b-5988-979c-e6a31b6195fb
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7a5d10>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_119608546c298b75ef60d0ba5de430d0.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_119608546c298b75ef60d0ba5de430d0.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6501c20-9e7c-500a-8873-823fe95fda05
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_ca0f851fad480f8b15aa39939a01a95c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_e1d74883b326e4b23ffd5b889614026e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_769380fac77c35ef8c11a8e827de2504.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_40b6cb6de57ddd05dc04de9faf6b918d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_2600390f257a10237e34e787049704bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_e6f96ee58ed9aed8a480716a19d3b90c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_24dc841e780812b13561dcbc0fa8aa22.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_1c685722490d9bc2df80911c4aaf169f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_3cfd7c6f5e7a3bad437e359ec3069b43.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb47e50>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_ca0f851fad480f8b15aa39939a01a95c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_ca0f851fad480f8b15aa39939a01a95c.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa401efd-dc2b-5988-979c-e6a31b6195fb
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_15f5bc66011b6d6341f01dc5c6c1ddcc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_0d66a739e1045005ed8f10d2e0f353a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb97290>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_e1d74883b326e4b23ffd5b889614026e.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_e1d74883b326e4b23ffd5b889614026e.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6501c20-9e7c-500a-8873-823fe95fda05
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb09810>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_769380fac77c35ef8c11a8e827de2504.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_769380fac77c35ef8c11a8e827de2504.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6501c20-9e7c-500a-8873-823fe95fda05
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_5918e3e1c0008f524e649bc70aebad27.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_df7fa08f4ef6711799c82e1d49883fbe.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_b7c89c36e5096e72cd7025f2dea68112.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f71add0>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_40b6cb6de57ddd05dc04de9faf6b918d.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_40b6cb6de57ddd05dc04de9faf6b918d.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item adb99871-4687-5a40-a7ef-6077d46438d6
2026-03-28 12:00:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb81c50>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_2600390f257a10237e34e787049704bb.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_2600390f257a10237e34e787049704bb.jpg saved to cache
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa401efd-dc2b-5988-979c-e6a31b6195fb
2026-03-28 12:00:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cabc750>
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3a%252F0b3aec258ed896bfab0871b9b16183fb%252Fpa%252FRB44165_e6f96ee58ed9aed8a480716a19d3b90c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_e6f96ee58ed9aed8a480716a19d3b90c.jpg saved to cache
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item adb99871-4687-5a40-a7ef-6077d46438d6
2026-03-28 12:00:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: adb99871-4687-5a40-a7ef-6077d46438d6, skipping ID generation
2026-03-28 12:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adb99871-4687-5a40-a7ef-6077d46438d6 with scrape type 1
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item adb99871-4687-5a40-a7ef-6077d46438d6 sending to next pipeline
2026-03-28 12:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: adb99871-4687-5a40-a7ef-6077d46438d6, identifier: RB44165
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f592750>
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_24dc841e780812b13561dcbc0fa8aa22.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_24dc841e780812b13561dcbc0fa8aa22.jpg saved to cache
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6501c20-9e7c-500a-8873-823fe95fda05
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c8404d0>
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F99%252Fcd991cd89e13eb84a2771f2186a12f46%252Fpa%252FWA70865_1c685722490d9bc2df80911c4aaf169f.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_1c685722490d9bc2df80911c4aaf169f.jpg saved to cache
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa401efd-dc2b-5988-979c-e6a31b6195fb
2026-03-28 12:00:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa401efd-dc2b-5988-979c-e6a31b6195fb, skipping ID generation
2026-03-28 12:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa401efd-dc2b-5988-979c-e6a31b6195fb with scrape type 1
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa401efd-dc2b-5988-979c-e6a31b6195fb sending to next pipeline
2026-03-28 12:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aa401efd-dc2b-5988-979c-e6a31b6195fb, identifier: WA70865
2026-03-28 12:00:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4ab790>
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_3cfd7c6f5e7a3bad437e359ec3069b43.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_3cfd7c6f5e7a3bad437e359ec3069b43.jpg saved to cache
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6501c20-9e7c-500a-8873-823fe95fda05
2026-03-28 12:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: adb99871-4687-5a40-a7ef-6077d46438d6 with identifier: RB44165
2026-03-28 12:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: adb99871-4687-5a40-a7ef-6077d46438d6 with identifier: RB44165
2026-03-28 12:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: adb99871-4687-5a40-a7ef-6077d46438d6 with identifier: RB44165 to the API
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_e6f96ee58ed9aed8a480716a19d3b90c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.0L',
'engine_horse_power': 67,
'expiration_date': '2026-03-30T15:34:27Z',
'fuel_type': 'petrol',
'id': 'adb99871-4687-5a40-a7ef-6077d46438d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB44165',
'listing': 'auction',
'location': 'IT, San Giuliano Milanese',
'make': 'Hyundai',
'model': 'i10',
'odometer': 124498,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_8ff02250c7cf06e957b60dbc068c1e79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3079621,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_e6f96ee58ed9aed8a480716a19d3b90c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82904,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_6fd63d461bb7435b14a4945c020a5024.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67959,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_721ec9b4840f43d9d2ca23ce7d0509c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_a0a7b1e057281acf2dba178caf98dc3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94597,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_7f58a0269fdcf0d99957d5f1f81ada6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_a6cce923bec583489673aadab6997a64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88995,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_2d587771a4234860bb68bff1f29377fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3016631,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_40b6cb6de57ddd05dc04de9faf6b918d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb99871-4687-5a40-a7ef-6077d46438d6/adb99871-4687-5a40-a7ef-6077d46438d6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77434,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/3a/0b3aec258ed896bfab0871b9b16183fb/pa/RB44165_986aed69603804eb3630c309ecbbd356.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai i10 1.0 Tech',
'transmission': 'manual',
'trim': 'Tech',
'year': 2018}
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB44165%27 HTTP/1.1" 200 None
2026-03-28 12:00:57 [auto1.it] INFO: Saving data for RB44165: {'created_time': 1774699257.042953, 'last_price_update_time': 1774699257.042963, 'auction_closing_time': 1774884867.0}
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RB44165') HTTP/1.1" 204 0
2026-03-28 12:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aa401efd-dc2b-5988-979c-e6a31b6195fb with identifier: WA70865
2026-03-28 12:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aa401efd-dc2b-5988-979c-e6a31b6195fb with identifier: WA70865
2026-03-28 12:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aa401efd-dc2b-5988-979c-e6a31b6195fb with identifier: WA70865 to the API
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_1c685722490d9bc2df80911c4aaf169f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:10:20Z',
'fuel_type': 'petrol',
'id': 'aa401efd-dc2b-5988-979c-e6a31b6195fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA70865',
'listing': 'auction',
'location': 'IT, Bologna',
'make': 'Ford',
'model': 'EcoSport',
'odometer': 29605,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79068,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_bf56255b0112d98806beb9f52d1f7cc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73053,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_1c685722490d9bc2df80911c4aaf169f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_8fb963b2bf39948f71a00178a2e89178.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56087,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_10cdc49dcceb9290d064da751dd38dc4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2366771,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_2600390f257a10237e34e787049704bb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_271697a343f7d011a0907e6d406ee919.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_dc6d83c9364f45633e4d21bf52d251eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79555,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_0ec96036f13a15fc201cabbf7e9da7aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_977e48239d939d7d54032931627831ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa401efd-dc2b-5988-979c-e6a31b6195fb/aa401efd-dc2b-5988-979c-e6a31b6195fb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2856716,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/99/cd991cd89e13eb84a2771f2186a12f46/pa/WA70865_ca0f851fad480f8b15aa39939a01a95c.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-14',
'seats_number': 5,
'seller_name': None,
'title': 'Ford EcoSport 1.0 EcoBoost Plus',
'transmission': 'manual',
'trim': 'Plus',
'year': 2018}
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA70865%27 HTTP/1.1" 200 None
2026-03-28 12:00:57 [auto1.it] INFO: Saving data for WA70865: {'created_time': 1774699257.449384, 'last_price_update_time': 1774699257.449395, 'auction_closing_time': 1774883420.0}
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WA70865') HTTP/1.1" 204 0
2026-03-28 12:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_5554123385052135250c89fcd6c1783a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d65c2d0>
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_15f5bc66011b6d6341f01dc5c6c1ddcc.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_15f5bc66011b6d6341f01dc5c6c1ddcc.jpg saved to cache
2026-03-28 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6501c20-9e7c-500a-8873-823fe95fda05
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d43abd0>
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_0d66a739e1045005ed8f10d2e0f353a4.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_0d66a739e1045005ed8f10d2e0f353a4.jpg saved to cache
2026-03-28 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 803d0771-4d91-5995-922f-1f077c458772
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cabcf50>
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d0c89b-198a-59f9-99ec-c2dd1465dab9/22d0c89b-198a-59f9-99ec-c2dd1465dab9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F54%252F2554b78c8003bf488a04e77323ce3338%252Fpa%252FPB77964_5918e3e1c0008f524e649bc70aebad27.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_5918e3e1c0008f524e649bc70aebad27.jpg saved to cache
2026-03-28 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22d0c89b-198a-59f9-99ec-c2dd1465dab9
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d43b3d0>
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_df7fa08f4ef6711799c82e1d49883fbe.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_df7fa08f4ef6711799c82e1d49883fbe.jpg saved to cache
2026-03-28 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6501c20-9e7c-500a-8873-823fe95fda05
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c837a10>
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d0c89b-198a-59f9-99ec-c2dd1465dab9/22d0c89b-198a-59f9-99ec-c2dd1465dab9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F54%252F2554b78c8003bf488a04e77323ce3338%252Fpa%252FPB77964_b7c89c36e5096e72cd7025f2dea68112.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_b7c89c36e5096e72cd7025f2dea68112.jpg saved to cache
2026-03-28 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22d0c89b-198a-59f9-99ec-c2dd1465dab9
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f577f10>
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_5554123385052135250c89fcd6c1783a.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_5554123385052135250c89fcd6c1783a.jpg saved to cache
2026-03-28 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 803d0771-4d91-5995-922f-1f077c458772
2026-03-28 12:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_772ee3d151f66b5aba6228e9a046a5e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_7c17e4c18b600cb1d5946deff72b76bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_5bbf54604ce1b47d409356003db030e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_debde9675e07a37cc76e45e2222fdbaf.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_cd7919a8e852fca15b0e0fb3e69c4150.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_7e8c9c649a5754562aba6a7328516414.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cacf650>
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_772ee3d151f66b5aba6228e9a046a5e4.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_772ee3d151f66b5aba6228e9a046a5e4.jpg saved to cache
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6501c20-9e7c-500a-8873-823fe95fda05
2026-03-28 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_1eef3f02d0020b6928cee94fb3da2cb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_bfa8f119a2f0bdad8cd8eebe1d2f1247.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_656319d7756352b905e54c8742ce3477.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4e8610>
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_7c17e4c18b600cb1d5946deff72b76bc.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_7c17e4c18b600cb1d5946deff72b76bc.jpg saved to cache
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6501c20-9e7c-500a-8873-823fe95fda05
2026-03-28 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_c50fb8348dbbc9862f93ba740533266b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f863950>
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbb%252Fdcbbd9a9b9f61014533f39f7e547435b%252Fpa%252FZB75356_5bbf54604ce1b47d409356003db030e2.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_5bbf54604ce1b47d409356003db030e2.jpg saved to cache
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6501c20-9e7c-500a-8873-823fe95fda05
2026-03-28 12:00:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6501c20-9e7c-500a-8873-823fe95fda05, skipping ID generation
2026-03-28 12:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6501c20-9e7c-500a-8873-823fe95fda05 with scrape type 1
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6501c20-9e7c-500a-8873-823fe95fda05 sending to next pipeline
2026-03-28 12:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a6501c20-9e7c-500a-8873-823fe95fda05, identifier: ZB75356
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c835310>
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_debde9675e07a37cc76e45e2222fdbaf.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_debde9675e07a37cc76e45e2222fdbaf.jpg saved to cache
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6dd67a57-127c-521b-8014-e98e5957b61b
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3e457ed0>
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d0c89b-198a-59f9-99ec-c2dd1465dab9/22d0c89b-198a-59f9-99ec-c2dd1465dab9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F54%252F2554b78c8003bf488a04e77323ce3338%252Fpa%252FPB77964_cd7919a8e852fca15b0e0fb3e69c4150.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_cd7919a8e852fca15b0e0fb3e69c4150.jpg saved to cache
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22d0c89b-198a-59f9-99ec-c2dd1465dab9
2026-03-28 12:00:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4ed590>
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_7e8c9c649a5754562aba6a7328516414.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_7e8c9c649a5754562aba6a7328516414.jpg saved to cache
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 803d0771-4d91-5995-922f-1f077c458772
2026-03-28 12:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a6501c20-9e7c-500a-8873-823fe95fda05 with identifier: ZB75356
2026-03-28 12:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a6501c20-9e7c-500a-8873-823fe95fda05 with identifier: ZB75356
2026-03-28 12:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a6501c20-9e7c-500a-8873-823fe95fda05 with identifier: ZB75356 to the API
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_5bbf54604ce1b47d409356003db030e2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:41:16Z',
'fuel_type': 'diesel',
'id': 'a6501c20-9e7c-500a-8873-823fe95fda05',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB75356',
'listing': 'auction',
'location': 'IT, Garbagnate Milanese',
'make': 'Fiat',
'model': '500X',
'odometer': 151906,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_119608546c298b75ef60d0ba5de430d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2180555,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_772ee3d151f66b5aba6228e9a046a5e4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2162978,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_3cfd7c6f5e7a3bad437e359ec3069b43.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_15f5bc66011b6d6341f01dc5c6c1ddcc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_769380fac77c35ef8c11a8e827de2504.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72980,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_24dc841e780812b13561dcbc0fa8aa22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_df7fa08f4ef6711799c82e1d49883fbe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2157531,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_7c17e4c18b600cb1d5946deff72b76bc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70354,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_e1d74883b326e4b23ffd5b889614026e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6501c20-9e7c-500a-8873-823fe95fda05/a6501c20-9e7c-500a-8873-823fe95fda05_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2043885,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bb/dcbbd9a9b9f61014533f39f7e547435b/pa/ZB75356_5bbf54604ce1b47d409356003db030e2.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-29',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.6 JTDM City Cross',
'transmission': 'manual',
'trim': 'City Cross',
'year': 2019}
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB75356%27 HTTP/1.1" 200 None
2026-03-28 12:00:59 [auto1.it] INFO: Saving data for ZB75356: {'created_time': 1774699259.036188, 'last_price_update_time': 1774699259.0362, 'auction_closing_time': 1774885276.0}
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZB75356') HTTP/1.1" 204 0
2026-03-28 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_dd9e2071649aa4926f13ca2a6340aa00.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f933090>
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d0c89b-198a-59f9-99ec-c2dd1465dab9/22d0c89b-198a-59f9-99ec-c2dd1465dab9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F54%252F2554b78c8003bf488a04e77323ce3338%252Fpa%252FPB77964_1eef3f02d0020b6928cee94fb3da2cb7.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_1eef3f02d0020b6928cee94fb3da2cb7.jpg saved to cache
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22d0c89b-198a-59f9-99ec-c2dd1465dab9
2026-03-28 12:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22d0c89b-198a-59f9-99ec-c2dd1465dab9, skipping ID generation
2026-03-28 12:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22d0c89b-198a-59f9-99ec-c2dd1465dab9 with scrape type 1
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22d0c89b-198a-59f9-99ec-c2dd1465dab9 sending to next pipeline
2026-03-28 12:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 22d0c89b-198a-59f9-99ec-c2dd1465dab9, identifier: PB77964
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4dc8d0>
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_bfa8f119a2f0bdad8cd8eebe1d2f1247.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_bfa8f119a2f0bdad8cd8eebe1d2f1247.jpg saved to cache
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4e98a58-475d-538f-938e-ff24bc88082c
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7bdc90>
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_656319d7756352b905e54c8742ce3477.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_656319d7756352b905e54c8742ce3477.jpg saved to cache
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 803d0771-4d91-5995-922f-1f077c458772
2026-03-28 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_84f19c24f6b2caf08918ca673d057362.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_f3ddc144316e23dd351198a385c2880f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 22d0c89b-198a-59f9-99ec-c2dd1465dab9 with identifier: PB77964
2026-03-28 12:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 22d0c89b-198a-59f9-99ec-c2dd1465dab9 with identifier: PB77964
2026-03-28 12:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 22d0c89b-198a-59f9-99ec-c2dd1465dab9 with identifier: PB77964 to the API
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_1eef3f02d0020b6928cee94fb3da2cb7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.7L',
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:57:56Z',
'fuel_type': 'diesel',
'id': '22d0c89b-198a-59f9-99ec-c2dd1465dab9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB77964',
'listing': 'auction',
'location': 'IT, Legnano',
'make': 'Hyundai',
'model': 'ix35',
'odometer': 220377,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d0c89b-198a-59f9-99ec-c2dd1465dab9/22d0c89b-198a-59f9-99ec-c2dd1465dab9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_cd7919a8e852fca15b0e0fb3e69c4150.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d0c89b-198a-59f9-99ec-c2dd1465dab9/22d0c89b-198a-59f9-99ec-c2dd1465dab9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62940,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_1eef3f02d0020b6928cee94fb3da2cb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d0c89b-198a-59f9-99ec-c2dd1465dab9/22d0c89b-198a-59f9-99ec-c2dd1465dab9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73535,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_5918e3e1c0008f524e649bc70aebad27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d0c89b-198a-59f9-99ec-c2dd1465dab9/22d0c89b-198a-59f9-99ec-c2dd1465dab9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_b2f11b3dc8e9096333d3967861bd635c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d0c89b-198a-59f9-99ec-c2dd1465dab9/22d0c89b-198a-59f9-99ec-c2dd1465dab9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/54/2554b78c8003bf488a04e77323ce3338/pa/PB77964_b7c89c36e5096e72cd7025f2dea68112.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-02-03',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai ix35 1.7 CRDi Comfort 2WD',
'transmission': 'manual',
'trim': 'Comfort 2WD',
'year': 2011}
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB77964%27 HTTP/1.1" 200 None
2026-03-28 12:00:59 [auto1.it] INFO: Saving data for PB77964: {'created_time': 1774699259.684153, 'last_price_update_time': 1774699259.684163, 'auction_closing_time': 1774886276.0}
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PB77964') HTTP/1.1" 204 0
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d771d50>
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_c50fb8348dbbc9862f93ba740533266b.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_c50fb8348dbbc9862f93ba740533266b.jpg saved to cache
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed9d7807-f9bb-5dbe-a22a-98f72d7028c7
2026-03-28 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_5875e789a946364b0d7ab03ca4c1dd1c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca27ed0>
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_dd9e2071649aa4926f13ca2a6340aa00.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_dd9e2071649aa4926f13ca2a6340aa00.jpg saved to cache
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 803d0771-4d91-5995-922f-1f077c458772
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb2e250>
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f170aece-4cfc-5491-87f1-8a7f088d1a9d/f170aece-4cfc-5491-87f1-8a7f088d1a9d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3f%252F153f8479072d855d743e30316c270512%252Fpa%252FRT78827_84f19c24f6b2caf08918ca673d057362.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_84f19c24f6b2caf08918ca673d057362.jpg saved to cache
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f170aece-4cfc-5491-87f1-8a7f088d1a9d
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d571990>
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_f3ddc144316e23dd351198a385c2880f.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_f3ddc144316e23dd351198a385c2880f.jpg saved to cache
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4e98a58-475d-538f-938e-ff24bc88082c
2026-03-28 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_4d75aedef7fac34c368588b40b2a69a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4a10d0>
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_5875e789a946364b0d7ab03ca4c1dd1c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_5875e789a946364b0d7ab03ca4c1dd1c.jpg saved to cache
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6dd67a57-127c-521b-8014-e98e5957b61b
2026-03-28 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_f038dc26e28c9d7054ad953399a067ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_5a1d5617ad1c84e084e104ba2ffb34c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_a69cb1041ab8ababefac1a6c22e1b704.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_89ba0ad66f30d3f5150425f7e2e46eb0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_1a37df1fe0db17fb6c04091732d5e15b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_a9c6169c7cc92aae1721898ef7cc4a37.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_fdec8d06f472782add4e20f9a0aefe9e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d49f110>
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f170aece-4cfc-5491-87f1-8a7f088d1a9d/f170aece-4cfc-5491-87f1-8a7f088d1a9d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3f%252F153f8479072d855d743e30316c270512%252Fpa%252FRT78827_4d75aedef7fac34c368588b40b2a69a9.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_4d75aedef7fac34c368588b40b2a69a9.jpg saved to cache
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f170aece-4cfc-5491-87f1-8a7f088d1a9d
2026-03-28 12:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_dd18ee589c556acfe2ab55e836f5dc64.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_a44d0dfe9c3e12aa3cfc9075f6c2af6b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f5cc910>
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_f038dc26e28c9d7054ad953399a067ff.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_f038dc26e28c9d7054ad953399a067ff.jpg saved to cache
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6dd67a57-127c-521b-8014-e98e5957b61b
2026-03-28 12:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_2b1ecd900486bc26cb84861f5129ec7f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_64fa198504992959e315944f25f2943d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_b48b6741ba4a968e55b7c95368c81ad1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_aa687c7829461d8e967b7ed8f9eb0098.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4a3e90>
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_5a1d5617ad1c84e084e104ba2ffb34c5.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_5a1d5617ad1c84e084e104ba2ffb34c5.jpg saved to cache
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 803d0771-4d91-5995-922f-1f077c458772
2026-03-28 12:01:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c97a550>
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_a69cb1041ab8ababefac1a6c22e1b704.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_a69cb1041ab8ababefac1a6c22e1b704.jpg saved to cache
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 803d0771-4d91-5995-922f-1f077c458772
2026-03-28 12:01:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cc14290>
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F3a%252F053acd2d3bb51963711be54d86bfed07%252Fpa%252FRZ14942_89ba0ad66f30d3f5150425f7e2e46eb0.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_89ba0ad66f30d3f5150425f7e2e46eb0.jpg saved to cache
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed9d7807-f9bb-5dbe-a22a-98f72d7028c7
2026-03-28 12:01:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed9d7807-f9bb-5dbe-a22a-98f72d7028c7, skipping ID generation
2026-03-28 12:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed9d7807-f9bb-5dbe-a22a-98f72d7028c7 with scrape type 1
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed9d7807-f9bb-5dbe-a22a-98f72d7028c7 sending to next pipeline
2026-03-28 12:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ed9d7807-f9bb-5dbe-a22a-98f72d7028c7, identifier: RZ14942
2026-03-28 12:01:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d79fb10>
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_1a37df1fe0db17fb6c04091732d5e15b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_1a37df1fe0db17fb6c04091732d5e15b.jpg saved to cache
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6dd67a57-127c-521b-8014-e98e5957b61b
2026-03-28 12:01:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d572590>
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_a9c6169c7cc92aae1721898ef7cc4a37.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_a9c6169c7cc92aae1721898ef7cc4a37.jpg saved to cache
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f36a363d-16e8-55e1-9438-200bfc854b53
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f5cf490>
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f170aece-4cfc-5491-87f1-8a7f088d1a9d/f170aece-4cfc-5491-87f1-8a7f088d1a9d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3f%252F153f8479072d855d743e30316c270512%252Fpa%252FRT78827_fdec8d06f472782add4e20f9a0aefe9e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_fdec8d06f472782add4e20f9a0aefe9e.jpg saved to cache
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f170aece-4cfc-5491-87f1-8a7f088d1a9d
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d79c1d0>
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_dd18ee589c556acfe2ab55e836f5dc64.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_dd18ee589c556acfe2ab55e836f5dc64.jpg saved to cache
2026-03-28 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6dd67a57-127c-521b-8014-e98e5957b61b
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f86ae50>
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_a44d0dfe9c3e12aa3cfc9075f6c2af6b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_a44d0dfe9c3e12aa3cfc9075f6c2af6b.jpg saved to cache
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f36a363d-16e8-55e1-9438-200bfc854b53
2026-03-28 12:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ed9d7807-f9bb-5dbe-a22a-98f72d7028c7 with identifier: RZ14942
2026-03-28 12:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ed9d7807-f9bb-5dbe-a22a-98f72d7028c7 with identifier: RZ14942
2026-03-28 12:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ed9d7807-f9bb-5dbe-a22a-98f72d7028c7 with identifier: RZ14942 to the API
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_89ba0ad66f30d3f5150425f7e2e46eb0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:52:57Z',
'fuel_type': 'hybrid',
'id': 'ed9d7807-f9bb-5dbe-a22a-98f72d7028c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ14942',
'listing': 'auction',
'location': 'IT, Gallarate',
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 69511,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2338455,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_e9e027d4fa6577cad9cee9016c0f84a7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2356395,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_84bd3d11b7d658259183e8e755fef2a4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2539208,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_cd72c1ffeeb8417e37e343f61ce22b48.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_96949616b7e97710311cd5c16cdd9e92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_c50fb8348dbbc9862f93ba740533266b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68470,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_ed07159c6a34a682047eac3499d7f655.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2177283,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_89ba0ad66f30d3f5150425f7e2e46eb0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62975,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_ed03ffc3dc1ee8ce48da5fcb03313b07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_38bf053982c855acc92734b5e2e481f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9d7807-f9bb-5dbe-a22a-98f72d7028c7/ed9d7807-f9bb-5dbe-a22a-98f72d7028c7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2408642,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img05/3a/053acd2d3bb51963711be54d86bfed07/pa/RZ14942_aaa58b8ed6770819fd5fb1ed9e7845cb.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-05-12',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Trend',
'transmission': 'automatic',
'trim': '2WD Trend',
'year': 2022}
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ14942%27 HTTP/1.1" 200 None
2026-03-28 12:01:01 [auto1.it] INFO: Saving data for RZ14942: {'created_time': 1774699261.373844, 'last_price_update_time': 1774699261.373852, 'auction_closing_time': 1774885977.0}
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RZ14942') HTTP/1.1" 204 0
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca729d0>
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f170aece-4cfc-5491-87f1-8a7f088d1a9d/f170aece-4cfc-5491-87f1-8a7f088d1a9d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3f%252F153f8479072d855d743e30316c270512%252Fpa%252FRT78827_2b1ecd900486bc26cb84861f5129ec7f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_2b1ecd900486bc26cb84861f5129ec7f.jpg saved to cache
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f170aece-4cfc-5491-87f1-8a7f088d1a9d
2026-03-28 12:01:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f170aece-4cfc-5491-87f1-8a7f088d1a9d, skipping ID generation
2026-03-28 12:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f170aece-4cfc-5491-87f1-8a7f088d1a9d with scrape type 1
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f170aece-4cfc-5491-87f1-8a7f088d1a9d sending to next pipeline
2026-03-28 12:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f170aece-4cfc-5491-87f1-8a7f088d1a9d, identifier: RT78827
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cabd850>
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_64fa198504992959e315944f25f2943d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_64fa198504992959e315944f25f2943d.jpg saved to cache
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 803d0771-4d91-5995-922f-1f077c458772
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cafe1d0>
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_b48b6741ba4a968e55b7c95368c81ad1.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_b48b6741ba4a968e55b7c95368c81ad1.jpg saved to cache
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 154ec7f7-09d6-508b-8a44-8d6030b71dc9
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7e9350>
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_aa687c7829461d8e967b7ed8f9eb0098.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_aa687c7829461d8e967b7ed8f9eb0098.jpg saved to cache
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4e98a58-475d-538f-938e-ff24bc88082c
2026-03-28 12:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f170aece-4cfc-5491-87f1-8a7f088d1a9d with identifier: RT78827
2026-03-28 12:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f170aece-4cfc-5491-87f1-8a7f088d1a9d with identifier: RT78827
2026-03-28 12:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f170aece-4cfc-5491-87f1-8a7f088d1a9d with identifier: RT78827 to the API
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_2b1ecd900486bc26cb84861f5129ec7f.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:03:22Z',
'fuel_type': 'diesel',
'id': 'f170aece-4cfc-5491-87f1-8a7f088d1a9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT78827',
'listing': 'auction',
'location': 'IT, Bolzano (BZ)',
'make': 'BMW',
'model': '1er',
'odometer': 282459,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f170aece-4cfc-5491-87f1-8a7f088d1a9d/f170aece-4cfc-5491-87f1-8a7f088d1a9d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_4574c669b504e41c5225d2a0b68d96fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f170aece-4cfc-5491-87f1-8a7f088d1a9d/f170aece-4cfc-5491-87f1-8a7f088d1a9d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73311,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_2b1ecd900486bc26cb84861f5129ec7f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f170aece-4cfc-5491-87f1-8a7f088d1a9d/f170aece-4cfc-5491-87f1-8a7f088d1a9d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_fdec8d06f472782add4e20f9a0aefe9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f170aece-4cfc-5491-87f1-8a7f088d1a9d/f170aece-4cfc-5491-87f1-8a7f088d1a9d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59608,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_4d75aedef7fac34c368588b40b2a69a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f170aece-4cfc-5491-87f1-8a7f088d1a9d/f170aece-4cfc-5491-87f1-8a7f088d1a9d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90022,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/3f/153f8479072d855d743e30316c270512/pa/RT78827_84f19c24f6b2caf08918ca673d057362.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-02-25',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT78827%27 HTTP/1.1" 200 None
2026-03-28 12:01:02 [auto1.it] INFO: Saving data for RT78827: {'created_time': 1774699262.004361, 'last_price_update_time': 1774699262.004372, 'auction_closing_time': 1774883002.0}
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT78827') HTTP/1.1" 204 0
2026-03-28 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_2e9bc24a30b6a38f15c91a6403ebfd5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_325db82a00887eb771091f3bc03f3953.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_b8e46042d4a9cecdd409a4ffd37181f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_100ae47cc73817ff0cd43c80f1098c87.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_f29c8bb57a902359ef3b470cba748e5f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_c0764bfd0703009672faa78f57c86020.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_b12235b1e9864cb94a4e61c06a4270c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_b7ea9faa318f4b918d04b30dbcc79abf.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_2ec21f2adcb0fc5a226976561373702d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_7de0750dd812b57eb079be7207dcb8b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_de7bab107dbf951f1c87dcb249629082.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d451050>
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dadf2e7-5a75-55cd-a568-19ae97860a47/2dadf2e7-5a75-55cd-a568-19ae97860a47_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F0f%252Faa0f583a09375dd5622c2f2e9df3b7f1%252Fpa%252FKW13943_2e9bc24a30b6a38f15c91a6403ebfd5b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_2e9bc24a30b6a38f15c91a6403ebfd5b.jpg saved to cache
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2dadf2e7-5a75-55cd-a568-19ae97860a47
2026-03-28 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_39e4b7b224df73d7105b30982b85c510.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_1871a7d326dd7e051adabc371788ab05.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d54d0d0>
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Ff6%252Fd2f6d31918848742be8f949c1df47c00%252Fpa%252FFJ19911_325db82a00887eb771091f3bc03f3953.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_325db82a00887eb771091f3bc03f3953.jpg saved to cache
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4e98a58-475d-538f-938e-ff24bc88082c
2026-03-28 12:01:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4e98a58-475d-538f-938e-ff24bc88082c, skipping ID generation
2026-03-28 12:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4e98a58-475d-538f-938e-ff24bc88082c with scrape type 1
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4e98a58-475d-538f-938e-ff24bc88082c sending to next pipeline
2026-03-28 12:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e4e98a58-475d-538f-938e-ff24bc88082c, identifier: FJ19911
2026-03-28 12:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d67a6d0>
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_b8e46042d4a9cecdd409a4ffd37181f9.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_b8e46042d4a9cecdd409a4ffd37181f9.jpg saved to cache
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 154ec7f7-09d6-508b-8a44-8d6030b71dc9
2026-03-28 12:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb92c90>
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_100ae47cc73817ff0cd43c80f1098c87.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_100ae47cc73817ff0cd43c80f1098c87.jpg saved to cache
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 803d0771-4d91-5995-922f-1f077c458772
2026-03-28 12:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d573e50>
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F23%252Fff23a59e019ebb9be8289fd619f085bc%252Fpa%252FKG10642_f29c8bb57a902359ef3b470cba748e5f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_f29c8bb57a902359ef3b470cba748e5f.jpg saved to cache
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6dd67a57-127c-521b-8014-e98e5957b61b
2026-03-28 12:01:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6dd67a57-127c-521b-8014-e98e5957b61b, skipping ID generation
2026-03-28 12:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dd67a57-127c-521b-8014-e98e5957b61b with scrape type 1
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6dd67a57-127c-521b-8014-e98e5957b61b sending to next pipeline
2026-03-28 12:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6dd67a57-127c-521b-8014-e98e5957b61b, identifier: KG10642
2026-03-28 12:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f5b32d0>
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F05%252Ff805aa8676633bf85e8f8026ceec600b%252Fpa%252FXU75020_c0764bfd0703009672faa78f57c86020.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_c0764bfd0703009672faa78f57c86020.jpg saved to cache
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 803d0771-4d91-5995-922f-1f077c458772
2026-03-28 12:01:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 803d0771-4d91-5995-922f-1f077c458772, skipping ID generation
2026-03-28 12:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 803d0771-4d91-5995-922f-1f077c458772 with scrape type 1
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 803d0771-4d91-5995-922f-1f077c458772 sending to next pipeline
2026-03-28 12:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 803d0771-4d91-5995-922f-1f077c458772, identifier: XU75020
2026-03-28 12:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5ce610>
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_b12235b1e9864cb94a4e61c06a4270c8.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_b12235b1e9864cb94a4e61c06a4270c8.jpg saved to cache
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f36a363d-16e8-55e1-9438-200bfc854b53
2026-03-28 12:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb92410>
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_b7ea9faa318f4b918d04b30dbcc79abf.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_b7ea9faa318f4b918d04b30dbcc79abf.jpg saved to cache
2026-03-28 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f36a363d-16e8-55e1-9438-200bfc854b53
2026-03-28 12:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e4e98a58-475d-538f-938e-ff24bc88082c with identifier: FJ19911
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 12:01:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e4e98a58-475d-538f-938e-ff24bc88082c with identifier: FJ19911
2026-03-28 12:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e4e98a58-475d-538f-938e-ff24bc88082c with identifier: FJ19911 to the API
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_325db82a00887eb771091f3bc03f3953.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:17:42Z',
'fuel_type': 'petrol',
'id': 'e4e98a58-475d-538f-938e-ff24bc88082c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ19911',
'listing': 'auction',
'location': 'IT, Bergamo',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 13243,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_f45aba372c10acf4fe7b68fcda8f8c45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_9c6e97b7f86af9b078624b665f5fb5a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_325db82a00887eb771091f3bc03f3953.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68248,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_b77d26b533ca8a354466670d79a05592.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75034,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_aa687c7829461d8e967b7ed8f9eb0098.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_76cb98a8ce2296351c2efeaa132faf8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73087,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_f3ddc144316e23dd351198a385c2880f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64657,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_f1c421d337c7e212342553154e6ff3e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_41414c5b859fba21baffdbe054ded9a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e98a58-475d-538f-938e-ff24bc88082c/e4e98a58-475d-538f-938e-ff24bc88082c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/f6/d2f6d31918848742be8f949c1df47c00/pa/FJ19911_bfa8f119a2f0bdad8cd8eebe1d2f1247.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.0 VVT-i Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2017}
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ19911%27 HTTP/1.1" 200 None
2026-03-28 12:01:03 [auto1.it] INFO: Saving data for FJ19911: {'created_time': 1774699263.617415, 'last_price_update_time': 1774699263.617424, 'auction_closing_time': 1774883862.0}
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FJ19911') HTTP/1.1" 204 0
2026-03-28 12:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6dd67a57-127c-521b-8014-e98e5957b61b with identifier: KG10642
2026-03-28 12:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6dd67a57-127c-521b-8014-e98e5957b61b with identifier: KG10642
2026-03-28 12:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6dd67a57-127c-521b-8014-e98e5957b61b with identifier: KG10642 to the API
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_f29c8bb57a902359ef3b470cba748e5f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:17:46Z',
'fuel_type': 'petrol',
'id': '6dd67a57-127c-521b-8014-e98e5957b61b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG10642',
'listing': 'auction',
'location': 'IT, Pompei',
'make': 'Fiat',
'model': 'Panda',
'odometer': 70372,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_08e8651e7e9fde88f3b911e31aeef428.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2316595,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_f29c8bb57a902359ef3b470cba748e5f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81230,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_dd18ee589c556acfe2ab55e836f5dc64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_5875e789a946364b0d7ab03ca4c1dd1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2367253,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_1a37df1fe0db17fb6c04091732d5e15b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2220668,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_9c443bd5f9914430e995fda3298411b4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1945813,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_f038dc26e28c9d7054ad953399a067ff.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_debde9675e07a37cc76e45e2222fdbaf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_10835ccdb49c217d832c1300d1fb0067.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd67a57-127c-521b-8014-e98e5957b61b/6dd67a57-127c-521b-8014-e98e5957b61b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2115541,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgff/23/ff23a59e019ebb9be8289fd619f085bc/pa/KG10642_3d38e851e97e069a559f53f706762835.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-10-30',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat Panda 1.2 Emotion',
'transmission': 'manual',
'trim': 'Emotion',
'year': 2011}
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG10642%27 HTTP/1.1" 200 None
2026-03-28 12:01:04 [auto1.it] INFO: Saving data for KG10642: {'created_time': 1774699264.605859, 'last_price_update_time': 1774699264.605869, 'auction_closing_time': 1774883866.0}
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KG10642') HTTP/1.1" 204 0
2026-03-28 12:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 803d0771-4d91-5995-922f-1f077c458772 with identifier: XU75020
2026-03-28 12:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 803d0771-4d91-5995-922f-1f077c458772 with identifier: XU75020
2026-03-28 12:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 803d0771-4d91-5995-922f-1f077c458772 with identifier: XU75020 to the API
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_c0764bfd0703009672faa78f57c86020.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:57:54Z',
'fuel_type': 'petrol',
'id': '803d0771-4d91-5995-922f-1f077c458772',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU75020',
'listing': 'auction',
'location': 'IT, Pavia',
'make': 'Opel',
'model': 'Corsa',
'odometer': 15591,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2341549,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_c0764bfd0703009672faa78f57c86020.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62338,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_64fa198504992959e315944f25f2943d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2267653,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_100ae47cc73817ff0cd43c80f1098c87.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60625,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_5a1d5617ad1c84e084e104ba2ffb34c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_dd9e2071649aa4926f13ca2a6340aa00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2265977,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_7e8c9c649a5754562aba6a7328516414.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2313472,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_a69cb1041ab8ababefac1a6c22e1b704.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_656319d7756352b905e54c8742ce3477.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_5554123385052135250c89fcd6c1783a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d0771-4d91-5995-922f-1f077c458772/803d0771-4d91-5995-922f-1f077c458772_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/05/f805aa8676633bf85e8f8026ceec600b/pa/XU75020_0d66a739e1045005ed8f10d2e0f353a4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-21',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 Advance',
'transmission': 'manual',
'trim': 'Advance',
'year': 2018}
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU75020%27 HTTP/1.1" 200 None
2026-03-28 12:01:05 [auto1.it] INFO: Saving data for XU75020: {'created_time': 1774699265.011738, 'last_price_update_time': 1774699265.011749, 'auction_closing_time': 1774886274.0}
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XU75020') HTTP/1.1" 204 0
2026-03-28 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_765ae610f73c443e3ca34b4ef40ed42a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_7bfc8fa8a2517d587a14a7156b6a2059.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_01f6b27256d9d1259a985fca7bb50a59.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7a96d0>
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_2ec21f2adcb0fc5a226976561373702d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_2ec21f2adcb0fc5a226976561373702d.jpg saved to cache
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f36a363d-16e8-55e1-9438-200bfc854b53
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5bd410>
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88614e76-2d00-5bf2-8bfd-bef3b21e2a31/88614e76-2d00-5bf2-8bfd-bef3b21e2a31_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb1%252F06b193c16e6c31516ded0d736f4b8e0e%252Fpa%252FML76939_7de0750dd812b57eb079be7207dcb8b8.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_7de0750dd812b57eb079be7207dcb8b8.jpg saved to cache
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88614e76-2d00-5bf2-8bfd-bef3b21e2a31
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4f4e90>
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_de7bab107dbf951f1c87dcb249629082.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_de7bab107dbf951f1c87dcb249629082.jpg saved to cache
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 154ec7f7-09d6-508b-8a44-8d6030b71dc9
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca06a50>
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_39e4b7b224df73d7105b30982b85c510.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_39e4b7b224df73d7105b30982b85c510.jpg saved to cache
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 154ec7f7-09d6-508b-8a44-8d6030b71dc9
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4de8d0>
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88614e76-2d00-5bf2-8bfd-bef3b21e2a31/88614e76-2d00-5bf2-8bfd-bef3b21e2a31_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb1%252F06b193c16e6c31516ded0d736f4b8e0e%252Fpa%252FML76939_1871a7d326dd7e051adabc371788ab05.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_1871a7d326dd7e051adabc371788ab05.jpg saved to cache
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88614e76-2d00-5bf2-8bfd-bef3b21e2a31
2026-03-28 12:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:05 [scrapy.extensions.logstats] INFO: Crawled 97 pages (at 97 pages/min), scraped 33 items (at 33 items/min)
2026-03-28 12:01:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4ddfd0>
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_765ae610f73c443e3ca34b4ef40ed42a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_765ae610f73c443e3ca34b4ef40ed42a.jpg saved to cache
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f36a363d-16e8-55e1-9438-200bfc854b53
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c982d10>
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9e%252Ff89e778c4a5a04b35df48d4cb9c09cdb%252Fpa%252FMU44225_7bfc8fa8a2517d587a14a7156b6a2059.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_7bfc8fa8a2517d587a14a7156b6a2059.jpg saved to cache
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 154ec7f7-09d6-508b-8a44-8d6030b71dc9
2026-03-28 12:01:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 154ec7f7-09d6-508b-8a44-8d6030b71dc9, skipping ID generation
2026-03-28 12:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 154ec7f7-09d6-508b-8a44-8d6030b71dc9 with scrape type 1
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 154ec7f7-09d6-508b-8a44-8d6030b71dc9 sending to next pipeline
2026-03-28 12:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 154ec7f7-09d6-508b-8a44-8d6030b71dc9, identifier: MU44225
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca4ed90>
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dadf2e7-5a75-55cd-a568-19ae97860a47/2dadf2e7-5a75-55cd-a568-19ae97860a47_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F0f%252Faa0f583a09375dd5622c2f2e9df3b7f1%252Fpa%252FKW13943_01f6b27256d9d1259a985fca7bb50a59.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_01f6b27256d9d1259a985fca7bb50a59.jpg saved to cache
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2dadf2e7-5a75-55cd-a568-19ae97860a47
2026-03-28 12:01:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dadf2e7-5a75-55cd-a568-19ae97860a47, skipping ID generation
2026-03-28 12:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dadf2e7-5a75-55cd-a568-19ae97860a47 with scrape type 1
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2dadf2e7-5a75-55cd-a568-19ae97860a47 sending to next pipeline
2026-03-28 12:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2dadf2e7-5a75-55cd-a568-19ae97860a47, identifier: KW13943
2026-03-28 12:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 154ec7f7-09d6-508b-8a44-8d6030b71dc9 with identifier: MU44225
2026-03-28 12:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 154ec7f7-09d6-508b-8a44-8d6030b71dc9 with identifier: MU44225
2026-03-28 12:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 154ec7f7-09d6-508b-8a44-8d6030b71dc9 with identifier: MU44225 to the API
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_7bfc8fa8a2517d587a14a7156b6a2059.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:48:32Z',
'fuel_type': 'diesel',
'id': '154ec7f7-09d6-508b-8a44-8d6030b71dc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU44225',
'listing': 'auction',
'location': 'IT, Avezzano',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 145539,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62195,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_a6689e46de57b822280117bf0e802b57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61367,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_7bfc8fa8a2517d587a14a7156b6a2059.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52442,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_de7bab107dbf951f1c87dcb249629082.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225859,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_43b9a7b8fbe48b58e635996f4c32245d.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_39e4b7b224df73d7105b30982b85c510.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53486,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_0c90e0302905fb6dfd3b5d873bf1cf92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42660,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_6239b9f4e41e6f4212af50d7e45ae306.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_60ddb89c046a0113a74ed5b4bc2ba9e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258738,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_b8e46042d4a9cecdd409a4ffd37181f9.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_154ec7f7-09d6-508b-8a44-8d6030b71dc9/154ec7f7-09d6-508b-8a44-8d6030b71dc9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/9e/f89e778c4a5a04b35df48d4cb9c09cdb/pa/MU44225_b48b6741ba4a968e55b7c95368c81ad1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-02-25',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.4 D-4D Cool',
'transmission': 'manual',
'trim': 'Cool',
'year': 2015}
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU44225%27 HTTP/1.1" 200 None
2026-03-28 12:01:06 [auto1.it] INFO: Saving data for MU44225: {'created_time': 1774699266.654963, 'last_price_update_time': 1774699266.654979, 'auction_closing_time': 1774885712.0}
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MU44225') HTTP/1.1" 204 0
2026-03-28 12:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2dadf2e7-5a75-55cd-a568-19ae97860a47 with identifier: KW13943
2026-03-28 12:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2dadf2e7-5a75-55cd-a568-19ae97860a47 with identifier: KW13943
2026-03-28 12:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2dadf2e7-5a75-55cd-a568-19ae97860a47 with identifier: KW13943 to the API
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_01f6b27256d9d1259a985fca7bb50a59.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6B',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:29:31Z',
'fuel_type': 'petrol',
'id': '2dadf2e7-5a75-55cd-a568-19ae97860a47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW13943',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Opel',
'model': 'Corsa',
'odometer': 81135,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dadf2e7-5a75-55cd-a568-19ae97860a47/2dadf2e7-5a75-55cd-a568-19ae97860a47_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_fe3e656ea7a78ce1f240af9ca72775ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dadf2e7-5a75-55cd-a568-19ae97860a47/2dadf2e7-5a75-55cd-a568-19ae97860a47_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_76dfc7d7610d89d504a079f7a0d84595.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dadf2e7-5a75-55cd-a568-19ae97860a47/2dadf2e7-5a75-55cd-a568-19ae97860a47_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_c48ea3043fc4c67a873727e79b457680.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dadf2e7-5a75-55cd-a568-19ae97860a47/2dadf2e7-5a75-55cd-a568-19ae97860a47_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_503981f5e04c60144be8775c297bbea5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dadf2e7-5a75-55cd-a568-19ae97860a47/2dadf2e7-5a75-55cd-a568-19ae97860a47_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106147,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_01f6b27256d9d1259a985fca7bb50a59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dadf2e7-5a75-55cd-a568-19ae97860a47/2dadf2e7-5a75-55cd-a568-19ae97860a47_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/0f/aa0f583a09375dd5622c2f2e9df3b7f1/pa/KW13943_2e9bc24a30b6a38f15c91a6403ebfd5b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-06-09',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 Njoy',
'transmission': 'manual',
'trim': 'Njoy',
'year': 2015}
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW13943%27 HTTP/1.1" 200 None
2026-03-28 12:01:07 [auto1.it] INFO: Saving data for KW13943: {'created_time': 1774699267.050252, 'last_price_update_time': 1774699267.050264, 'auction_closing_time': 1774884571.0}
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KW13943') HTTP/1.1" 204 0
2026-03-28 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MR47105/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_74aaf622847fc49304932cf418a75cdd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX06371> (referer: https://www.auto1.com/v1/car-details-view/VX06371/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_412eae4e693eef8186cbcce5fa0f5f22.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_c204f61ea78bb1558c59b58fc9548b0c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_574f4cd6168c4150f05fbf6870b837ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_249880620cec79e487e50b8d87cfe1d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5cf210>
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88614e76-2d00-5bf2-8bfd-bef3b21e2a31/88614e76-2d00-5bf2-8bfd-bef3b21e2a31_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb1%252F06b193c16e6c31516ded0d736f4b8e0e%252Fpa%252FML76939_74aaf622847fc49304932cf418a75cdd.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_74aaf622847fc49304932cf418a75cdd.jpg saved to cache
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88614e76-2d00-5bf2-8bfd-bef3b21e2a31
2026-03-28 12:01:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88614e76-2d00-5bf2-8bfd-bef3b21e2a31, skipping ID generation
2026-03-28 12:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88614e76-2d00-5bf2-8bfd-bef3b21e2a31 with scrape type 1
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88614e76-2d00-5bf2-8bfd-bef3b21e2a31 sending to next pipeline
2026-03-28 12:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 88614e76-2d00-5bf2-8bfd-bef3b21e2a31, identifier: ML76939
2026-03-28 12:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 88614e76-2d00-5bf2-8bfd-bef3b21e2a31 with identifier: ML76939
2026-03-28 12:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 88614e76-2d00-5bf2-8bfd-bef3b21e2a31 with identifier: ML76939
2026-03-28 12:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 88614e76-2d00-5bf2-8bfd-bef3b21e2a31 with identifier: ML76939 to the API
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_74aaf622847fc49304932cf418a75cdd.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '1.1L',
'engine_horse_power': 58,
'expiration_date': '2026-03-30T15:20:09Z',
'fuel_type': 'petrol',
'id': '88614e76-2d00-5bf2-8bfd-bef3b21e2a31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML76939',
'listing': 'auction',
'location': 'IT, Tradein',
'make': 'Renault',
'model': 'Twingo',
'odometer': 44978,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88614e76-2d00-5bf2-8bfd-bef3b21e2a31/88614e76-2d00-5bf2-8bfd-bef3b21e2a31_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_74aaf622847fc49304932cf418a75cdd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88614e76-2d00-5bf2-8bfd-bef3b21e2a31/88614e76-2d00-5bf2-8bfd-bef3b21e2a31_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_1871a7d326dd7e051adabc371788ab05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88614e76-2d00-5bf2-8bfd-bef3b21e2a31/88614e76-2d00-5bf2-8bfd-bef3b21e2a31_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_7de0750dd812b57eb079be7207dcb8b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88614e76-2d00-5bf2-8bfd-bef3b21e2a31/88614e76-2d00-5bf2-8bfd-bef3b21e2a31_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57180,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_8dbb83a2ce43dd263465706ce991be99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88614e76-2d00-5bf2-8bfd-bef3b21e2a31/88614e76-2d00-5bf2-8bfd-bef3b21e2a31_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/b1/06b193c16e6c31516ded0d736f4b8e0e/pa/ML76939_8b728b8e4f8923bbac5698948b809fb8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-08-30',
'seats_number': 4,
'seller_name': None,
'title': 'Renault Twingo 1.2 Sport & Sound',
'transmission': 'manual',
'trim': 'Sport & Sound',
'year': 2009}
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML76939%27 HTTP/1.1" 200 None
2026-03-28 12:01:07 [auto1.it] INFO: Saving data for ML76939: {'created_time': 1774699267.693868, 'last_price_update_time': 1774699267.693878, 'auction_closing_time': 1774884009.0}
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ML76939') HTTP/1.1" 204 0
2026-03-28 12:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f2132c2-3a89-52e3-81d8-70bee2f8d0e6 with identifier: VX06371
2026-03-28 12:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f2132c2-3a89-52e3-81d8-70bee2f8d0e6 with scrape type 1
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3f2132c2-3a89-52e3-81d8-70bee2f8d0e6
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F87%252F5887047f5c68e93c8f051724eef1444e%252Fpa%252FVX06371_c05e702ae90dc4c05a3e97637c03ec91.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887047f5c68e93c8f051724eef1444e/pa/VX06371_c05e702ae90dc4c05a3e97637c03ec91.jpg already downloaded
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F87%252F5887047f5c68e93c8f051724eef1444e%252Fpa%252FVX06371_e5c494726c22a5ad73be457bec1847a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887047f5c68e93c8f051724eef1444e/pa/VX06371_e5c494726c22a5ad73be457bec1847a2.jpg already downloaded
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F87%252F5887047f5c68e93c8f051724eef1444e%252Fpa%252FVX06371_5294c00f018f00e5bf72f69ac9808519.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887047f5c68e93c8f051724eef1444e/pa/VX06371_5294c00f018f00e5bf72f69ac9808519.jpg already downloaded
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F87%252F5887047f5c68e93c8f051724eef1444e%252Fpa%252FVX06371_841b6bec239c2883b59905379331cf8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887047f5c68e93c8f051724eef1444e/pa/VX06371_841b6bec239c2883b59905379331cf8b.jpg already downloaded
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F87%252F5887047f5c68e93c8f051724eef1444e%252Fpa%252FVX06371_7d055fd9c1e0164a8dcc94992c01d4fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887047f5c68e93c8f051724eef1444e/pa/VX06371_7d055fd9c1e0164a8dcc94992c01d4fc.jpg already downloaded
2026-03-28 12:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3f2132c2-3a89-52e3-81d8-70bee2f8d0e6, identifier: VX06371
2026-03-28 12:01:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6fac50>
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_412eae4e693eef8186cbcce5fa0f5f22.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_412eae4e693eef8186cbcce5fa0f5f22.jpg saved to cache
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 453f202c-8f5b-5971-b8cd-72c41834e578
2026-03-28 12:01:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5cf810>
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fae%252F3eae7cb1808b61fc429ffc2462097be3%252Fpa%252FYU39946_c204f61ea78bb1558c59b58fc9548b0c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_c204f61ea78bb1558c59b58fc9548b0c.jpg saved to cache
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f36a363d-16e8-55e1-9438-200bfc854b53
2026-03-28 12:01:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f36a363d-16e8-55e1-9438-200bfc854b53, skipping ID generation
2026-03-28 12:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f36a363d-16e8-55e1-9438-200bfc854b53 with scrape type 1
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f36a363d-16e8-55e1-9438-200bfc854b53 sending to next pipeline
2026-03-28 12:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f36a363d-16e8-55e1-9438-200bfc854b53, identifier: YU39946
2026-03-28 12:01:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca55190>
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F06%252F1b06db8eb84f5d065f215e7731f5147d%252Fpa%252FYJ81563_574f4cd6168c4150f05fbf6870b837ff.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_574f4cd6168c4150f05fbf6870b837ff.jpg saved to cache
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 453f202c-8f5b-5971-b8cd-72c41834e578
2026-03-28 12:01:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 453f202c-8f5b-5971-b8cd-72c41834e578, skipping ID generation
2026-03-28 12:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 453f202c-8f5b-5971-b8cd-72c41834e578 with scrape type 1
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 453f202c-8f5b-5971-b8cd-72c41834e578 sending to next pipeline
2026-03-28 12:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 453f202c-8f5b-5971-b8cd-72c41834e578, identifier: YJ81563
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d624190>
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e20f307-15b9-531c-a295-805ffed5fb8e/1e20f307-15b9-531c-a295-805ffed5fb8e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fe9%252F23e9f91f5ef896a1bc59bfebb7ff805b%252Fpa%252FNL56799_249880620cec79e487e50b8d87cfe1d6.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_249880620cec79e487e50b8d87cfe1d6.jpg saved to cache
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e20f307-15b9-531c-a295-805ffed5fb8e
2026-03-28 12:01:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e20f307-15b9-531c-a295-805ffed5fb8e, skipping ID generation
2026-03-28 12:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e20f307-15b9-531c-a295-805ffed5fb8e with scrape type 1
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e20f307-15b9-531c-a295-805ffed5fb8e sending to next pipeline
2026-03-28 12:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1e20f307-15b9-531c-a295-805ffed5fb8e, identifier: NL56799
2026-03-28 12:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3f2132c2-3a89-52e3-81d8-70bee2f8d0e6 with identifier: VX06371
2026-03-28 12:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3f2132c2-3a89-52e3-81d8-70bee2f8d0e6 with identifier: VX06371
2026-03-28 12:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3f2132c2-3a89-52e3-81d8-70bee2f8d0e6 with identifier: VX06371 to the API
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VX06371>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:40:02Z',
'fuel_type': 'petrol',
'id': '3f2132c2-3a89-52e3-81d8-70bee2f8d0e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX06371',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Opel',
'model': 'Astra',
'odometer': 181318,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/img58/87/5887047f5c68e93c8f051724eef1444e/pa/VX06371_c05e702ae90dc4c05a3e97637c03ec91.jpg',
'https://img-pa.auto1.com/img58/87/5887047f5c68e93c8f051724eef1444e/pa/VX06371_e5c494726c22a5ad73be457bec1847a2.jpg',
'https://img-pa.auto1.com/img58/87/5887047f5c68e93c8f051724eef1444e/pa/VX06371_5294c00f018f00e5bf72f69ac9808519.jpg',
'https://img-pa.auto1.com/img58/87/5887047f5c68e93c8f051724eef1444e/pa/VX06371_841b6bec239c2883b59905379331cf8b.jpg',
'https://img-pa.auto1.com/img58/87/5887047f5c68e93c8f051724eef1444e/pa/VX06371_7d055fd9c1e0164a8dcc94992c01d4fc.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2132c2-3a89-52e3-81d8-70bee2f8d0e6/3f2132c2-3a89-52e3-81d8-70bee2f8d0e6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/87/5887047f5c68e93c8f051724eef1444e/pa/VX06371_c05e702ae90dc4c05a3e97637c03ec91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2132c2-3a89-52e3-81d8-70bee2f8d0e6/3f2132c2-3a89-52e3-81d8-70bee2f8d0e6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/87/5887047f5c68e93c8f051724eef1444e/pa/VX06371_e5c494726c22a5ad73be457bec1847a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2132c2-3a89-52e3-81d8-70bee2f8d0e6/3f2132c2-3a89-52e3-81d8-70bee2f8d0e6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77365,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/87/5887047f5c68e93c8f051724eef1444e/pa/VX06371_5294c00f018f00e5bf72f69ac9808519.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2132c2-3a89-52e3-81d8-70bee2f8d0e6/3f2132c2-3a89-52e3-81d8-70bee2f8d0e6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/87/5887047f5c68e93c8f051724eef1444e/pa/VX06371_841b6bec239c2883b59905379331cf8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2132c2-3a89-52e3-81d8-70bee2f8d0e6/3f2132c2-3a89-52e3-81d8-70bee2f8d0e6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75644,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/87/5887047f5c68e93c8f051724eef1444e/pa/VX06371_7d055fd9c1e0164a8dcc94992c01d4fc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-04-07',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra 1.4 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2010}
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX06371%27 HTTP/1.1" 200 None
2026-03-28 12:01:08 [auto1.it] INFO: Saving data for VX06371: {'created_time': 1774699268.990366, 'last_price_update_time': 1774699268.990376, 'auction_closing_time': 1774885202.0}
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VX06371') HTTP/1.1" 204 0
2026-03-28 12:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f36a363d-16e8-55e1-9438-200bfc854b53 with identifier: YU39946
2026-03-28 12:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f36a363d-16e8-55e1-9438-200bfc854b53 with identifier: YU39946
2026-03-28 12:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f36a363d-16e8-55e1-9438-200bfc854b53 with identifier: YU39946 to the API
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_c204f61ea78bb1558c59b58fc9548b0c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:11:42Z',
'fuel_type': 'petrol',
'id': 'f36a363d-16e8-55e1-9438-200bfc854b53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU39946',
'listing': 'auction',
'location': 'IT, Tradein',
'make': 'Fiat',
'model': '500',
'odometer': 122502,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110308,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_765ae610f73c443e3ca34b4ef40ed42a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3565825,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_eede851eb01b3bff000482179cec94b2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100143,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_2ec21f2adcb0fc5a226976561373702d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3372511,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_95fcc52a36fd7f86da0b7ea7e605b90f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3692502,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_c204f61ea78bb1558c59b58fc9548b0c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3710236,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_b7ea9faa318f4b918d04b30dbcc79abf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3363187,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_b12235b1e9864cb94a4e61c06a4270c8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_a44d0dfe9c3e12aa3cfc9075f6c2af6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_d3fbc8c2c7b0a1c2a351b7c21cff11fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36a363d-16e8-55e1-9438-200bfc854b53/f36a363d-16e8-55e1-9438-200bfc854b53_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3467028,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3e/ae/3eae7cb1808b61fc429ffc2462097be3/pa/YU39946_a9c6169c7cc92aae1721898ef7cc4a37.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-10-29',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2013}
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU39946%27 HTTP/1.1" 200 None
2026-03-28 12:01:09 [auto1.it] INFO: Saving data for YU39946: {'created_time': 1774699269.431618, 'last_price_update_time': 1774699269.431628, 'auction_closing_time': 1774883502.0}
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YU39946') HTTP/1.1" 204 0
2026-03-28 12:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 453f202c-8f5b-5971-b8cd-72c41834e578 with identifier: YJ81563
2026-03-28 12:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 453f202c-8f5b-5971-b8cd-72c41834e578 with identifier: YJ81563
2026-03-28 12:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 453f202c-8f5b-5971-b8cd-72c41834e578 with identifier: YJ81563 to the API
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_574f4cd6168c4150f05fbf6870b837ff.jpg>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 98,
'expiration_date': '2026-03-30T15:54:31Z',
'fuel_type': 'petrol',
'id': '453f202c-8f5b-5971-b8cd-72c41834e578',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ81563',
'listing': 'auction',
'location': 'IT, Cesano Maderno',
'make': 'MINI',
'model': 'Countryman',
'odometer': 132236,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2659904,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_574f4cd6168c4150f05fbf6870b837ff.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2603525,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_412eae4e693eef8186cbcce5fa0f5f22.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2331713,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_94b8e9a318a6bcabde72cb285623494d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56536,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_130fc08d0ce79f24e07190ea55727db5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54763,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_7f69509a47dd93cfec0bdc8fbdb20834.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_391d6048acf882853c305e5d2ccc9d76.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2111492,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_3701a94737ca788872ec60baa074c481.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2601553,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_e49699e89d3db85f6ea8891beb162f34.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_7012ea4397e82cf1e8b1683b8991aebb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_453f202c-8f5b-5971-b8cd-72c41834e578/453f202c-8f5b-5971-b8cd-72c41834e578_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60299,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/06/1b06db8eb84f5d065f215e7731f5147d/pa/YJ81563_7bd044f9b8de6527a3b5ce6240e38134.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-03-17',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman One',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ81563%27 HTTP/1.1" 200 None
2026-03-28 12:01:09 [auto1.it] INFO: Saving data for YJ81563: {'created_time': 1774699269.803766, 'last_price_update_time': 1774699269.803777, 'auction_closing_time': 1774886071.0}
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YJ81563') HTTP/1.1" 204 0
2026-03-28 12:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1e20f307-15b9-531c-a295-805ffed5fb8e with identifier: NL56799
2026-03-28 12:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1e20f307-15b9-531c-a295-805ffed5fb8e with identifier: NL56799
2026-03-28 12:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1e20f307-15b9-531c-a295-805ffed5fb8e with identifier: NL56799 to the API
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_249880620cec79e487e50b8d87cfe1d6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '1.1L',
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:06:04Z',
'fuel_type': 'petrol',
'id': '1e20f307-15b9-531c-a295-805ffed5fb8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL56799',
'listing': 'auction',
'location': 'IT, Cinisello Balsamo',
'make': 'Peugeot',
'model': '206+',
'odometer': 177554,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e20f307-15b9-531c-a295-805ffed5fb8e/1e20f307-15b9-531c-a295-805ffed5fb8e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80337,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_249880620cec79e487e50b8d87cfe1d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e20f307-15b9-531c-a295-805ffed5fb8e/1e20f307-15b9-531c-a295-805ffed5fb8e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79436,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_ff46c2e60e87b4bead2b1bc463f130e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e20f307-15b9-531c-a295-805ffed5fb8e/1e20f307-15b9-531c-a295-805ffed5fb8e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69904,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_080b5256bfe294f3e228ddcf84ca824f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e20f307-15b9-531c-a295-805ffed5fb8e/1e20f307-15b9-531c-a295-805ffed5fb8e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66613,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_e890e121f59f9f0d0151cdb43e41e461.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e20f307-15b9-531c-a295-805ffed5fb8e/1e20f307-15b9-531c-a295-805ffed5fb8e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77016,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/e9/23e9f91f5ef896a1bc59bfebb7ff805b/pa/NL56799_26a0fd274b6f382c8cdbfff37ac6b677.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-07-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 206+ 1.1 Trendy',
'transmission': 'manual',
'trim': 'Trendy',
'year': 2010}
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL56799%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.it] INFO: Saving data for NL56799: {'created_time': 1774699270.179125, 'last_price_update_time': 1774699270.179133, 'auction_closing_time': 1774883164.0}
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NL56799') HTTP/1.1" 204 0
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU30300> (referer: https://www.auto1.com/v1/car-details-view/BU30300/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC58161/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB09244/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD34551> (referer: https://www.auto1.com/v1/car-details-view/RD34551/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH77376> (referer: https://www.auto1.com/v1/car-details-view/YH77376/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_1fd30cd7847fc50a5b34bf61e0a5eeea.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1cd8f05-0283-5721-9e25-102d5b042207 with identifier: BU30300
2026-03-28 12:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1cd8f05-0283-5721-9e25-102d5b042207 with scrape type 1
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a1cd8f05-0283-5721-9e25-102d5b042207
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30630b8429a84548ad1648d2ab1add%252Fpa%252FBU30300_f26538546474f5cdc5f3f709485a0373.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30630b8429a84548ad1648d2ab1add/pa/BU30300_f26538546474f5cdc5f3f709485a0373.jpg already downloaded
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30630b8429a84548ad1648d2ab1add%252Fpa%252FBU30300_437787d4d144fd3a9fd4d1e395fedcaa.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30630b8429a84548ad1648d2ab1add/pa/BU30300_437787d4d144fd3a9fd4d1e395fedcaa.jpg already downloaded
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30630b8429a84548ad1648d2ab1add%252Fpa%252FBU30300_8f01201ee8ad212b86c7b0b5883a9053.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30630b8429a84548ad1648d2ab1add/pa/BU30300_8f01201ee8ad212b86c7b0b5883a9053.jpg already downloaded
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30630b8429a84548ad1648d2ab1add%252Fpa%252FBU30300_a068602f26aa9f51c2a15324eb35034e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30630b8429a84548ad1648d2ab1add/pa/BU30300_a068602f26aa9f51c2a15324eb35034e.jpg already downloaded
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F30%252Faa30630b8429a84548ad1648d2ab1add%252Fpa%252FBU30300_1fcacb8e04826668bd7860742cc84ebb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/30/aa30630b8429a84548ad1648d2ab1add/pa/BU30300_1fcacb8e04826668bd7860742cc84ebb.jpg already downloaded
2026-03-28 12:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a1cd8f05-0283-5721-9e25-102d5b042207, identifier: BU30300
2026-03-28 12:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a1cd8f05-0283-5721-9e25-102d5b042207 with identifier: BU30300
2026-03-28 12:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a1cd8f05-0283-5721-9e25-102d5b042207 with identifier: BU30300
2026-03-28 12:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a1cd8f05-0283-5721-9e25-102d5b042207 with identifier: BU30300 to the API
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BU30300>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:12:25Z',
'fuel_type': 'diesel',
'id': 'a1cd8f05-0283-5721-9e25-102d5b042207',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU30300',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Volvo',
'model': 'C30',
'odometer': 196590,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgaa/30/aa30630b8429a84548ad1648d2ab1add/pa/BU30300_f26538546474f5cdc5f3f709485a0373.jpg',
'https://img-pa.auto1.com/imgaa/30/aa30630b8429a84548ad1648d2ab1add/pa/BU30300_437787d4d144fd3a9fd4d1e395fedcaa.jpg',
'https://img-pa.auto1.com/imgaa/30/aa30630b8429a84548ad1648d2ab1add/pa/BU30300_8f01201ee8ad212b86c7b0b5883a9053.jpg',
'https://img-pa.auto1.com/imgaa/30/aa30630b8429a84548ad1648d2ab1add/pa/BU30300_a068602f26aa9f51c2a15324eb35034e.jpg',
'https://img-pa.auto1.com/imgaa/30/aa30630b8429a84548ad1648d2ab1add/pa/BU30300_1fcacb8e04826668bd7860742cc84ebb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cd8f05-0283-5721-9e25-102d5b042207/a1cd8f05-0283-5721-9e25-102d5b042207_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108823,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/30/aa30630b8429a84548ad1648d2ab1add/pa/BU30300_f26538546474f5cdc5f3f709485a0373.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cd8f05-0283-5721-9e25-102d5b042207/a1cd8f05-0283-5721-9e25-102d5b042207_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/30/aa30630b8429a84548ad1648d2ab1add/pa/BU30300_437787d4d144fd3a9fd4d1e395fedcaa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cd8f05-0283-5721-9e25-102d5b042207/a1cd8f05-0283-5721-9e25-102d5b042207_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75741,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/30/aa30630b8429a84548ad1648d2ab1add/pa/BU30300_8f01201ee8ad212b86c7b0b5883a9053.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cd8f05-0283-5721-9e25-102d5b042207/a1cd8f05-0283-5721-9e25-102d5b042207_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/30/aa30630b8429a84548ad1648d2ab1add/pa/BU30300_a068602f26aa9f51c2a15324eb35034e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cd8f05-0283-5721-9e25-102d5b042207/a1cd8f05-0283-5721-9e25-102d5b042207_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/30/aa30630b8429a84548ad1648d2ab1add/pa/BU30300_1fcacb8e04826668bd7860742cc84ebb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-04-11',
'seats_number': 4,
'seller_name': None,
'title': 'Volvo C30 1.6 DRIVe Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2010}
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU30300%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.it] INFO: Saving data for BU30300: {'created_time': 1774699270.867028, 'last_price_update_time': 1774699270.86704, 'auction_closing_time': 1774883545.0}
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BU30300') HTTP/1.1" 204 0
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_2ea81aee3b233e4c7db67d19cf41a57d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_7debe2fa3a6bb2a8be58eb1b4c22e709.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2 with identifier: RD34551
2026-03-28 12:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2 with scrape type 1
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_c82c65bc88b712b57b79c693ff3e2429.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_c82c65bc88b712b57b79c693ff3e2429.jpg not downloaded yet
2026-03-28 12:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f41dd270-0b52-51c5-8e19-140d8dbc8234 with identifier: YH77376
2026-03-28 12:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f41dd270-0b52-51c5-8e19-140d8dbc8234 with scrape type 1
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f41dd270-0b52-51c5-8e19-140d8dbc8234
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_4f0726d1ddb086b7ab8d34c4339963be.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_4f0726d1ddb086b7ab8d34c4339963be.jpg not downloaded yet
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_91d69bf2cc1e06b7af281813069ea9c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_91d69bf2cc1e06b7af281813069ea9c0.jpg not downloaded yet
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_5c51ef0c758dce9a70fc493392d50750.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_5c51ef0c758dce9a70fc493392d50750.jpg not downloaded yet
2026-03-28 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JX99167/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY84618> (referer: https://www.auto1.com/v1/car-details-view/YY84618/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4f9bd0>
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_1fd30cd7847fc50a5b34bf61e0a5eeea.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_1fd30cd7847fc50a5b34bf61e0a5eeea.jpg saved to cache
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3c876ba-8c5c-5a96-b9ef-da114c2fbe33
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_f2c845b6c55e8a59307b5cb3be8f7330.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_f2c845b6c55e8a59307b5cb3be8f7330.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_9931dc970f495139a34b84a7857eb5c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_9931dc970f495139a34b84a7857eb5c5.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_835839f2a3a8ec826d5053689439e6ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_835839f2a3a8ec826d5053689439e6ef.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_e48b781e87323cad6f5dea56529f12c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_e48b781e87323cad6f5dea56529f12c4.jpg not downloaded yet
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca2fa50>
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_2ea81aee3b233e4c7db67d19cf41a57d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_2ea81aee3b233e4c7db67d19cf41a57d.jpg saved to cache
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c960e10>
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_7debe2fa3a6bb2a8be58eb1b4c22e709.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_7debe2fa3a6bb2a8be58eb1b4c22e709.jpg saved to cache
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_03ddbecad3d901b42faffaa807618151.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_03ddbecad3d901b42faffaa807618151.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_035be6143fc1b815a5618079718bd250.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_035be6143fc1b815a5618079718bd250.jpg not downloaded yet
2026-03-28 12:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0a215c5-ced0-5710-902b-4d1eb099193f with identifier: YY84618
2026-03-28 12:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0a215c5-ced0-5710-902b-4d1eb099193f with scrape type 1
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d0a215c5-ced0-5710-902b-4d1eb099193f
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F53%252F0e53db5ea8bec8342189676a4163729d%252Fpa%252FYY84618_aab33d3f08ec5f7b9290facf6b99df37.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_aab33d3f08ec5f7b9290facf6b99df37.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_d4c8a79adc64fb7eec7ffeb87b3bf06e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_d4c8a79adc64fb7eec7ffeb87b3bf06e.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_46d2d1c28892ecddcbe96b679181cd0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_46d2d1c28892ecddcbe96b679181cd0b.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F53%252F0e53db5ea8bec8342189676a4163729d%252Fpa%252FYY84618_614f37b0532ec6c81977b2a1eccfac0e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_614f37b0532ec6c81977b2a1eccfac0e.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_5274bdab40c9f83b300afc85b36d658b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_5274bdab40c9f83b300afc85b36d658b.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_adf39278f00056b0b89174e8126414c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_adf39278f00056b0b89174e8126414c8.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F53%252F0e53db5ea8bec8342189676a4163729d%252Fpa%252FYY84618_667681f371a6318d73265248c926a919.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_667681f371a6318d73265248c926a919.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_53823fc20612aeae80d508b0fc31fdb4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_53823fc20612aeae80d508b0fc31fdb4.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_88eafe30120279ecf81b2bf76b206859.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_88eafe30120279ecf81b2bf76b206859.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F53%252F0e53db5ea8bec8342189676a4163729d%252Fpa%252FYY84618_bd1d6f0ca6960b0103d7f1f6e778a547.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_bd1d6f0ca6960b0103d7f1f6e778a547.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_4520f4c632b5f9e533e1bc1b472f64bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_4520f4c632b5f9e533e1bc1b472f64bb.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_14f5e2700521da26e232fff5c0b164f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_14f5e2700521da26e232fff5c0b164f4.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F53%252F0e53db5ea8bec8342189676a4163729d%252Fpa%252FYY84618_c994ee98cd5d7e1e033a0658127ca52b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_c994ee98cd5d7e1e033a0658127ca52b.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_72cf4f7eb48a7ce8fa21fffd246a331d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_72cf4f7eb48a7ce8fa21fffd246a331d.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_b99c82508d6aa2e1b82c91083c6d3929.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_b99c82508d6aa2e1b82c91083c6d3929.jpg not downloaded yet
2026-03-28 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_4f0726d1ddb086b7ab8d34c4339963be.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_c82c65bc88b712b57b79c693ff3e2429.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7c7e10>
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_4f0726d1ddb086b7ab8d34c4339963be.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_4f0726d1ddb086b7ab8d34c4339963be.jpg saved to cache
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f41dd270-0b52-51c5-8e19-140d8dbc8234
2026-03-28 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_b99c82508d6aa2e1b82c91083c6d3929.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb0afd0>
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_c82c65bc88b712b57b79c693ff3e2429.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_c82c65bc88b712b57b79c693ff3e2429.jpg saved to cache
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2
2026-03-28 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW63690/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_72cf4f7eb48a7ce8fa21fffd246a331d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4efb50>
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_b99c82508d6aa2e1b82c91083c6d3929.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_b99c82508d6aa2e1b82c91083c6d3929.jpg saved to cache
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f41dd270-0b52-51c5-8e19-140d8dbc8234
2026-03-28 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB76167/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:12 [auto1.it] INFO: Channel: 24h | Page: 5 | totalHits: 3672 | hits on page: 40
2026-03-28 12:01:12 [auto1.it] INFO: Found listing with ID: BM48711
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM48711%27 HTTP/1.1" 200 None
2026-03-28 12:01:12 [auto1.it] INFO: Scrape type for BM48711: 2
2026-03-28 12:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4d993f4-bac1-5516-9c79-92a74cc454f3 with identifier: BM48711
2026-03-28 12:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4d993f4-bac1-5516-9c79-92a74cc454f3 with scrape type 2
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4d993f4-bac1-5516-9c79-92a74cc454f3 with scrape type 2
2026-03-28 12:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f4d993f4-bac1-5516-9c79-92a74cc454f3, identifier: BM48711
2026-03-28 12:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f4d993f4-bac1-5516-9c79-92a74cc454f3 with identifier: BM48711
2026-03-28 12:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f4d993f4-bac1-5516-9c79-92a74cc454f3 with identifier: BM48711
2026-03-28 12:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f4d993f4-bac1-5516-9c79-92a74cc454f3 with identifier: BM48711 to the API
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:26:45Z',
'fuel_type': 'diesel',
'id': 'f4d993f4-bac1-5516-9c79-92a74cc454f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM48711',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 98590,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-17',
'seller_name': None,
'title': 'Audi Q3 35 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM48711%27 HTTP/1.1" 200 None
2026-03-28 12:01:12 [auto1.it] INFO: Saving data for BM48711: {'auction_closing_time': 1774884405.0, 'created_time': 1774515668.393744, 'last_price_update_time': 1774699272.479088}
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BM48711') HTTP/1.1" 204 0
2026-03-28 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_c994ee98cd5d7e1e033a0658127ca52b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_4520f4c632b5f9e533e1bc1b472f64bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:12 [auto1.it] INFO: Found listing with ID: NH24051
2026-03-28 12:01:12 [auto1.it] INFO: Found listing with ID: LU93439
2026-03-28 12:01:12 [auto1.it] INFO: Found listing with ID: GC10643
2026-03-28 12:01:12 [auto1.it] INFO: Found listing with ID: SZ93699
2026-03-28 12:01:12 [auto1.it] INFO: Found listing with ID: HD89174
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD89174%27 HTTP/1.1" 200 None
2026-03-28 12:01:12 [auto1.it] INFO: Scrape type for HD89174: 1
2026-03-28 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_14f5e2700521da26e232fff5c0b164f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_bd1d6f0ca6960b0103d7f1f6e778a547.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MX89615/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CK02940/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3e469f50>
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_72cf4f7eb48a7ce8fa21fffd246a331d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_72cf4f7eb48a7ce8fa21fffd246a331d.jpg saved to cache
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2
2026-03-28 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_88eafe30120279ecf81b2bf76b206859.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:12 [auto1.it] INFO: Found listing with ID: LL57465
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL57465%27 HTTP/1.1" 200 None
2026-03-28 12:01:12 [auto1.it] INFO: Scrape type for LL57465: 1
2026-03-28 12:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MR47105> (referer: https://www.auto1.com/v1/car-details-view/MR47105/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ80815/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:12 [auto1.it] INFO: Found listing with ID: SD35651
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD35651%27 HTTP/1.1" 200 None
2026-03-28 12:01:12 [auto1.it] INFO: Scrape type for SD35651: 1
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c963c50>
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a215c5-ced0-5710-902b-4d1eb099193f/d0a215c5-ced0-5710-902b-4d1eb099193f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F53%252F0e53db5ea8bec8342189676a4163729d%252Fpa%252FYY84618_c994ee98cd5d7e1e033a0658127ca52b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_c994ee98cd5d7e1e033a0658127ca52b.jpg saved to cache
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0a215c5-ced0-5710-902b-4d1eb099193f
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4a2dd0>
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_4520f4c632b5f9e533e1bc1b472f64bb.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_4520f4c632b5f9e533e1bc1b472f64bb.jpg saved to cache
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d48f050>
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_14f5e2700521da26e232fff5c0b164f4.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_14f5e2700521da26e232fff5c0b164f4.jpg saved to cache
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f41dd270-0b52-51c5-8e19-140d8dbc8234
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d59ae50>
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a215c5-ced0-5710-902b-4d1eb099193f/d0a215c5-ced0-5710-902b-4d1eb099193f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F53%252F0e53db5ea8bec8342189676a4163729d%252Fpa%252FYY84618_bd1d6f0ca6960b0103d7f1f6e778a547.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_bd1d6f0ca6960b0103d7f1f6e778a547.jpg saved to cache
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0a215c5-ced0-5710-902b-4d1eb099193f
2026-03-28 12:01:12 [auto1.it] INFO: Found listing with ID: VJ26511
2026-03-28 12:01:12 [auto1.it] INFO: Found listing with ID: UM38141
2026-03-28 12:01:12 [auto1.it] INFO: Found listing with ID: XE84016
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE84016%27 HTTP/1.1" 200 None
2026-03-28 12:01:12 [auto1.it] INFO: Scrape type for XE84016: 1
2026-03-28 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_667681f371a6318d73265248c926a919.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_5274bdab40c9f83b300afc85b36d658b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:12 [auto1.it] INFO: Found listing with ID: LD34697
2026-03-28 12:01:12 [auto1.it] INFO: Found listing with ID: NN91424
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN91424%27 HTTP/1.1" 200 None
2026-03-28 12:01:12 [auto1.it] INFO: Scrape type for NN91424: 1
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d679650>
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_88eafe30120279ecf81b2bf76b206859.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_88eafe30120279ecf81b2bf76b206859.jpg saved to cache
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f41dd270-0b52-51c5-8e19-140d8dbc8234
2026-03-28 12:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3853dcf2-1528-5272-be25-521ec1fb25c0 with identifier: MR47105
2026-03-28 12:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3853dcf2-1528-5272-be25-521ec1fb25c0 with scrape type 1
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3853dcf2-1528-5272-be25-521ec1fb25c0
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F01%252Fe10199b92db316a28a0d6b8b0c56dbf7%252Fpa%252FMR47105_0a6a65102abdd0c2d2e6ced426e7c7bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_0a6a65102abdd0c2d2e6ced426e7c7bb.jpg already downloaded
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F01%252Fe10199b92db316a28a0d6b8b0c56dbf7%252Fpa%252FMR47105_e292710209b22e0073db7b68099faba2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_e292710209b22e0073db7b68099faba2.jpg already downloaded
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F01%252Fe10199b92db316a28a0d6b8b0c56dbf7%252Fpa%252FMR47105_0d88e76262f419986dd037ba48205c2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_0d88e76262f419986dd037ba48205c2b.jpg already downloaded
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F01%252Fe10199b92db316a28a0d6b8b0c56dbf7%252Fpa%252FMR47105_522afa39d5bc79b6ad3e5a98fd46cbdf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_522afa39d5bc79b6ad3e5a98fd46cbdf.jpg already downloaded
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F01%252Fe10199b92db316a28a0d6b8b0c56dbf7%252Fpa%252FMR47105_0fddc3aa85e303c433b0048bbd5f06df.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_0fddc3aa85e303c433b0048bbd5f06df.jpg already downloaded
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F01%252Fe10199b92db316a28a0d6b8b0c56dbf7%252Fpa%252FMR47105_2dde75fc0f40a202b9f8d5e7a9244b16.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_2dde75fc0f40a202b9f8d5e7a9244b16.jpg already downloaded
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F01%252Fe10199b92db316a28a0d6b8b0c56dbf7%252Fpa%252FMR47105_314a9d1ef865859ce487da5ab71d3b40.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_314a9d1ef865859ce487da5ab71d3b40.jpg already downloaded
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F01%252Fe10199b92db316a28a0d6b8b0c56dbf7%252Fpa%252FMR47105_01b2dedf5956e854ec89898967215560.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_01b2dedf5956e854ec89898967215560.jpg already downloaded
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F01%252Fe10199b92db316a28a0d6b8b0c56dbf7%252Fpa%252FMR47105_adb13220429737eed9de721746391d6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_adb13220429737eed9de721746391d6a.jpg already downloaded
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F01%252Fe10199b92db316a28a0d6b8b0c56dbf7%252Fpa%252FMR47105_696d99061478f37524f845c15780451a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_696d99061478f37524f845c15780451a.jpg already downloaded
2026-03-28 12:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3853dcf2-1528-5272-be25-521ec1fb25c0, identifier: MR47105
2026-03-28 12:01:13 [auto1.it] INFO: Found listing with ID: JP07987
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP07987%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [auto1.it] INFO: Scrape type for JP07987: 2
2026-03-28 12:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b43d459-6ea4-54df-ae54-b1ced0181a24 with identifier: JP07987
2026-03-28 12:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b43d459-6ea4-54df-ae54-b1ced0181a24 with scrape type 2
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b43d459-6ea4-54df-ae54-b1ced0181a24 with scrape type 2
2026-03-28 12:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2b43d459-6ea4-54df-ae54-b1ced0181a24, identifier: JP07987
2026-03-28 12:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3853dcf2-1528-5272-be25-521ec1fb25c0 with identifier: MR47105
2026-03-28 12:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3853dcf2-1528-5272-be25-521ec1fb25c0 with identifier: MR47105
2026-03-28 12:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3853dcf2-1528-5272-be25-521ec1fb25c0 with identifier: MR47105 to the API
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MR47105>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:27:36Z',
'fuel_type': 'diesel',
'id': '3853dcf2-1528-5272-be25-521ec1fb25c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR47105',
'listing': 'auction',
'location': 'IT, Casoria',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 57506,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_0a6a65102abdd0c2d2e6ced426e7c7bb.jpg',
'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_e292710209b22e0073db7b68099faba2.jpg',
'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_0d88e76262f419986dd037ba48205c2b.jpg',
'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_522afa39d5bc79b6ad3e5a98fd46cbdf.jpg',
'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_0fddc3aa85e303c433b0048bbd5f06df.jpg',
'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_2dde75fc0f40a202b9f8d5e7a9244b16.jpg',
'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_314a9d1ef865859ce487da5ab71d3b40.jpg',
'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_01b2dedf5956e854ec89898967215560.jpg',
'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_adb13220429737eed9de721746391d6a.jpg',
'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_696d99061478f37524f845c15780451a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3853dcf2-1528-5272-be25-521ec1fb25c0/3853dcf2-1528-5272-be25-521ec1fb25c0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_0a6a65102abdd0c2d2e6ced426e7c7bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3853dcf2-1528-5272-be25-521ec1fb25c0/3853dcf2-1528-5272-be25-521ec1fb25c0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75523,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_e292710209b22e0073db7b68099faba2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3853dcf2-1528-5272-be25-521ec1fb25c0/3853dcf2-1528-5272-be25-521ec1fb25c0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2421187,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_0d88e76262f419986dd037ba48205c2b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3853dcf2-1528-5272-be25-521ec1fb25c0/3853dcf2-1528-5272-be25-521ec1fb25c0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2514915,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_522afa39d5bc79b6ad3e5a98fd46cbdf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3853dcf2-1528-5272-be25-521ec1fb25c0/3853dcf2-1528-5272-be25-521ec1fb25c0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_0fddc3aa85e303c433b0048bbd5f06df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3853dcf2-1528-5272-be25-521ec1fb25c0/3853dcf2-1528-5272-be25-521ec1fb25c0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2493773,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_2dde75fc0f40a202b9f8d5e7a9244b16.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3853dcf2-1528-5272-be25-521ec1fb25c0/3853dcf2-1528-5272-be25-521ec1fb25c0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_314a9d1ef865859ce487da5ab71d3b40.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3853dcf2-1528-5272-be25-521ec1fb25c0/3853dcf2-1528-5272-be25-521ec1fb25c0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80111,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_01b2dedf5956e854ec89898967215560.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3853dcf2-1528-5272-be25-521ec1fb25c0/3853dcf2-1528-5272-be25-521ec1fb25c0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2635733,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_adb13220429737eed9de721746391d6a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3853dcf2-1528-5272-be25-521ec1fb25c0/3853dcf2-1528-5272-be25-521ec1fb25c0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2619237,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge1/01/e10199b92db316a28a0d6b8b0c56dbf7/pa/MR47105_696d99061478f37524f845c15780451a.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-03-23',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 Sportback 35 TDI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2022}
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR47105%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [auto1.it] INFO: Saving data for MR47105: {'created_time': 1774699273.707994, 'last_price_update_time': 1774699273.708004, 'auction_closing_time': 1774884456.0}
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MR47105') HTTP/1.1" 204 0
2026-03-28 12:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2b43d459-6ea4-54df-ae54-b1ced0181a24 with identifier: JP07987
2026-03-28 12:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2b43d459-6ea4-54df-ae54-b1ced0181a24 with identifier: JP07987
2026-03-28 12:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2b43d459-6ea4-54df-ae54-b1ced0181a24 with identifier: JP07987 to the API
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 147,
'expiration_date': '2026-03-30T15:50:46Z',
'fuel_type': 'diesel',
'id': '2b43d459-6ea4-54df-ae54-b1ced0181a24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP07987',
'listing': 'auction',
'make': 'Subaru',
'model': 'XV',
'odometer': 160214,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-11',
'seller_name': None,
'title': 'Subaru XV 2.0 Diesel Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2014}
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP07987%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [auto1.it] INFO: Saving data for JP07987: {'auction_closing_time': 1774885846.0, 'created_time': 1773954320.097059, 'last_price_update_time': 1774699275.051241}
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JP07987') HTTP/1.1" 204 0
2026-03-28 12:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_614f37b0532ec6c81977b2a1eccfac0e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:15 [auto1.it] INFO: Found listing with ID: ZM57231
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM57231%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [auto1.it] INFO: Scrape type for ZM57231: 1
2026-03-28 12:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN18335/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f86ba10>
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a215c5-ced0-5710-902b-4d1eb099193f/d0a215c5-ced0-5710-902b-4d1eb099193f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F53%252F0e53db5ea8bec8342189676a4163729d%252Fpa%252FYY84618_667681f371a6318d73265248c926a919.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_667681f371a6318d73265248c926a919.jpg saved to cache
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0a215c5-ced0-5710-902b-4d1eb099193f
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb45890>
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_5274bdab40c9f83b300afc85b36d658b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_5274bdab40c9f83b300afc85b36d658b.jpg saved to cache
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2
2026-03-28 12:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD11089> (referer: https://www.auto1.com/v1/car-details-view/HD11089/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB46951> (referer: https://www.auto1.com/v1/car-details-view/XB46951/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:15 [auto1.it] INFO: Found listing with ID: KG93031
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG93031%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [auto1.it] INFO: Scrape type for KG93031: 1
2026-03-28 12:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:15 [auto1.it] INFO: Found listing with ID: PK33610
2026-03-28 12:01:15 [auto1.it] INFO: Found listing with ID: FL38609
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL38609%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [auto1.it] INFO: Scrape type for FL38609: 1
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c9788d0>
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a215c5-ced0-5710-902b-4d1eb099193f/d0a215c5-ced0-5710-902b-4d1eb099193f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F53%252F0e53db5ea8bec8342189676a4163729d%252Fpa%252FYY84618_614f37b0532ec6c81977b2a1eccfac0e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_614f37b0532ec6c81977b2a1eccfac0e.jpg saved to cache
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0a215c5-ced0-5710-902b-4d1eb099193f
2026-03-28 12:01:15 [auto1.it] INFO: Found listing with ID: PR73005
2026-03-28 12:01:15 [auto1.it] INFO: Found listing with ID: AL33204
2026-03-28 12:01:15 [auto1.it] INFO: Found listing with ID: VU45167
2026-03-28 12:01:15 [auto1.it] INFO: Found listing with ID: YD14292
2026-03-28 12:01:15 [auto1.it] INFO: Found listing with ID: HC79760
2026-03-28 12:01:15 [auto1.it] INFO: Found listing with ID: YJ65230
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ65230%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [auto1.it] INFO: Scrape type for YJ65230: 1
2026-03-28 12:01:15 [auto1.it] INFO: Found listing with ID: AY38539
2026-03-28 12:01:15 [auto1.it] INFO: Found listing with ID: FN08703
2026-03-28 12:01:15 [auto1.it] INFO: Found listing with ID: DK59825
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK59825%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [auto1.it] INFO: Scrape type for DK59825: 1
2026-03-28 12:01:15 [auto1.it] INFO: Found listing with ID: SN64311
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN64311%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [auto1.it] INFO: Scrape type for SN64311: 2
2026-03-28 12:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 781e79b1-d76f-5719-b036-1e0c25fb3b46 with identifier: SN64311
2026-03-28 12:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 781e79b1-d76f-5719-b036-1e0c25fb3b46 with scrape type 2
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 781e79b1-d76f-5719-b036-1e0c25fb3b46 with scrape type 2
2026-03-28 12:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 781e79b1-d76f-5719-b036-1e0c25fb3b46, identifier: SN64311
2026-03-28 12:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9372d4c2-fc03-591b-97b2-dfbdc7099433 with identifier: HD11089
2026-03-28 12:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9372d4c2-fc03-591b-97b2-dfbdc7099433 with scrape type 1
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9372d4c2-fc03-591b-97b2-dfbdc7099433
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F91%252F3d915e91be956e26e6f33896f9f50787%252Fpa%252FHD11089_47905c6fed004eb6e78bf065da4c90fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_47905c6fed004eb6e78bf065da4c90fd.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F91%252F3d915e91be956e26e6f33896f9f50787%252Fpa%252FHD11089_19c7d49ae9dfe82bcfd9d893422e131f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_19c7d49ae9dfe82bcfd9d893422e131f.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F91%252F3d915e91be956e26e6f33896f9f50787%252Fpa%252FHD11089_26e79064a7962f7a9935649adcf82d49.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_26e79064a7962f7a9935649adcf82d49.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F91%252F3d915e91be956e26e6f33896f9f50787%252Fpa%252FHD11089_f84ab6baebc104fe4f1513b7dd422041.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_f84ab6baebc104fe4f1513b7dd422041.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F91%252F3d915e91be956e26e6f33896f9f50787%252Fpa%252FHD11089_52f95ea5cac1b8a1dbb47574a03b8b08.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_52f95ea5cac1b8a1dbb47574a03b8b08.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F91%252F3d915e91be956e26e6f33896f9f50787%252Fpa%252FHD11089_e0a6446554a3438927379c17a74062ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_e0a6446554a3438927379c17a74062ec.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F91%252F3d915e91be956e26e6f33896f9f50787%252Fpa%252FHD11089_2b440b257cd324e2fc4dd0ba05070623.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_2b440b257cd324e2fc4dd0ba05070623.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F91%252F3d915e91be956e26e6f33896f9f50787%252Fpa%252FHD11089_64a09da11492d4ad36a344c75c8175f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_64a09da11492d4ad36a344c75c8175f3.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F91%252F3d915e91be956e26e6f33896f9f50787%252Fpa%252FHD11089_55e02b4c9dedae32fef93fdf6d107133.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_55e02b4c9dedae32fef93fdf6d107133.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F91%252F3d915e91be956e26e6f33896f9f50787%252Fpa%252FHD11089_c77ccd526aa993a9e310b2e39a116793.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_c77ccd526aa993a9e310b2e39a116793.jpg already downloaded
2026-03-28 12:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9372d4c2-fc03-591b-97b2-dfbdc7099433, identifier: HD11089
2026-03-28 12:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b52ffbd-4768-59aa-9108-bca596d396f5 with identifier: XB46951
2026-03-28 12:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b52ffbd-4768-59aa-9108-bca596d396f5 with scrape type 1
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b52ffbd-4768-59aa-9108-bca596d396f5
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F62%252F0f62aa749d589c2891accb8e6e299aad%252Fpa%252FXB46951_c510b60770cdb7d715ea43768a76dfda.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_c510b60770cdb7d715ea43768a76dfda.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F62%252F0f62aa749d589c2891accb8e6e299aad%252Fpa%252FXB46951_a542cc8748538e3183ef8a01041bc9b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_a542cc8748538e3183ef8a01041bc9b1.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F62%252F0f62aa749d589c2891accb8e6e299aad%252Fpa%252FXB46951_b654192eed8769b60b810859ef53185b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_b654192eed8769b60b810859ef53185b.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F62%252F0f62aa749d589c2891accb8e6e299aad%252Fpa%252FXB46951_5f58ef02741efa094063c7216ab122db.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_5f58ef02741efa094063c7216ab122db.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F62%252F0f62aa749d589c2891accb8e6e299aad%252Fpa%252FXB46951_a1c1c77af76874ea1be6632172884f40.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_a1c1c77af76874ea1be6632172884f40.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F62%252F0f62aa749d589c2891accb8e6e299aad%252Fpa%252FXB46951_643ea13d804e4279e2673e40d87a21eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_643ea13d804e4279e2673e40d87a21eb.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F62%252F0f62aa749d589c2891accb8e6e299aad%252Fpa%252FXB46951_5e16f44909b6da7ac2cba35ba34c5182.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_5e16f44909b6da7ac2cba35ba34c5182.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F62%252F0f62aa749d589c2891accb8e6e299aad%252Fpa%252FXB46951_8b8c4ef0b30995fc641c529ae63b037a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_8b8c4ef0b30995fc641c529ae63b037a.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F62%252F0f62aa749d589c2891accb8e6e299aad%252Fpa%252FXB46951_6a1caeba2f97e1851d5ba4b052abf1b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_6a1caeba2f97e1851d5ba4b052abf1b3.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F62%252F0f62aa749d589c2891accb8e6e299aad%252Fpa%252FXB46951_a3e28a1964fee33b0d9f6625f9b49322.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_a3e28a1964fee33b0d9f6625f9b49322.jpg already downloaded
2026-03-28 12:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1b52ffbd-4768-59aa-9108-bca596d396f5, identifier: XB46951
2026-03-28 12:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 781e79b1-d76f-5719-b036-1e0c25fb3b46 with identifier: SN64311
2026-03-28 12:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 781e79b1-d76f-5719-b036-1e0c25fb3b46 with identifier: SN64311
2026-03-28 12:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 781e79b1-d76f-5719-b036-1e0c25fb3b46 with identifier: SN64311 to the API
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:33:49Z',
'fuel_type': 'diesel',
'id': '781e79b1-d76f-5719-b036-1e0c25fb3b46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN64311',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 87122,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-30',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Energy Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2018}
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN64311%27 HTTP/1.1" 200 None
2026-03-28 12:01:16 [auto1.it] INFO: Saving data for SN64311: {'auction_closing_time': 1774884829.0, 'created_time': 1774440177.363034, 'last_price_update_time': 1774699276.467036}
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SN64311') HTTP/1.1" 204 0
2026-03-28 12:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9372d4c2-fc03-591b-97b2-dfbdc7099433 with identifier: HD11089
2026-03-28 12:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9372d4c2-fc03-591b-97b2-dfbdc7099433 with identifier: HD11089
2026-03-28 12:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9372d4c2-fc03-591b-97b2-dfbdc7099433 with identifier: HD11089 to the API
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HD11089>
{'auction_title': '',
'c_o_2_emission_value': 98,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.2L',
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:32:13Z',
'fuel_type': 'petrol',
'id': '9372d4c2-fc03-591b-97b2-dfbdc7099433',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD11089',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Suzuki',
'model': 'Ignis',
'odometer': 33301,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_47905c6fed004eb6e78bf065da4c90fd.jpg',
'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_19c7d49ae9dfe82bcfd9d893422e131f.jpg',
'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_26e79064a7962f7a9935649adcf82d49.jpg',
'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_f84ab6baebc104fe4f1513b7dd422041.jpg',
'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_52f95ea5cac1b8a1dbb47574a03b8b08.jpg',
'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_e0a6446554a3438927379c17a74062ec.jpg',
'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_2b440b257cd324e2fc4dd0ba05070623.jpg',
'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_64a09da11492d4ad36a344c75c8175f3.jpg',
'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_55e02b4c9dedae32fef93fdf6d107133.jpg',
'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_c77ccd526aa993a9e310b2e39a116793.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9372d4c2-fc03-591b-97b2-dfbdc7099433/9372d4c2-fc03-591b-97b2-dfbdc7099433_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85404,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_47905c6fed004eb6e78bf065da4c90fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9372d4c2-fc03-591b-97b2-dfbdc7099433/9372d4c2-fc03-591b-97b2-dfbdc7099433_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80768,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_19c7d49ae9dfe82bcfd9d893422e131f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9372d4c2-fc03-591b-97b2-dfbdc7099433/9372d4c2-fc03-591b-97b2-dfbdc7099433_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_26e79064a7962f7a9935649adcf82d49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9372d4c2-fc03-591b-97b2-dfbdc7099433/9372d4c2-fc03-591b-97b2-dfbdc7099433_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_f84ab6baebc104fe4f1513b7dd422041.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9372d4c2-fc03-591b-97b2-dfbdc7099433/9372d4c2-fc03-591b-97b2-dfbdc7099433_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74677,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_52f95ea5cac1b8a1dbb47574a03b8b08.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9372d4c2-fc03-591b-97b2-dfbdc7099433/9372d4c2-fc03-591b-97b2-dfbdc7099433_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_e0a6446554a3438927379c17a74062ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9372d4c2-fc03-591b-97b2-dfbdc7099433/9372d4c2-fc03-591b-97b2-dfbdc7099433_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_2b440b257cd324e2fc4dd0ba05070623.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9372d4c2-fc03-591b-97b2-dfbdc7099433/9372d4c2-fc03-591b-97b2-dfbdc7099433_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86540,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_64a09da11492d4ad36a344c75c8175f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9372d4c2-fc03-591b-97b2-dfbdc7099433/9372d4c2-fc03-591b-97b2-dfbdc7099433_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_55e02b4c9dedae32fef93fdf6d107133.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9372d4c2-fc03-591b-97b2-dfbdc7099433/9372d4c2-fc03-591b-97b2-dfbdc7099433_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74869,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/91/3d915e91be956e26e6f33896f9f50787/pa/HD11089_c77ccd526aa993a9e310b2e39a116793.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-24',
'seats_number': 4,
'seller_name': None,
'title': 'Suzuki Ignis 1.2 DualJet SHVS ITop',
'transmission': 'manual',
'trim': 'ITop',
'year': 2019}
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD11089%27 HTTP/1.1" 200 None
2026-03-28 12:01:16 [auto1.it] INFO: Saving data for HD11089: {'created_time': 1774699276.921919, 'last_price_update_time': 1774699276.921932, 'auction_closing_time': 1774884733.0}
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HD11089') HTTP/1.1" 204 0
2026-03-28 12:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1b52ffbd-4768-59aa-9108-bca596d396f5 with identifier: XB46951
2026-03-28 12:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1b52ffbd-4768-59aa-9108-bca596d396f5 with identifier: XB46951
2026-03-28 12:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1b52ffbd-4768-59aa-9108-bca596d396f5 with identifier: XB46951 to the API
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XB46951>
{'auction_title': '',
'c_o_2_emission_value': 163,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.1L',
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:30:26Z',
'fuel_type': 'diesel',
'id': '1b52ffbd-4768-59aa-9108-bca596d396f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB46951',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Mercedes-Benz',
'model': 'M-Klasse',
'odometer': 183279,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_c510b60770cdb7d715ea43768a76dfda.jpg',
'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_a542cc8748538e3183ef8a01041bc9b1.jpg',
'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_b654192eed8769b60b810859ef53185b.jpg',
'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_5f58ef02741efa094063c7216ab122db.jpg',
'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_a1c1c77af76874ea1be6632172884f40.jpg',
'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_643ea13d804e4279e2673e40d87a21eb.jpg',
'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_5e16f44909b6da7ac2cba35ba34c5182.jpg',
'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_8b8c4ef0b30995fc641c529ae63b037a.jpg',
'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_6a1caeba2f97e1851d5ba4b052abf1b3.jpg',
'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_a3e28a1964fee33b0d9f6625f9b49322.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b52ffbd-4768-59aa-9108-bca596d396f5/1b52ffbd-4768-59aa-9108-bca596d396f5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_c510b60770cdb7d715ea43768a76dfda.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b52ffbd-4768-59aa-9108-bca596d396f5/1b52ffbd-4768-59aa-9108-bca596d396f5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3069414,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_a542cc8748538e3183ef8a01041bc9b1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b52ffbd-4768-59aa-9108-bca596d396f5/1b52ffbd-4768-59aa-9108-bca596d396f5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_b654192eed8769b60b810859ef53185b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b52ffbd-4768-59aa-9108-bca596d396f5/1b52ffbd-4768-59aa-9108-bca596d396f5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_5f58ef02741efa094063c7216ab122db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b52ffbd-4768-59aa-9108-bca596d396f5/1b52ffbd-4768-59aa-9108-bca596d396f5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2979438,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_a1c1c77af76874ea1be6632172884f40.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b52ffbd-4768-59aa-9108-bca596d396f5/1b52ffbd-4768-59aa-9108-bca596d396f5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_643ea13d804e4279e2673e40d87a21eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b52ffbd-4768-59aa-9108-bca596d396f5/1b52ffbd-4768-59aa-9108-bca596d396f5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67797,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_5e16f44909b6da7ac2cba35ba34c5182.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b52ffbd-4768-59aa-9108-bca596d396f5/1b52ffbd-4768-59aa-9108-bca596d396f5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3055053,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_8b8c4ef0b30995fc641c529ae63b037a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b52ffbd-4768-59aa-9108-bca596d396f5/1b52ffbd-4768-59aa-9108-bca596d396f5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65975,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_6a1caeba2f97e1851d5ba4b052abf1b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b52ffbd-4768-59aa-9108-bca596d396f5/1b52ffbd-4768-59aa-9108-bca596d396f5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3163967,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0f/62/0f62aa749d589c2891accb8e6e299aad/pa/XB46951_a3e28a1964fee33b0d9f6625f9b49322.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-04-23',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz M-Klasse ML 250 CDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2015}
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB46951%27 HTTP/1.1" 200 None
2026-03-28 12:01:17 [auto1.it] INFO: Saving data for XB46951: {'created_time': 1774699277.359886, 'last_price_update_time': 1774699277.359901, 'auction_closing_time': 1774884626.0}
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XB46951') HTTP/1.1" 204 0
2026-03-28 12:01:17 [auto1.it] INFO: Found listing with ID: WA74903
2026-03-28 12:01:17 [auto1.it] INFO: Found listing with ID: JD08634
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD08634%27 HTTP/1.1" 200 None
2026-03-28 12:01:17 [auto1.it] INFO: Scrape type for JD08634: 1
2026-03-28 12:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RJ05786> (referer: https://www.auto1.com/v1/car-details-view/RJ05786/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC58161> (referer: https://www.auto1.com/v1/car-details-view/JC58161/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZX07478/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:17 [auto1.it] INFO: Found listing with ID: NV36405
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV36405%27 HTTP/1.1" 200 None
2026-03-28 12:01:17 [auto1.it] INFO: Scrape type for NV36405: 2
2026-03-28 12:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e810fa1-7281-5127-b403-6f6c4b7b4b7d with identifier: NV36405
2026-03-28 12:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e810fa1-7281-5127-b403-6f6c4b7b4b7d with scrape type 2
2026-03-28 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e810fa1-7281-5127-b403-6f6c4b7b4b7d with scrape type 2
2026-03-28 12:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5e810fa1-7281-5127-b403-6f6c4b7b4b7d, identifier: NV36405
2026-03-28 12:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5e810fa1-7281-5127-b403-6f6c4b7b4b7d with identifier: NV36405
2026-03-28 12:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5e810fa1-7281-5127-b403-6f6c4b7b4b7d with identifier: NV36405
2026-03-28 12:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5e810fa1-7281-5127-b403-6f6c4b7b4b7d with identifier: NV36405 to the API
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:13:07Z',
'fuel_type': 'petrol',
'id': '5e810fa1-7281-5127-b403-6f6c4b7b4b7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV36405',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 167900,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-21',
'seller_name': None,
'title': 'Opel Astra 1.0 Elective Start/Stop',
'transmission': 'manual',
'trim': 'Elective Start/Stop',
'year': 2015}
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV36405%27 HTTP/1.1" 200 None
2026-03-28 12:01:17 [auto1.it] INFO: Saving data for NV36405: {'auction_closing_time': 1774883587.0, 'created_time': 1774342927.805636, 'last_price_update_time': 1774699277.919716}
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NV36405') HTTP/1.1" 204 0
2026-03-28 12:01:17 [auto1.it] INFO: Found listing with ID: EY62872
2026-03-28 12:01:17 [auto1.it] INFO: Found listing with ID: RX99129
2026-03-28 12:01:17 [auto1.it] INFO: Found listing with ID: MT10040
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT10040%27 HTTP/1.1" 200 None
2026-03-28 12:01:17 [auto1.it] INFO: Scrape type for MT10040: 1
2026-03-28 12:01:17 [auto1.it] INFO: Found listing with ID: DE88474
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE88474%27 HTTP/1.1" 200 None
2026-03-28 12:01:17 [auto1.it] INFO: Scrape type for DE88474: 1
2026-03-28 12:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da8eb7aa-12af-5d7c-90dc-81d2515a736d with identifier: RJ05786
2026-03-28 12:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da8eb7aa-12af-5d7c-90dc-81d2515a736d with scrape type 1
2026-03-28 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item da8eb7aa-12af-5d7c-90dc-81d2515a736d
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F69%252F93690fe6eb3a38af13497f4b03825468%252Fpa%252FRJ05786_516a9328f4a312cef8152260624d12d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_516a9328f4a312cef8152260624d12d9.jpg already downloaded
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F69%252F93690fe6eb3a38af13497f4b03825468%252Fpa%252FRJ05786_a585015cf980e4a7bd163da718926c8e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_a585015cf980e4a7bd163da718926c8e.jpg already downloaded
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F69%252F93690fe6eb3a38af13497f4b03825468%252Fpa%252FRJ05786_80ce8115105697a434f354537358c0d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_80ce8115105697a434f354537358c0d2.jpg already downloaded
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F69%252F93690fe6eb3a38af13497f4b03825468%252Fpa%252FRJ05786_34884abb4169388f69cce0b29855c9aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_34884abb4169388f69cce0b29855c9aa.jpg already downloaded
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F69%252F93690fe6eb3a38af13497f4b03825468%252Fpa%252FRJ05786_8bdca708cc45ca6e96f994ddff120460.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_8bdca708cc45ca6e96f994ddff120460.jpg already downloaded
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F69%252F93690fe6eb3a38af13497f4b03825468%252Fpa%252FRJ05786_f8575873a773439c3cc5844d609525d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_f8575873a773439c3cc5844d609525d9.jpg already downloaded
2026-03-28 12:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: da8eb7aa-12af-5d7c-90dc-81d2515a736d, identifier: RJ05786
2026-03-28 12:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b2331b2-bba6-56f9-b66a-9e6924ff7f48 with identifier: JC58161
2026-03-28 12:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b2331b2-bba6-56f9-b66a-9e6924ff7f48 with scrape type 1
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0b2331b2-bba6-56f9-b66a-9e6924ff7f48
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_778e72ca04e4cfe9baa5fcb91dde2085.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_778e72ca04e4cfe9baa5fcb91dde2085.jpg not downloaded yet
2026-03-28 12:01:18 [auto1.it] INFO: Channel: 24h | Page: 6 | totalHits: 3672 | hits on page: 40
2026-03-28 12:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: da8eb7aa-12af-5d7c-90dc-81d2515a736d with identifier: RJ05786
2026-03-28 12:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: da8eb7aa-12af-5d7c-90dc-81d2515a736d with identifier: RJ05786
2026-03-28 12:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: da8eb7aa-12af-5d7c-90dc-81d2515a736d with identifier: RJ05786 to the API
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RJ05786>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:00:17Z',
'fuel_type': 'diesel',
'id': 'da8eb7aa-12af-5d7c-90dc-81d2515a736d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ05786',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Renault',
'model': 'Scenic',
'odometer': 163618,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_516a9328f4a312cef8152260624d12d9.jpg',
'https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_a585015cf980e4a7bd163da718926c8e.jpg',
'https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_80ce8115105697a434f354537358c0d2.jpg',
'https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_34884abb4169388f69cce0b29855c9aa.jpg',
'https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_8bdca708cc45ca6e96f994ddff120460.jpg',
'https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_f8575873a773439c3cc5844d609525d9.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da8eb7aa-12af-5d7c-90dc-81d2515a736d/da8eb7aa-12af-5d7c-90dc-81d2515a736d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75677,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_516a9328f4a312cef8152260624d12d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da8eb7aa-12af-5d7c-90dc-81d2515a736d/da8eb7aa-12af-5d7c-90dc-81d2515a736d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73943,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_a585015cf980e4a7bd163da718926c8e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da8eb7aa-12af-5d7c-90dc-81d2515a736d/da8eb7aa-12af-5d7c-90dc-81d2515a736d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_80ce8115105697a434f354537358c0d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da8eb7aa-12af-5d7c-90dc-81d2515a736d/da8eb7aa-12af-5d7c-90dc-81d2515a736d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92149,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_34884abb4169388f69cce0b29855c9aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da8eb7aa-12af-5d7c-90dc-81d2515a736d/da8eb7aa-12af-5d7c-90dc-81d2515a736d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83138,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_8bdca708cc45ca6e96f994ddff120460.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da8eb7aa-12af-5d7c-90dc-81d2515a736d/da8eb7aa-12af-5d7c-90dc-81d2515a736d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101416,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/69/93690fe6eb3a38af13497f4b03825468/pa/RJ05786_f8575873a773439c3cc5844d609525d9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-04-11',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi XMod Wave',
'transmission': 'manual',
'trim': 'XMod Wave',
'year': 2013}
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ05786%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.it] INFO: Saving data for RJ05786: {'created_time': 1774699278.517303, 'last_price_update_time': 1774699278.517311, 'auction_closing_time': 1774882817.0}
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RJ05786') HTTP/1.1" 204 0
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: FC40925
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC40925%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.it] INFO: Scrape type for FC40925: 0
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: LB90809
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB90809%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.it] INFO: Scrape type for LB90809: 1
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_64fe4b75aef3259df00d31b90f313be9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_64fe4b75aef3259df00d31b90f313be9.jpg not downloaded yet
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: EW38815
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: RC51898
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: RL93891
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL93891%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.it] INFO: Scrape type for RL93891: 1
2026-03-28 12:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD89174/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW63690> (referer: https://www.auto1.com/v1/car-details-view/NW63690/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: EU57494
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: EG76959
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: BV97003
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV97003%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.it] INFO: Scrape type for BV97003: 1
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_fb60efb49e5a2deb257ecf5b12888b6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_fb60efb49e5a2deb257ecf5b12888b6d.jpg not downloaded yet
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: EX32240
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: SC52671
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC52671%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.it] INFO: Scrape type for SC52671: 1
2026-03-28 12:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ66288> (referer: https://www.auto1.com/v1/car-details-view/NZ66288/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_adf39278f00056b0b89174e8126414c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_c9b3864c1e3c61fb3b5f9085fb95d63f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_c9b3864c1e3c61fb3b5f9085fb95d63f.jpg not downloaded yet
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: ZD86423
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: FJ00600
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ00600%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.it] INFO: Scrape type for FJ00600: 1
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_afa96310fe9edc81a76902d567640ce7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_afa96310fe9edc81a76902d567640ce7.jpg not downloaded yet
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: GD51545
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: HC77212
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC77212%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.it] INFO: Scrape type for HC77212: 1
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_dc2c65c2e9e0cc3f0655012a8c07cf92.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_dc2c65c2e9e0cc3f0655012a8c07cf92.jpg not downloaded yet
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: UD61440
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: EP46313
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: NB70789
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: ZF56836
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF56836%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.it] INFO: Scrape type for ZF56836: 1
2026-03-28 12:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d832aa8-d665-54b0-a41e-39953f141455 with identifier: NW63690
2026-03-28 12:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d832aa8-d665-54b0-a41e-39953f141455 with scrape type 1
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9d832aa8-d665-54b0-a41e-39953f141455
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fbe%252F14bedd6dbde45625f5c100caee65851b%252Fpa%252FNW63690_70eed1bfd21b16e49ae1ea7106358e48.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_70eed1bfd21b16e49ae1ea7106358e48.jpg not downloaded yet
2026-03-28 12:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_53823fc20612aeae80d508b0fc31fdb4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_29903c980c6caf5b341067f3db3f3268.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_29903c980c6caf5b341067f3db3f3268.jpg not downloaded yet
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: LS68308
2026-03-28 12:01:18 [auto1.it] INFO: Found listing with ID: LX14349
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX14349%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.it] INFO: Scrape type for LX14349: 1
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fbe%252F14bedd6dbde45625f5c100caee65851b%252Fpa%252FNW63690_e28076736df3b2b91f76e8c04a5142bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_e28076736df3b2b91f76e8c04a5142bb.jpg not downloaded yet
2026-03-28 12:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d24e46a-4936-5251-973c-958aa2ab4326 with identifier: NZ66288
2026-03-28 12:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d24e46a-4936-5251-973c-958aa2ab4326 with scrape type 1
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d24e46a-4936-5251-973c-958aa2ab4326
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_287eb1f0bc990689305a99dbd3b3cf37.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_287eb1f0bc990689305a99dbd3b3cf37.jpg not downloaded yet
2026-03-28 12:01:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6b2fd0>
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_adf39278f00056b0b89174e8126414c8.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_adf39278f00056b0b89174e8126414c8.jpg saved to cache
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f41dd270-0b52-51c5-8e19-140d8dbc8234
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_42ead4553d68c94a5bb37f7a48c576ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_42ead4553d68c94a5bb37f7a48c576ba.jpg not downloaded yet
2026-03-28 12:01:19 [auto1.it] INFO: Found listing with ID: HU17700
2026-03-28 12:01:19 [auto1.it] INFO: Found listing with ID: XB86450
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB86450%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [auto1.it] INFO: Scrape type for XB86450: 1
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fbe%252F14bedd6dbde45625f5c100caee65851b%252Fpa%252FNW63690_04fd180dbc444ddc05aba21b795ecb8e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_04fd180dbc444ddc05aba21b795ecb8e.jpg not downloaded yet
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_9bf7e27dc411a21bea953ed63214accc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_9bf7e27dc411a21bea953ed63214accc.jpg not downloaded yet
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_ba6b33877cd9b2708d4e8ffd3d9b8a16.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_ba6b33877cd9b2708d4e8ffd3d9b8a16.jpg not downloaded yet
2026-03-28 12:01:19 [auto1.it] INFO: Found listing with ID: BC13106
2026-03-28 12:01:19 [auto1.it] INFO: Found listing with ID: SS75136
2026-03-28 12:01:19 [auto1.it] INFO: Found listing with ID: TZ08821
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ08821%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [auto1.it] INFO: Scrape type for TZ08821: 1
2026-03-28 12:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB76167> (referer: https://www.auto1.com/v1/car-details-view/HB76167/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XE84016/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbd3d50>
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_53823fc20612aeae80d508b0fc31fdb4.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_53823fc20612aeae80d508b0fc31fdb4.jpg saved to cache
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fbe%252F14bedd6dbde45625f5c100caee65851b%252Fpa%252FNW63690_9778677d7e35af8f6265dcaddc8c2262.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_9778677d7e35af8f6265dcaddc8c2262.jpg not downloaded yet
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_95b145af78001062e5ae02f77c9882e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_95b145af78001062e5ae02f77c9882e9.jpg not downloaded yet
2026-03-28 12:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_feefb250c658a093814f401d96a3ab3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_feefb250c658a093814f401d96a3ab3b.jpg not downloaded yet
2026-03-28 12:01:19 [auto1.it] INFO: Found listing with ID: FW12151
2026-03-28 12:01:19 [auto1.it] INFO: Found listing with ID: SD66994
2026-03-28 12:01:19 [auto1.it] INFO: Found listing with ID: LB50046
2026-03-28 12:01:19 [auto1.it] INFO: Found listing with ID: NL74097
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL74097%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [auto1.it] INFO: Scrape type for NL74097: 1
2026-03-28 12:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_70eed1bfd21b16e49ae1ea7106358e48.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fbe%252F14bedd6dbde45625f5c100caee65851b%252Fpa%252FNW63690_63700bb1f76003e3ad88eb083eddc6df.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_63700bb1f76003e3ad88eb083eddc6df.jpg not downloaded yet
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_41c068d1ed39abcd6f7eebd227edf95b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_41c068d1ed39abcd6f7eebd227edf95b.jpg not downloaded yet
2026-03-28 12:01:19 [auto1.it] INFO: Found listing with ID: ME27860
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME27860%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [auto1.it] INFO: Scrape type for ME27860: 1
2026-03-28 12:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e5922e0-4510-5fd3-9a45-9d86124bf86e with identifier: HB76167
2026-03-28 12:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e5922e0-4510-5fd3-9a45-9d86124bf86e with scrape type 1
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e5922e0-4510-5fd3-9a45-9d86124bf86e
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_e18b00df4ae5457b369536c1142a35c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_e18b00df4ae5457b369536c1142a35c7.jpg not downloaded yet
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_8c6372639dfc7fbdc6ec898a0f854256.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_8c6372639dfc7fbdc6ec898a0f854256.jpg not downloaded yet
2026-03-28 12:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM57231/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:19 [auto1.it] INFO: Found listing with ID: MX93098
2026-03-28 12:01:19 [auto1.it] INFO: Found listing with ID: CL75380
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL75380%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [auto1.it] INFO: Scrape type for CL75380: 2
2026-03-28 12:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56366ba7-d841-5605-9a0c-442f58f55386 with identifier: CL75380
2026-03-28 12:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56366ba7-d841-5605-9a0c-442f58f55386 with scrape type 2
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56366ba7-d841-5605-9a0c-442f58f55386 with scrape type 2
2026-03-28 12:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 56366ba7-d841-5605-9a0c-442f58f55386, identifier: CL75380
2026-03-28 12:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_a8186f5fccf870d068248e52367f628c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_a8186f5fccf870d068248e52367f628c.jpg not downloaded yet
2026-03-28 12:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ80815> (referer: https://www.auto1.com/v1/car-details-view/CZ80815/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 56366ba7-d841-5605-9a0c-442f58f55386 with identifier: CL75380
2026-03-28 12:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 56366ba7-d841-5605-9a0c-442f58f55386 with identifier: CL75380
2026-03-28 12:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 56366ba7-d841-5605-9a0c-442f58f55386 with identifier: CL75380 to the API
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 250,
'expiration_date': '2026-03-30T15:37:05Z',
'fuel_type': 'diesel',
'id': '56366ba7-d841-5605-9a0c-442f58f55386',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL75380',
'listing': 'auction',
'make': 'Jeep',
'model': 'Grand Cherokee',
'odometer': 161598,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-26',
'seller_name': None,
'title': 'Jeep Grand Cherokee 3.0 CRD Summit',
'transmission': 'automatic',
'trim': 'Summit',
'year': 2018}
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL75380%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [auto1.it] INFO: Saving data for CL75380: {'auction_closing_time': 1774885025.0, 'created_time': 1773954616.300883, 'last_price_update_time': 1774699279.916456}
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CL75380') HTTP/1.1" 204 0
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_b960add7f0fe6f515d56ca76fa64b99a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_b960add7f0fe6f515d56ca76fa64b99a.jpg not downloaded yet
2026-03-28 12:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_95b145af78001062e5ae02f77c9882e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:20 [auto1.it] INFO: Found listing with ID: VK29965
2026-03-28 12:01:20 [auto1.it] INFO: Found listing with ID: WG00273
2026-03-28 12:01:20 [auto1.it] INFO: Found listing with ID: BX84836
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX84836%27 HTTP/1.1" 200 None
2026-03-28 12:01:20 [auto1.it] INFO: Scrape type for BX84836: 1
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_a958c2c2567674a71810cf5d0428a0a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_a958c2c2567674a71810cf5d0428a0a9.jpg not downloaded yet
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca3e590>
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d832aa8-d665-54b0-a41e-39953f141455/9d832aa8-d665-54b0-a41e-39953f141455_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fbe%252F14bedd6dbde45625f5c100caee65851b%252Fpa%252FNW63690_70eed1bfd21b16e49ae1ea7106358e48.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_70eed1bfd21b16e49ae1ea7106358e48.jpg saved to cache
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d832aa8-d665-54b0-a41e-39953f141455
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_04fd180dbc444ddc05aba21b795ecb8e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_40219bd20f5be6737604909c24a20509.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_40219bd20f5be6737604909c24a20509.jpg not downloaded yet
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CK02940> (referer: https://www.auto1.com/v1/car-details-view/CK02940/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:20 [auto1.it] INFO: Found listing with ID: ZH45027
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH45027%27 HTTP/1.1" 200 None
2026-03-28 12:01:20 [auto1.it] INFO: Scrape type for ZH45027: 1
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_21889b7d44bae0ce8c2a47d38b769971.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_21889b7d44bae0ce8c2a47d38b769971.jpg not downloaded yet
2026-03-28 12:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MX89615> (referer: https://www.auto1.com/v1/car-details-view/MX89615/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN91424/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD08634/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c09ea6e-ff64-5664-85a8-60dcb96f4be4 with identifier: CZ80815
2026-03-28 12:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c09ea6e-ff64-5664-85a8-60dcb96f4be4 with scrape type 1
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3c09ea6e-ff64-5664-85a8-60dcb96f4be4
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f5b8747fb7b63b18ade81cd52237a2%252Fpa%252FCZ80815_e464b6443e1b884a0f084af48bab0ee9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_e464b6443e1b884a0f084af48bab0ee9.jpg not downloaded yet
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_8c6372639dfc7fbdc6ec898a0f854256.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_d9feec1273b2c785c397435532ba0fd7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_d9feec1273b2c785c397435532ba0fd7.jpg not downloaded yet
2026-03-28 12:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:20 [auto1.it] INFO: Found listing with ID: CD24058
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD24058%27 HTTP/1.1" 200 None
2026-03-28 12:01:20 [auto1.it] INFO: Scrape type for CD24058: 2
2026-03-28 12:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47531449-8920-5177-8619-224819104fa1 with identifier: CD24058
2026-03-28 12:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47531449-8920-5177-8619-224819104fa1 with scrape type 2
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47531449-8920-5177-8619-224819104fa1 with scrape type 2
2026-03-28 12:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 47531449-8920-5177-8619-224819104fa1, identifier: CD24058
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_89ff3c046f7c77c4a36f17a24ab350ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_89ff3c046f7c77c4a36f17a24ab350ce.jpg not downloaded yet
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f5b8747fb7b63b18ade81cd52237a2%252Fpa%252FCZ80815_9fd26cbe2f7d943de5a22239c145b302.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_9fd26cbe2f7d943de5a22239c145b302.jpg not downloaded yet
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d483850>
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_95b145af78001062e5ae02f77c9882e9.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_95b145af78001062e5ae02f77c9882e9.jpg saved to cache
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d24e46a-4936-5251-973c-958aa2ab4326
2026-03-28 12:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 47531449-8920-5177-8619-224819104fa1 with identifier: CD24058
2026-03-28 12:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 47531449-8920-5177-8619-224819104fa1 with identifier: CD24058
2026-03-28 12:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 47531449-8920-5177-8619-224819104fa1 with identifier: CD24058 to the API
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:09:51Z',
'fuel_type': 'petrol',
'id': '47531449-8920-5177-8619-224819104fa1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD24058',
'listing': 'auction',
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 155448,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-26',
'seller_name': None,
'title': 'Lancia Ypsilon 1.2 Gold',
'transmission': 'manual',
'trim': 'Gold',
'year': 2014}
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD24058%27 HTTP/1.1" 200 None
2026-03-28 12:01:20 [auto1.it] INFO: Saving data for CD24058: {'auction_closing_time': 1774883391.0, 'created_time': 1773954488.419402, 'last_price_update_time': 1774699280.90025}
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CD24058') HTTP/1.1" 204 0
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_22f479551c70f1ab85add68748f8193b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_22f479551c70f1ab85add68748f8193b.jpg not downloaded yet
2026-03-28 12:01:20 [auto1.it] INFO: Found listing with ID: VB56015
2026-03-28 12:01:20 [auto1.it] INFO: Found listing with ID: TV81460
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV81460%27 HTTP/1.1" 200 None
2026-03-28 12:01:20 [auto1.it] INFO: Scrape type for TV81460: 1
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_f1273a2327f09aaeec4a0192770a764e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_f1273a2327f09aaeec4a0192770a764e.jpg not downloaded yet
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f5b8747fb7b63b18ade81cd52237a2%252Fpa%252FCZ80815_11ef814e9a0407f3db94d5a5c6bd85e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_11ef814e9a0407f3db94d5a5c6bd85e4.jpg not downloaded yet
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6b3f50>
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d832aa8-d665-54b0-a41e-39953f141455/9d832aa8-d665-54b0-a41e-39953f141455_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fbe%252F14bedd6dbde45625f5c100caee65851b%252Fpa%252FNW63690_04fd180dbc444ddc05aba21b795ecb8e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_04fd180dbc444ddc05aba21b795ecb8e.jpg saved to cache
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d832aa8-d665-54b0-a41e-39953f141455
2026-03-28 12:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_40219bd20f5be6737604909c24a20509.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_a958c2c2567674a71810cf5d0428a0a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_623ebc41aed736b590c90fee5c5a57fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_623ebc41aed736b590c90fee5c5a57fb.jpg not downloaded yet
2026-03-28 12:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_e18b00df4ae5457b369536c1142a35c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:21 [auto1.it] INFO: Found listing with ID: RK78436
2026-03-28 12:01:21 [auto1.it] INFO: Found listing with ID: SX60727
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX60727%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [auto1.it] INFO: Scrape type for SX60727: 1
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_ded20b2d3a28568801cd18b58ed77371.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_ded20b2d3a28568801cd18b58ed77371.jpg not downloaded yet
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f5b8747fb7b63b18ade81cd52237a2%252Fpa%252FCZ80815_b3a4a59c80571321ba60f659618699e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_b3a4a59c80571321ba60f659618699e0.jpg not downloaded yet
2026-03-28 12:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 202afcd8-3aa8-5196-8906-130b49fa0733 with identifier: CK02940
2026-03-28 12:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 202afcd8-3aa8-5196-8906-130b49fa0733 with scrape type 1
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 202afcd8-3aa8-5196-8906-130b49fa0733
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_e6c74da635cdacf56afb5c419096a9f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_e6c74da635cdacf56afb5c419096a9f2.jpg not downloaded yet
2026-03-28 12:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c5c3a64-672a-5c42-ad54-94525f5a1beb with identifier: MX89615
2026-03-28 12:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c5c3a64-672a-5c42-ad54-94525f5a1beb with scrape type 1
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c5c3a64-672a-5c42-ad54-94525f5a1beb
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_6de5e2063114497934cfe2b0d302e313.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_6de5e2063114497934cfe2b0d302e313.jpg not downloaded yet
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca2c690>
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_8c6372639dfc7fbdc6ec898a0f854256.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_8c6372639dfc7fbdc6ec898a0f854256.jpg saved to cache
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d24e46a-4936-5251-973c-958aa2ab4326
2026-03-28 12:01:21 [auto1.it] INFO: Found listing with ID: SF25356
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF25356%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [auto1.it] INFO: Scrape type for SF25356: 2
2026-03-28 12:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eb73604-cafb-504d-85ff-70ac4006b5b7 with identifier: SF25356
2026-03-28 12:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eb73604-cafb-504d-85ff-70ac4006b5b7 with scrape type 2
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4eb73604-cafb-504d-85ff-70ac4006b5b7 with scrape type 2
2026-03-28 12:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4eb73604-cafb-504d-85ff-70ac4006b5b7, identifier: SF25356
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_b7ad491cc76539c0336df3eb2353a64e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_b7ad491cc76539c0336df3eb2353a64e.jpg not downloaded yet
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f5b8747fb7b63b18ade81cd52237a2%252Fpa%252FCZ80815_efcad9a0d91498cf908bbc9a83dc92e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_efcad9a0d91498cf908bbc9a83dc92e3.jpg not downloaded yet
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_cc7f66009bc148f3b9a726f4c7de0f50.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_cc7f66009bc148f3b9a726f4c7de0f50.jpg not downloaded yet
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_6671e571755ab797dba5c011cb11f806.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_6671e571755ab797dba5c011cb11f806.jpg not downloaded yet
2026-03-28 12:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DK59825/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_a8186f5fccf870d068248e52367f628c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4eb73604-cafb-504d-85ff-70ac4006b5b7 with identifier: SF25356
2026-03-28 12:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4eb73604-cafb-504d-85ff-70ac4006b5b7 with identifier: SF25356
2026-03-28 12:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4eb73604-cafb-504d-85ff-70ac4006b5b7 with identifier: SF25356 to the API
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:49:57Z',
'fuel_type': 'hybrid',
'id': '4eb73604-cafb-504d-85ff-70ac4006b5b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF25356',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 91607,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-30',
'seller_name': None,
'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
'transmission': 'automatic',
'trim': 'ST-Line X',
'year': 2023}
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF25356%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [auto1.it] INFO: Saving data for SF25356: {'auction_closing_time': 1774885797.0, 'created_time': 1774342895.164782, 'last_price_update_time': 1774699281.787342}
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SF25356') HTTP/1.1" 204 0
2026-03-28 12:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ65230/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c96ed10>
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_40219bd20f5be6737604909c24a20509.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_40219bd20f5be6737604909c24a20509.jpg saved to cache
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d24e46a-4936-5251-973c-958aa2ab4326
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c982810>
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_a958c2c2567674a71810cf5d0428a0a9.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_a958c2c2567674a71810cf5d0428a0a9.jpg saved to cache
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e5922e0-4510-5fd3-9a45-9d86124bf86e
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4efc90>
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_e18b00df4ae5457b369536c1142a35c7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_e18b00df4ae5457b369536c1142a35c7.jpg saved to cache
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e5922e0-4510-5fd3-9a45-9d86124bf86e
2026-03-28 12:01:21 [auto1.it] INFO: Found listing with ID: PB64949
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB64949%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [auto1.it] INFO: Scrape type for PB64949: 1
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_07a70fac849a4b76171338543a4dfbc7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_07a70fac849a4b76171338543a4dfbc7.jpg not downloaded yet
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_8cf5999543302e46c2b8258af4cfab6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_8cf5999543302e46c2b8258af4cfab6f.jpg not downloaded yet
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_b5b9b24f7b845abfd2856b8eff3d082f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_b5b9b24f7b845abfd2856b8eff3d082f.jpg not downloaded yet
2026-03-28 12:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_22f479551c70f1ab85add68748f8193b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_9fd26cbe2f7d943de5a22239c145b302.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_11ef814e9a0407f3db94d5a5c6bd85e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:22 [auto1.it] INFO: Found listing with ID: HW36660
2026-03-28 12:01:22 [auto1.it] INFO: Found listing with ID: HR61031
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_9cb603419042accd782f8d0188d16d1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_9cb603419042accd782f8d0188d16d1b.jpg not downloaded yet
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_07fd649091b1d80a303055c6616140e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_07fd649091b1d80a303055c6616140e4.jpg not downloaded yet
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_ebdb2900cf58dbb2ec7fa89e42745ef6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_ebdb2900cf58dbb2ec7fa89e42745ef6.jpg not downloaded yet
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL93891/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN18335> (referer: https://www.auto1.com/v1/car-details-view/YN18335/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3fd24910>
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_a8186f5fccf870d068248e52367f628c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_a8186f5fccf870d068248e52367f628c.jpg saved to cache
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e5922e0-4510-5fd3-9a45-9d86124bf86e
2026-03-28 12:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_a2c12f59de85dac5ace1685779cca0b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_a2c12f59de85dac5ace1685779cca0b4.jpg not downloaded yet
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_ba493caae10bbcd862f09f26d64ccbfd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_ba493caae10bbcd862f09f26d64ccbfd.jpg not downloaded yet
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb6dc10>
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_22f479551c70f1ab85add68748f8193b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_22f479551c70f1ab85add68748f8193b.jpg saved to cache
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d24e46a-4936-5251-973c-958aa2ab4326
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5e9390>
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c09ea6e-ff64-5664-85a8-60dcb96f4be4/3c09ea6e-ff64-5664-85a8-60dcb96f4be4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f5b8747fb7b63b18ade81cd52237a2%252Fpa%252FCZ80815_9fd26cbe2f7d943de5a22239c145b302.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_9fd26cbe2f7d943de5a22239c145b302.jpg saved to cache
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c09ea6e-ff64-5664-85a8-60dcb96f4be4
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d46f010>
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c09ea6e-ff64-5664-85a8-60dcb96f4be4/3c09ea6e-ff64-5664-85a8-60dcb96f4be4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f5b8747fb7b63b18ade81cd52237a2%252Fpa%252FCZ80815_11ef814e9a0407f3db94d5a5c6bd85e4.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_11ef814e9a0407f3db94d5a5c6bd85e4.jpg saved to cache
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c09ea6e-ff64-5664-85a8-60dcb96f4be4
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_59fc85fb61c6153536b82aac46545d2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_59fc85fb61c6153536b82aac46545d2b.jpg not downloaded yet
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_06881741fbeaa9c6981b793735e8cd4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_06881741fbeaa9c6981b793735e8cd4c.jpg not downloaded yet
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_cc7f66009bc148f3b9a726f4c7de0f50.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_6671e571755ab797dba5c011cb11f806.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_3500e983be7b31b0ff5202251f2f37b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_3500e983be7b31b0ff5202251f2f37b8.jpg not downloaded yet
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_42164db87e15b29a3c925673ac0d7db7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_42164db87e15b29a3c925673ac0d7db7.jpg not downloaded yet
2026-03-28 12:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ac40a33-d49b-5435-8835-7eea0188196a with identifier: YN18335
2026-03-28 12:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ac40a33-d49b-5435-8835-7eea0188196a with scrape type 1
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6ac40a33-d49b-5435-8835-7eea0188196a
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F28%252F0c289dc6c4ff9e3ff3f80f951860cdc9%252Fpa%252FYN18335_8de3267651260a0a736e1580e506a9f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_8de3267651260a0a736e1580e506a9f9.jpg not downloaded yet
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_b5b9b24f7b845abfd2856b8eff3d082f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_efcad9a0d91498cf908bbc9a83dc92e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_7398709e16d3150f3369a0ef18b1fbe8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_7398709e16d3150f3369a0ef18b1fbe8.jpg not downloaded yet
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_2f37996c4020885bef07b0819bfa34c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_2f37996c4020885bef07b0819bfa34c4.jpg not downloaded yet
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F28%252F0c289dc6c4ff9e3ff3f80f951860cdc9%252Fpa%252FYN18335_b6c0bee6725c400962162d1dda97f2c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_b6c0bee6725c400962162d1dda97f2c6.jpg not downloaded yet
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_b7ad491cc76539c0336df3eb2353a64e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_8cf5999543302e46c2b8258af4cfab6f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XE84016> (referer: https://www.auto1.com/v1/car-details-view/XE84016/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZX07478> (referer: https://www.auto1.com/v1/car-details-view/ZX07478/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_9dee1b43b5d65d1680c15248b647d6c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_9dee1b43b5d65d1680c15248b647d6c7.jpg not downloaded yet
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_931944c022c35ffc51eac97c71178a21.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_931944c022c35ffc51eac97c71178a21.jpg not downloaded yet
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F28%252F0c289dc6c4ff9e3ff3f80f951860cdc9%252Fpa%252FYN18335_a9d76736b4950bc3b972864cbdca35a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_a9d76736b4950bc3b972864cbdca35a5.jpg not downloaded yet
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM57231> (referer: https://www.auto1.com/v1/car-details-view/ZM57231/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca39c50>
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_cc7f66009bc148f3b9a726f4c7de0f50.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_cc7f66009bc148f3b9a726f4c7de0f50.jpg saved to cache
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 202afcd8-3aa8-5196-8906-130b49fa0733
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d520490>
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_6671e571755ab797dba5c011cb11f806.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_6671e571755ab797dba5c011cb11f806.jpg saved to cache
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c5c3a64-672a-5c42-ad54-94525f5a1beb
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_64fe4b75aef3259df00d31b90f313be9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_66090f35fe1a5a565c5120cc654af02e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_66090f35fe1a5a565c5120cc654af02e.jpg not downloaded yet
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_17340291c0c7bbb4e1a0537c3ad96299.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_17340291c0c7bbb4e1a0537c3ad96299.jpg not downloaded yet
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F28%252F0c289dc6c4ff9e3ff3f80f951860cdc9%252Fpa%252FYN18335_0b8fa702dc49582ff728172c19c52405.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_0b8fa702dc49582ff728172c19c52405.jpg not downloaded yet
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d637c90>
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_b5b9b24f7b845abfd2856b8eff3d082f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_b5b9b24f7b845abfd2856b8eff3d082f.jpg saved to cache
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c5c3a64-672a-5c42-ad54-94525f5a1beb
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c845050>
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c09ea6e-ff64-5664-85a8-60dcb96f4be4/3c09ea6e-ff64-5664-85a8-60dcb96f4be4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f5b8747fb7b63b18ade81cd52237a2%252Fpa%252FCZ80815_efcad9a0d91498cf908bbc9a83dc92e3.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_efcad9a0d91498cf908bbc9a83dc92e3.jpg saved to cache
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c09ea6e-ff64-5664-85a8-60dcb96f4be4
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_9bf7e27dc411a21bea953ed63214accc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_42164db87e15b29a3c925673ac0d7db7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_8de3267651260a0a736e1580e506a9f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_3500e983be7b31b0ff5202251f2f37b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_ba493caae10bbcd862f09f26d64ccbfd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F28%252F0c289dc6c4ff9e3ff3f80f951860cdc9%252Fpa%252FYN18335_431ddcd8de8603dc49e21d47ac5028d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_431ddcd8de8603dc49e21d47ac5028d7.jpg not downloaded yet
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_06881741fbeaa9c6981b793735e8cd4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB90809/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f571410>
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_b7ad491cc76539c0336df3eb2353a64e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_b7ad491cc76539c0336df3eb2353a64e.jpg saved to cache
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7e5922e0-4510-5fd3-9a45-9d86124bf86e
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cae15d0>
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_8cf5999543302e46c2b8258af4cfab6f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_8cf5999543302e46c2b8258af4cfab6f.jpg saved to cache
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 202afcd8-3aa8-5196-8906-130b49fa0733
2026-03-28 12:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19d1220d-6dde-5042-96e4-7b520ea935a0 with identifier: XE84016
2026-03-28 12:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19d1220d-6dde-5042-96e4-7b520ea935a0 with scrape type 1
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 19d1220d-6dde-5042-96e4-7b520ea935a0
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_78b264a7fcc1b1c3497f9782192862bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_78b264a7fcc1b1c3497f9782192862bb.jpg not downloaded yet
2026-03-28 12:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36a421a3-eebc-5a46-a021-7be46aad1c68 with identifier: ZX07478
2026-03-28 12:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36a421a3-eebc-5a46-a021-7be46aad1c68 with scrape type 1
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 36a421a3-eebc-5a46-a021-7be46aad1c68
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F22%252F79226d88b0746e875d493e89c17bd168%252Fpa%252FZX07478_3fb6dcc14519aa2d3b6456be23b35c44.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/22/79226d88b0746e875d493e89c17bd168/pa/ZX07478_3fb6dcc14519aa2d3b6456be23b35c44.jpg already downloaded
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F22%252F79226d88b0746e875d493e89c17bd168%252Fpa%252FZX07478_9750f15888eda31868f6c3d38e3feaeb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/22/79226d88b0746e875d493e89c17bd168/pa/ZX07478_9750f15888eda31868f6c3d38e3feaeb.jpg already downloaded
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F22%252F79226d88b0746e875d493e89c17bd168%252Fpa%252FZX07478_def62934a29e137a53c6a5c68f50496f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/22/79226d88b0746e875d493e89c17bd168/pa/ZX07478_def62934a29e137a53c6a5c68f50496f.jpg already downloaded
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F22%252F79226d88b0746e875d493e89c17bd168%252Fpa%252FZX07478_f3a0c043f1efb35f7e496a94eeedbcc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/22/79226d88b0746e875d493e89c17bd168/pa/ZX07478_f3a0c043f1efb35f7e496a94eeedbcc1.jpg already downloaded
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F22%252F79226d88b0746e875d493e89c17bd168%252Fpa%252FZX07478_5540db84f39d8777c42a93147bb3b897.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/22/79226d88b0746e875d493e89c17bd168/pa/ZX07478_5540db84f39d8777c42a93147bb3b897.jpg already downloaded
2026-03-28 12:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 36a421a3-eebc-5a46-a021-7be46aad1c68, identifier: ZX07478
2026-03-28 12:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ce5f4cc-c997-5461-b70a-ad2a38a6dd62 with identifier: ZM57231
2026-03-28 12:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ce5f4cc-c997-5461-b70a-ad2a38a6dd62 with scrape type 1
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0ce5f4cc-c997-5461-b70a-ad2a38a6dd62
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F39%252F6439474116ed52038f0c28e236e377c9%252Fpa%252FZM57231_0bece8c0195eec51f958d949a436a465.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_0bece8c0195eec51f958d949a436a465.jpg not downloaded yet
2026-03-28 12:01:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5997d0>
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_64fe4b75aef3259df00d31b90f313be9.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_64fe4b75aef3259df00d31b90f313be9.jpg saved to cache
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b2331b2-bba6-56f9-b66a-9e6924ff7f48
2026-03-28 12:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 36a421a3-eebc-5a46-a021-7be46aad1c68 with identifier: ZX07478
2026-03-28 12:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 36a421a3-eebc-5a46-a021-7be46aad1c68 with identifier: ZX07478
2026-03-28 12:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 36a421a3-eebc-5a46-a021-7be46aad1c68 with identifier: ZX07478 to the API
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZX07478>
{'auction_title': '',
'c_o_2_emission_value': 169,
'category': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:41:16Z',
'fuel_type': 'diesel',
'id': '36a421a3-eebc-5a46-a021-7be46aad1c68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX07478',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Ford',
'model': 'Kuga',
'odometer': 267665,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/img79/22/79226d88b0746e875d493e89c17bd168/pa/ZX07478_3fb6dcc14519aa2d3b6456be23b35c44.jpg',
'https://img-pa.auto1.com/img79/22/79226d88b0746e875d493e89c17bd168/pa/ZX07478_9750f15888eda31868f6c3d38e3feaeb.jpg',
'https://img-pa.auto1.com/img79/22/79226d88b0746e875d493e89c17bd168/pa/ZX07478_def62934a29e137a53c6a5c68f50496f.jpg',
'https://img-pa.auto1.com/img79/22/79226d88b0746e875d493e89c17bd168/pa/ZX07478_f3a0c043f1efb35f7e496a94eeedbcc1.jpg',
'https://img-pa.auto1.com/img79/22/79226d88b0746e875d493e89c17bd168/pa/ZX07478_5540db84f39d8777c42a93147bb3b897.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a421a3-eebc-5a46-a021-7be46aad1c68/36a421a3-eebc-5a46-a021-7be46aad1c68_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76862,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/22/79226d88b0746e875d493e89c17bd168/pa/ZX07478_3fb6dcc14519aa2d3b6456be23b35c44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a421a3-eebc-5a46-a021-7be46aad1c68/36a421a3-eebc-5a46-a021-7be46aad1c68_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/22/79226d88b0746e875d493e89c17bd168/pa/ZX07478_9750f15888eda31868f6c3d38e3feaeb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a421a3-eebc-5a46-a021-7be46aad1c68/36a421a3-eebc-5a46-a021-7be46aad1c68_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/22/79226d88b0746e875d493e89c17bd168/pa/ZX07478_def62934a29e137a53c6a5c68f50496f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a421a3-eebc-5a46-a021-7be46aad1c68/36a421a3-eebc-5a46-a021-7be46aad1c68_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/22/79226d88b0746e875d493e89c17bd168/pa/ZX07478_f3a0c043f1efb35f7e496a94eeedbcc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a421a3-eebc-5a46-a021-7be46aad1c68/36a421a3-eebc-5a46-a021-7be46aad1c68_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/22/79226d88b0746e875d493e89c17bd168/pa/ZX07478_5540db84f39d8777c42a93147bb3b897.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-08-02',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2009}
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX07478%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.it] INFO: Saving data for ZX07478: {'created_time': 1774699283.675474, 'last_price_update_time': 1774699283.675482, 'auction_closing_time': 1774885276.0}
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZX07478') HTTP/1.1" 204 0
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_5a5ca039ec676da4f4e7328bfa6e164f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_5a5ca039ec676da4f4e7328bfa6e164f.jpg not downloaded yet
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F39%252F6439474116ed52038f0c28e236e377c9%252Fpa%252FZM57231_d0972a52fe2288e2758525e9d60197ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_d0972a52fe2288e2758525e9d60197ea.jpg not downloaded yet
2026-03-28 12:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_b6c0bee6725c400962162d1dda97f2c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_a9d76736b4950bc3b972864cbdca35a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_2f37996c4020885bef07b0819bfa34c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_931944c022c35ffc51eac97c71178a21.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD08634> (referer: https://www.auto1.com/v1/car-details-view/JD08634/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX84836/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f868c10>
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_9bf7e27dc411a21bea953ed63214accc.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_9bf7e27dc411a21bea953ed63214accc.jpg saved to cache
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d24e46a-4936-5251-973c-958aa2ab4326
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d796790>
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_42164db87e15b29a3c925673ac0d7db7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_42164db87e15b29a3c925673ac0d7db7.jpg saved to cache
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c5c3a64-672a-5c42-ad54-94525f5a1beb
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c95a5d0>
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac40a33-d49b-5435-8835-7eea0188196a/6ac40a33-d49b-5435-8835-7eea0188196a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F28%252F0c289dc6c4ff9e3ff3f80f951860cdc9%252Fpa%252FYN18335_8de3267651260a0a736e1580e506a9f9.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_8de3267651260a0a736e1580e506a9f9.jpg saved to cache
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ac40a33-d49b-5435-8835-7eea0188196a
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7953d0>
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_3500e983be7b31b0ff5202251f2f37b8.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_3500e983be7b31b0ff5202251f2f37b8.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 202afcd8-3aa8-5196-8906-130b49fa0733
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d464c90>
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_ba493caae10bbcd862f09f26d64ccbfd.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_ba493caae10bbcd862f09f26d64ccbfd.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c5c3a64-672a-5c42-ad54-94525f5a1beb
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d51c150>
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_06881741fbeaa9c6981b793735e8cd4c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_06881741fbeaa9c6981b793735e8cd4c.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c5c3a64-672a-5c42-ad54-94525f5a1beb
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_b960add7f0fe6f515d56ca76fa64b99a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_bf0bbc2ca47dada3c3c98b7e4f75ef6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_bf0bbc2ca47dada3c3c98b7e4f75ef6a.jpg not downloaded yet
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F39%252F6439474116ed52038f0c28e236e377c9%252Fpa%252FZM57231_91843eeec8988b220c4ca4bf78217101.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_91843eeec8988b220c4ca4bf78217101.jpg not downloaded yet
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN91424> (referer: https://www.auto1.com/v1/car-details-view/NN91424/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_0a24371c72024f71db1efa27a2b02dc7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_0a24371c72024f71db1efa27a2b02dc7.jpg not downloaded yet
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F39%252F6439474116ed52038f0c28e236e377c9%252Fpa%252FZM57231_c458d7322ded6474cc37e63cdb43a19e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_c458d7322ded6474cc37e63cdb43a19e.jpg not downloaded yet
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c959990>
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac40a33-d49b-5435-8835-7eea0188196a/6ac40a33-d49b-5435-8835-7eea0188196a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F28%252F0c289dc6c4ff9e3ff3f80f951860cdc9%252Fpa%252FYN18335_b6c0bee6725c400962162d1dda97f2c6.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_b6c0bee6725c400962162d1dda97f2c6.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ac40a33-d49b-5435-8835-7eea0188196a
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d663b10>
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac40a33-d49b-5435-8835-7eea0188196a/6ac40a33-d49b-5435-8835-7eea0188196a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F28%252F0c289dc6c4ff9e3ff3f80f951860cdc9%252Fpa%252FYN18335_a9d76736b4950bc3b972864cbdca35a5.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_a9d76736b4950bc3b972864cbdca35a5.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ac40a33-d49b-5435-8835-7eea0188196a
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6c6a90>
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_2f37996c4020885bef07b0819bfa34c4.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_2f37996c4020885bef07b0819bfa34c4.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c5c3a64-672a-5c42-ad54-94525f5a1beb
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d660cd0>
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_931944c022c35ffc51eac97c71178a21.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_931944c022c35ffc51eac97c71178a21.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c5c3a64-672a-5c42-ad54-94525f5a1beb
2026-03-28 12:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33a0871a-57e2-54c6-93fe-e9f467f9dccc with identifier: JD08634
2026-03-28 12:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33a0871a-57e2-54c6-93fe-e9f467f9dccc with scrape type 1
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 33a0871a-57e2-54c6-93fe-e9f467f9dccc
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_ce4331f5dae8ba7899ae42ff3a7514bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_ce4331f5dae8ba7899ae42ff3a7514bd.jpg not downloaded yet
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_431ddcd8de8603dc49e21d47ac5028d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_78b264a7fcc1b1c3497f9782192862bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_17340291c0c7bbb4e1a0537c3ad96299.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_7452c62f75ec058ddcad861a21f4698b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_7452c62f75ec058ddcad861a21f4698b.jpg not downloaded yet
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F39%252F6439474116ed52038f0c28e236e377c9%252Fpa%252FZM57231_7852de0f1a52128b49159169b286ee7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_7852de0f1a52128b49159169b286ee7c.jpg not downloaded yet
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_6338a76e4469bcdcff710e4d591f9e52.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_6338a76e4469bcdcff710e4d591f9e52.jpg not downloaded yet
2026-03-28 12:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c9796d0>
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_b960add7f0fe6f515d56ca76fa64b99a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_b960add7f0fe6f515d56ca76fa64b99a.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d24e46a-4936-5251-973c-958aa2ab4326
2026-03-28 12:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6364b96c-402b-5031-b583-b32bab1f1d5d with identifier: NN91424
2026-03-28 12:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6364b96c-402b-5031-b583-b32bab1f1d5d with scrape type 1
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6364b96c-402b-5031-b583-b32bab1f1d5d
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fb3%252F61b3cfca1c2a0dedaab07ab727246ec0%252Fpa%252FNN91424_231aa106fc4bf11345f67d0e89a46217.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_231aa106fc4bf11345f67d0e89a46217.jpg already downloaded
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fb3%252F61b3cfca1c2a0dedaab07ab727246ec0%252Fpa%252FNN91424_1e51aea40c2b4b69dfa193534a904bcc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_1e51aea40c2b4b69dfa193534a904bcc.jpg already downloaded
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fb3%252F61b3cfca1c2a0dedaab07ab727246ec0%252Fpa%252FNN91424_f9ad384a9bef26bfbe7192ddfc587cd4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_f9ad384a9bef26bfbe7192ddfc587cd4.jpg already downloaded
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fb3%252F61b3cfca1c2a0dedaab07ab727246ec0%252Fpa%252FNN91424_900f28dd548e212e1ed7eb4b5c38db45.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_900f28dd548e212e1ed7eb4b5c38db45.jpg already downloaded
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fb3%252F61b3cfca1c2a0dedaab07ab727246ec0%252Fpa%252FNN91424_ce0a12335e9f0751213a4c1857aab239.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_ce0a12335e9f0751213a4c1857aab239.jpg already downloaded
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fb3%252F61b3cfca1c2a0dedaab07ab727246ec0%252Fpa%252FNN91424_b3bdf934d86eff1538974ccde40fec98.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_b3bdf934d86eff1538974ccde40fec98.jpg already downloaded
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fb3%252F61b3cfca1c2a0dedaab07ab727246ec0%252Fpa%252FNN91424_fe6365483a301d6a72fe48bbd10db012.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_fe6365483a301d6a72fe48bbd10db012.jpg already downloaded
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fb3%252F61b3cfca1c2a0dedaab07ab727246ec0%252Fpa%252FNN91424_308615edb2490581e1aec9b3ea37ba0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_308615edb2490581e1aec9b3ea37ba0d.jpg already downloaded
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fb3%252F61b3cfca1c2a0dedaab07ab727246ec0%252Fpa%252FNN91424_58fa5e34f47841212f335d0034f29856.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_58fa5e34f47841212f335d0034f29856.jpg already downloaded
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fb3%252F61b3cfca1c2a0dedaab07ab727246ec0%252Fpa%252FNN91424_20468a62dedc93eedec7fcca808fa825.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_20468a62dedc93eedec7fcca808fa825.jpg already downloaded
2026-03-28 12:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6364b96c-402b-5031-b583-b32bab1f1d5d, identifier: NN91424
2026-03-28 12:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_66090f35fe1a5a565c5120cc654af02e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_0bece8c0195eec51f958d949a436a465.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_d0972a52fe2288e2758525e9d60197ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_0b8fa702dc49582ff728172c19c52405.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_5a5ca039ec676da4f4e7328bfa6e164f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL93891> (referer: https://www.auto1.com/v1/car-details-view/RL93891/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6364b96c-402b-5031-b583-b32bab1f1d5d with identifier: NN91424
2026-03-28 12:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6364b96c-402b-5031-b583-b32bab1f1d5d with identifier: NN91424
2026-03-28 12:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6364b96c-402b-5031-b583-b32bab1f1d5d with identifier: NN91424 to the API
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NN91424>
{'auction_title': '',
'c_o_2_emission_value': 156,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.4L',
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:10:26Z',
'fuel_type': 'petrol',
'id': '6364b96c-402b-5031-b583-b32bab1f1d5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN91424',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Fiat',
'model': '500L',
'odometer': 120742,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_231aa106fc4bf11345f67d0e89a46217.jpg',
'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_1e51aea40c2b4b69dfa193534a904bcc.jpg',
'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_f9ad384a9bef26bfbe7192ddfc587cd4.jpg',
'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_900f28dd548e212e1ed7eb4b5c38db45.jpg',
'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_ce0a12335e9f0751213a4c1857aab239.jpg',
'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_b3bdf934d86eff1538974ccde40fec98.jpg',
'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_fe6365483a301d6a72fe48bbd10db012.jpg',
'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_308615edb2490581e1aec9b3ea37ba0d.jpg',
'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_58fa5e34f47841212f335d0034f29856.jpg',
'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_20468a62dedc93eedec7fcca808fa825.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6364b96c-402b-5031-b583-b32bab1f1d5d/6364b96c-402b-5031-b583-b32bab1f1d5d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_231aa106fc4bf11345f67d0e89a46217.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6364b96c-402b-5031-b583-b32bab1f1d5d/6364b96c-402b-5031-b583-b32bab1f1d5d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65499,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_1e51aea40c2b4b69dfa193534a904bcc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6364b96c-402b-5031-b583-b32bab1f1d5d/6364b96c-402b-5031-b583-b32bab1f1d5d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68861,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_f9ad384a9bef26bfbe7192ddfc587cd4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6364b96c-402b-5031-b583-b32bab1f1d5d/6364b96c-402b-5031-b583-b32bab1f1d5d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_900f28dd548e212e1ed7eb4b5c38db45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6364b96c-402b-5031-b583-b32bab1f1d5d/6364b96c-402b-5031-b583-b32bab1f1d5d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64903,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_ce0a12335e9f0751213a4c1857aab239.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6364b96c-402b-5031-b583-b32bab1f1d5d/6364b96c-402b-5031-b583-b32bab1f1d5d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65497,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_b3bdf934d86eff1538974ccde40fec98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6364b96c-402b-5031-b583-b32bab1f1d5d/6364b96c-402b-5031-b583-b32bab1f1d5d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_fe6365483a301d6a72fe48bbd10db012.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6364b96c-402b-5031-b583-b32bab1f1d5d/6364b96c-402b-5031-b583-b32bab1f1d5d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_308615edb2490581e1aec9b3ea37ba0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6364b96c-402b-5031-b583-b32bab1f1d5d/6364b96c-402b-5031-b583-b32bab1f1d5d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_58fa5e34f47841212f335d0034f29856.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6364b96c-402b-5031-b583-b32bab1f1d5d/6364b96c-402b-5031-b583-b32bab1f1d5d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b3/61b3cfca1c2a0dedaab07ab727246ec0/pa/NN91424_20468a62dedc93eedec7fcca808fa825.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500L 1.4 Mirror',
'transmission': 'manual',
'trim': 'Mirror',
'year': 2019}
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN91424%27 HTTP/1.1" 200 None
2026-03-28 12:01:25 [auto1.it] INFO: Saving data for NN91424: {'created_time': 1774699285.550507, 'last_price_update_time': 1774699285.550517, 'auction_closing_time': 1774883426.0}
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NN91424') HTTP/1.1" 204 0
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_fa54d5e5940807952b3f8cb4da2d3d5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_fa54d5e5940807952b3f8cb4da2d3d5f.jpg not downloaded yet
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_22202a5b9a53ea55466b7771d53f8341.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_22202a5b9a53ea55466b7771d53f8341.jpg not downloaded yet
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb95190>
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac40a33-d49b-5435-8835-7eea0188196a/6ac40a33-d49b-5435-8835-7eea0188196a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F28%252F0c289dc6c4ff9e3ff3f80f951860cdc9%252Fpa%252FYN18335_431ddcd8de8603dc49e21d47ac5028d7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_431ddcd8de8603dc49e21d47ac5028d7.jpg saved to cache
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ac40a33-d49b-5435-8835-7eea0188196a
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca6d390>
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_78b264a7fcc1b1c3497f9782192862bb.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_78b264a7fcc1b1c3497f9782192862bb.jpg saved to cache
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19d1220d-6dde-5042-96e4-7b520ea935a0
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d536650>
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_17340291c0c7bbb4e1a0537c3ad96299.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_17340291c0c7bbb4e1a0537c3ad96299.jpg saved to cache
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c5c3a64-672a-5c42-ad54-94525f5a1beb
2026-03-28 12:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_c458d7322ded6474cc37e63cdb43a19e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_7398709e16d3150f3369a0ef18b1fbe8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_2524e26b11f4b04130694ecbf05047d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_2524e26b11f4b04130694ecbf05047d0.jpg not downloaded yet
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_6e9e1f8f4928ef3282e3545566e856ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_6e9e1f8f4928ef3282e3545566e856ed.jpg not downloaded yet
2026-03-28 12:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_0a24371c72024f71db1efa27a2b02dc7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_a2c12f59de85dac5ace1685779cca0b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_ce4331f5dae8ba7899ae42ff3a7514bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca49190>
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_66090f35fe1a5a565c5120cc654af02e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_66090f35fe1a5a565c5120cc654af02e.jpg saved to cache
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 202afcd8-3aa8-5196-8906-130b49fa0733
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7abad0>
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ce5f4cc-c997-5461-b70a-ad2a38a6dd62/0ce5f4cc-c997-5461-b70a-ad2a38a6dd62_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F39%252F6439474116ed52038f0c28e236e377c9%252Fpa%252FZM57231_0bece8c0195eec51f958d949a436a465.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_0bece8c0195eec51f958d949a436a465.jpg saved to cache
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ce5f4cc-c997-5461-b70a-ad2a38a6dd62
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4fb310>
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ce5f4cc-c997-5461-b70a-ad2a38a6dd62/0ce5f4cc-c997-5461-b70a-ad2a38a6dd62_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F39%252F6439474116ed52038f0c28e236e377c9%252Fpa%252FZM57231_d0972a52fe2288e2758525e9d60197ea.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_d0972a52fe2288e2758525e9d60197ea.jpg saved to cache
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ce5f4cc-c997-5461-b70a-ad2a38a6dd62
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c98a910>
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac40a33-d49b-5435-8835-7eea0188196a/6ac40a33-d49b-5435-8835-7eea0188196a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F28%252F0c289dc6c4ff9e3ff3f80f951860cdc9%252Fpa%252FYN18335_0b8fa702dc49582ff728172c19c52405.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_0b8fa702dc49582ff728172c19c52405.jpg saved to cache
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ac40a33-d49b-5435-8835-7eea0188196a
2026-03-28 12:01:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ac40a33-d49b-5435-8835-7eea0188196a, skipping ID generation
2026-03-28 12:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ac40a33-d49b-5435-8835-7eea0188196a with scrape type 1
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ac40a33-d49b-5435-8835-7eea0188196a sending to next pipeline
2026-03-28 12:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6ac40a33-d49b-5435-8835-7eea0188196a, identifier: YN18335
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d43b150>
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_5a5ca039ec676da4f4e7328bfa6e164f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_5a5ca039ec676da4f4e7328bfa6e164f.jpg saved to cache
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 19d1220d-6dde-5042-96e4-7b520ea935a0
2026-03-28 12:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 343624c3-373e-513f-a631-a9401780e978 with identifier: RL93891
2026-03-28 12:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 343624c3-373e-513f-a631-a9401780e978 with scrape type 1
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 343624c3-373e-513f-a631-a9401780e978
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247eae4e01721332b04317e84461afa6%252Fpa%252FRL93891_45eecde2fe8f0b6d67afd3630b876e26.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_45eecde2fe8f0b6d67afd3630b876e26.jpg not downloaded yet
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_d6da383ea053d81116329695521c765d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_d6da383ea053d81116329695521c765d.jpg not downloaded yet
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_93dd3efad86353ea95667b299d1f4a71.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_93dd3efad86353ea95667b299d1f4a71.jpg not downloaded yet
2026-03-28 12:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6ac40a33-d49b-5435-8835-7eea0188196a with identifier: YN18335
2026-03-28 12:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6ac40a33-d49b-5435-8835-7eea0188196a with identifier: YN18335
2026-03-28 12:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6ac40a33-d49b-5435-8835-7eea0188196a with identifier: YN18335 to the API
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_0b8fa702dc49582ff728172c19c52405.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.3L',
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:13:27Z',
'fuel_type': 'petrol',
'id': '6ac40a33-d49b-5435-8835-7eea0188196a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN18335',
'listing': 'auction',
'location': 'IT, Ferrara',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 109655,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac40a33-d49b-5435-8835-7eea0188196a/6ac40a33-d49b-5435-8835-7eea0188196a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80723,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_8de3267651260a0a736e1580e506a9f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac40a33-d49b-5435-8835-7eea0188196a/6ac40a33-d49b-5435-8835-7eea0188196a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_b6c0bee6725c400962162d1dda97f2c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac40a33-d49b-5435-8835-7eea0188196a/6ac40a33-d49b-5435-8835-7eea0188196a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73302,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_a9d76736b4950bc3b972864cbdca35a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac40a33-d49b-5435-8835-7eea0188196a/6ac40a33-d49b-5435-8835-7eea0188196a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68798,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_0b8fa702dc49582ff728172c19c52405.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac40a33-d49b-5435-8835-7eea0188196a/6ac40a33-d49b-5435-8835-7eea0188196a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/28/0c289dc6c4ff9e3ff3f80f951860cdc9/pa/YN18335_431ddcd8de8603dc49e21d47ac5028d7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-02-04',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.3 VVT-i',
'transmission': 'automatic',
'trim': '',
'year': 2007}
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN18335%27 HTTP/1.1" 200 None
2026-03-28 12:01:26 [auto1.it] INFO: Saving data for YN18335: {'created_time': 1774699286.646194, 'last_price_update_time': 1774699286.646204, 'auction_closing_time': 1774883607.0}
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YN18335') HTTP/1.1" 204 0
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247eae4e01721332b04317e84461afa6%252Fpa%252FRL93891_3c12c8f254a68362507260f2380e44a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_3c12c8f254a68362507260f2380e44a2.jpg not downloaded yet
2026-03-28 12:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_bf0bbc2ca47dada3c3c98b7e4f75ef6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_ebdb2900cf58dbb2ec7fa89e42745ef6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_91843eeec8988b220c4ca4bf78217101.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_99e365ade24836fc4919514d7b74b299.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_99e365ade24836fc4919514d7b74b299.jpg not downloaded yet
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_ce549b16188ef71738aa40d2599b7bdb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_ce549b16188ef71738aa40d2599b7bdb.jpg not downloaded yet
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d534450>
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ce5f4cc-c997-5461-b70a-ad2a38a6dd62/0ce5f4cc-c997-5461-b70a-ad2a38a6dd62_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F39%252F6439474116ed52038f0c28e236e377c9%252Fpa%252FZM57231_c458d7322ded6474cc37e63cdb43a19e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_c458d7322ded6474cc37e63cdb43a19e.jpg saved to cache
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ce5f4cc-c997-5461-b70a-ad2a38a6dd62
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5d7d90>
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_7398709e16d3150f3369a0ef18b1fbe8.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_7398709e16d3150f3369a0ef18b1fbe8.jpg saved to cache
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 202afcd8-3aa8-5196-8906-130b49fa0733
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4f5990>
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_0a24371c72024f71db1efa27a2b02dc7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_0a24371c72024f71db1efa27a2b02dc7.jpg saved to cache
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 19d1220d-6dde-5042-96e4-7b520ea935a0
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca16290>
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_a2c12f59de85dac5ace1685779cca0b4.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_a2c12f59de85dac5ace1685779cca0b4.jpg saved to cache
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 202afcd8-3aa8-5196-8906-130b49fa0733
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5e9790>
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_ce4331f5dae8ba7899ae42ff3a7514bd.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_ce4331f5dae8ba7899ae42ff3a7514bd.jpg saved to cache
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33a0871a-57e2-54c6-93fe-e9f467f9dccc
2026-03-28 12:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_07fd649091b1d80a303055c6616140e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247eae4e01721332b04317e84461afa6%252Fpa%252FRL93891_088e73ac6cd15d0ce589d3329c17cab6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_088e73ac6cd15d0ce589d3329c17cab6.jpg not downloaded yet
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_bf3acc3e9492fee8d08d72548d53a6de.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_bf3acc3e9492fee8d08d72548d53a6de.jpg not downloaded yet
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_ae727b949b072ce58e03418c7133ddaf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_ae727b949b072ce58e03418c7133ddaf.jpg not downloaded yet
2026-03-28 12:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_22202a5b9a53ea55466b7771d53f8341.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247eae4e01721332b04317e84461afa6%252Fpa%252FRL93891_b6b8146f4078858a9cbcac8449f1a16f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_b6b8146f4078858a9cbcac8449f1a16f.jpg not downloaded yet
2026-03-28 12:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX84836> (referer: https://www.auto1.com/v1/car-details-view/BX84836/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_fa54d5e5940807952b3f8cb4da2d3d5f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_7c0aef45a751eaffe5a9526718c35e2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_7c0aef45a751eaffe5a9526718c35e2a.jpg not downloaded yet
2026-03-28 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_7852de0f1a52128b49159169b286ee7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247eae4e01721332b04317e84461afa6%252Fpa%252FRL93891_3cc8caede4726ed0d052bb6cba720372.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_3cc8caede4726ed0d052bb6cba720372.jpg not downloaded yet
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5d5810>
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_bf0bbc2ca47dada3c3c98b7e4f75ef6a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_bf0bbc2ca47dada3c3c98b7e4f75ef6a.jpg saved to cache
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 19d1220d-6dde-5042-96e4-7b520ea935a0
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca15110>
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_ebdb2900cf58dbb2ec7fa89e42745ef6.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_ebdb2900cf58dbb2ec7fa89e42745ef6.jpg saved to cache
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c5c3a64-672a-5c42-ad54-94525f5a1beb
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4b79d0>
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ce5f4cc-c997-5461-b70a-ad2a38a6dd62/0ce5f4cc-c997-5461-b70a-ad2a38a6dd62_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F39%252F6439474116ed52038f0c28e236e377c9%252Fpa%252FZM57231_91843eeec8988b220c4ca4bf78217101.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_91843eeec8988b220c4ca4bf78217101.jpg saved to cache
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ce5f4cc-c997-5461-b70a-ad2a38a6dd62
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_92ea9cd165455b14b8936476c89697f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_92ea9cd165455b14b8936476c89697f8.jpg not downloaded yet
2026-03-28 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_93dd3efad86353ea95667b299d1f4a71.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_7452c62f75ec058ddcad861a21f4698b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d450dd0>
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_07fd649091b1d80a303055c6616140e4.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_07fd649091b1d80a303055c6616140e4.jpg saved to cache
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 202afcd8-3aa8-5196-8906-130b49fa0733
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_505546c2285e07182413494948f4198e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_505546c2285e07182413494948f4198e.jpg not downloaded yet
2026-03-28 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_d6da383ea053d81116329695521c765d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_45eecde2fe8f0b6d67afd3630b876e26.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb289d0>
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_22202a5b9a53ea55466b7771d53f8341.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_22202a5b9a53ea55466b7771d53f8341.jpg saved to cache
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 33a0871a-57e2-54c6-93fe-e9f467f9dccc
2026-03-28 12:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f84444e-222a-598e-b072-2131cad2713c with identifier: BX84836
2026-03-28 12:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f84444e-222a-598e-b072-2131cad2713c with scrape type 1
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5f84444e-222a-598e-b072-2131cad2713c
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff1%252F91f13e35a449f69e2a45ae5ccf7a7e14%252Fpa%252FBX84836_7b79d0e6a623c623ff53091f199ba239.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_7b79d0e6a623c623ff53091f199ba239.jpg not downloaded yet
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4b7990>
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_fa54d5e5940807952b3f8cb4da2d3d5f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_fa54d5e5940807952b3f8cb4da2d3d5f.jpg saved to cache
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 19d1220d-6dde-5042-96e4-7b520ea935a0
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c837910>
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ce5f4cc-c997-5461-b70a-ad2a38a6dd62/0ce5f4cc-c997-5461-b70a-ad2a38a6dd62_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F39%252F6439474116ed52038f0c28e236e377c9%252Fpa%252FZM57231_7852de0f1a52128b49159169b286ee7c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_7852de0f1a52128b49159169b286ee7c.jpg saved to cache
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ce5f4cc-c997-5461-b70a-ad2a38a6dd62
2026-03-28 12:01:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ce5f4cc-c997-5461-b70a-ad2a38a6dd62, skipping ID generation
2026-03-28 12:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ce5f4cc-c997-5461-b70a-ad2a38a6dd62 with scrape type 1
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ce5f4cc-c997-5461-b70a-ad2a38a6dd62 sending to next pipeline
2026-03-28 12:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0ce5f4cc-c997-5461-b70a-ad2a38a6dd62, identifier: ZM57231
2026-03-28 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_9cb603419042accd782f8d0188d16d1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0ce5f4cc-c997-5461-b70a-ad2a38a6dd62 with identifier: ZM57231
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 12:01:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0ce5f4cc-c997-5461-b70a-ad2a38a6dd62 with identifier: ZM57231
2026-03-28 12:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0ce5f4cc-c997-5461-b70a-ad2a38a6dd62 with identifier: ZM57231 to the API
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_7852de0f1a52128b49159169b286ee7c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 3',
'engine': '1.4L',
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:30:29Z',
'fuel_type': 'diesel',
'id': '0ce5f4cc-c997-5461-b70a-ad2a38a6dd62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM57231',
'listing': 'auction',
'location': 'IT, Navacchio',
'make': 'Toyota',
'model': 'Yaris Verso',
'odometer': 268108,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ce5f4cc-c997-5461-b70a-ad2a38a6dd62/0ce5f4cc-c997-5461-b70a-ad2a38a6dd62_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_0bece8c0195eec51f958d949a436a465.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ce5f4cc-c997-5461-b70a-ad2a38a6dd62/0ce5f4cc-c997-5461-b70a-ad2a38a6dd62_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_d0972a52fe2288e2758525e9d60197ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ce5f4cc-c997-5461-b70a-ad2a38a6dd62/0ce5f4cc-c997-5461-b70a-ad2a38a6dd62_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76288,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_91843eeec8988b220c4ca4bf78217101.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ce5f4cc-c997-5461-b70a-ad2a38a6dd62/0ce5f4cc-c997-5461-b70a-ad2a38a6dd62_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_c458d7322ded6474cc37e63cdb43a19e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ce5f4cc-c997-5461-b70a-ad2a38a6dd62/0ce5f4cc-c997-5461-b70a-ad2a38a6dd62_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70230,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/39/6439474116ed52038f0c28e236e377c9/pa/ZM57231_7852de0f1a52128b49159169b286ee7c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2003-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris Verso 1.4 D-4D Luna',
'transmission': 'manual',
'trim': 'Luna',
'year': 2003}
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM57231%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [auto1.it] INFO: Saving data for ZM57231: {'created_time': 1774699288.067591, 'last_price_update_time': 1774699288.067601, 'auction_closing_time': 1774884629.0}
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZM57231') HTTP/1.1" 204 0
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_ce549b16188ef71738aa40d2599b7bdb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff1%252F91f13e35a449f69e2a45ae5ccf7a7e14%252Fpa%252FBX84836_9ebb434a4b4994a017994e9cb3bf2bf4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_9ebb434a4b4994a017994e9cb3bf2bf4.jpg not downloaded yet
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_088e73ac6cd15d0ce589d3329c17cab6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_b6b8146f4078858a9cbcac8449f1a16f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff1%252F91f13e35a449f69e2a45ae5ccf7a7e14%252Fpa%252FBX84836_982239f90e6c1ac7a0a51c1bf6a2c502.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_982239f90e6c1ac7a0a51c1bf6a2c502.jpg not downloaded yet
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DK59825> (referer: https://www.auto1.com/v1/car-details-view/DK59825/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ65230> (referer: https://www.auto1.com/v1/car-details-view/YJ65230/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6c8a50>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_93dd3efad86353ea95667b299d1f4a71.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_93dd3efad86353ea95667b299d1f4a71.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 33a0871a-57e2-54c6-93fe-e9f467f9dccc
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4a3710>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_7452c62f75ec058ddcad861a21f4698b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_7452c62f75ec058ddcad861a21f4698b.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 19d1220d-6dde-5042-96e4-7b520ea935a0
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d795ed0>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_d6da383ea053d81116329695521c765d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_d6da383ea053d81116329695521c765d.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 19d1220d-6dde-5042-96e4-7b520ea935a0
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d58d150>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_343624c3-373e-513f-a631-a9401780e978/343624c3-373e-513f-a631-a9401780e978_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247eae4e01721332b04317e84461afa6%252Fpa%252FRL93891_45eecde2fe8f0b6d67afd3630b876e26.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_45eecde2fe8f0b6d67afd3630b876e26.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 343624c3-373e-513f-a631-a9401780e978
2026-03-28 12:01:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d794390>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_9cb603419042accd782f8d0188d16d1b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_9cb603419042accd782f8d0188d16d1b.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7e5922e0-4510-5fd3-9a45-9d86124bf86e
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff1%252F91f13e35a449f69e2a45ae5ccf7a7e14%252Fpa%252FBX84836_8bfd4d32aae106787641415aeb70e0dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_8bfd4d32aae106787641415aeb70e0dc.jpg not downloaded yet
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_7c0aef45a751eaffe5a9526718c35e2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_bf3acc3e9492fee8d08d72548d53a6de.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff1%252F91f13e35a449f69e2a45ae5ccf7a7e14%252Fpa%252FBX84836_f469c4091cfc5ec79d20abe0a5f41d0e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_f469c4091cfc5ec79d20abe0a5f41d0e.jpg not downloaded yet
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca81690>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_ce549b16188ef71738aa40d2599b7bdb.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_ce549b16188ef71738aa40d2599b7bdb.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 33a0871a-57e2-54c6-93fe-e9f467f9dccc
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f5b12d0>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_343624c3-373e-513f-a631-a9401780e978/343624c3-373e-513f-a631-a9401780e978_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247eae4e01721332b04317e84461afa6%252Fpa%252FRL93891_088e73ac6cd15d0ce589d3329c17cab6.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_088e73ac6cd15d0ce589d3329c17cab6.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 343624c3-373e-513f-a631-a9401780e978
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d573f10>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_343624c3-373e-513f-a631-a9401780e978/343624c3-373e-513f-a631-a9401780e978_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247eae4e01721332b04317e84461afa6%252Fpa%252FRL93891_b6b8146f4078858a9cbcac8449f1a16f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_b6b8146f4078858a9cbcac8449f1a16f.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 343624c3-373e-513f-a631-a9401780e978
2026-03-28 12:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f89dd6f-47b9-5614-b3d5-7d24010e1917 with identifier: DK59825
2026-03-28 12:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f89dd6f-47b9-5614-b3d5-7d24010e1917 with scrape type 1
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f89dd6f-47b9-5614-b3d5-7d24010e1917
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_533dfc74108d9f637ab7dfe90c90bb28.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_533dfc74108d9f637ab7dfe90c90bb28.jpg not downloaded yet
2026-03-28 12:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2314c75-4344-5c8f-8b89-d0a0441e6f2e with identifier: YJ65230
2026-03-28 12:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2314c75-4344-5c8f-8b89-d0a0441e6f2e with scrape type 1
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b2314c75-4344-5c8f-8b89-d0a0441e6f2e
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa3%252F52a3d967080496c1ceae675559bace2a%252Fpa%252FYJ65230_3821cbf4c48e20137608a4b5715b2813.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_3821cbf4c48e20137608a4b5715b2813.jpg not downloaded yet
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_3cc8caede4726ed0d052bb6cba720372.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_43a213b340bfa9c74e695fe4c5886151.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_43a213b340bfa9c74e695fe4c5886151.jpg not downloaded yet
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa3%252F52a3d967080496c1ceae675559bace2a%252Fpa%252FYJ65230_7d5a802e26e1079fc8d8a5db41609117.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_7d5a802e26e1079fc8d8a5db41609117.jpg not downloaded yet
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_51cdb54f3691ef5915794a0f0965ec20.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_51cdb54f3691ef5915794a0f0965ec20.jpg not downloaded yet
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa3%252F52a3d967080496c1ceae675559bace2a%252Fpa%252FYJ65230_94120cf692ec9135bb1fc8231223d915.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_94120cf692ec9135bb1fc8231223d915.jpg not downloaded yet
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_92ea9cd165455b14b8936476c89697f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_7b79d0e6a623c623ff53091f199ba239.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb299d0>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_7c0aef45a751eaffe5a9526718c35e2a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_7c0aef45a751eaffe5a9526718c35e2a.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 33a0871a-57e2-54c6-93fe-e9f467f9dccc
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbd3790>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_bf3acc3e9492fee8d08d72548d53a6de.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_bf3acc3e9492fee8d08d72548d53a6de.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 19d1220d-6dde-5042-96e4-7b520ea935a0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_7189f8baec7726397f6c99b6ae077b34.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_7189f8baec7726397f6c99b6ae077b34.jpg not downloaded yet
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa3%252F52a3d967080496c1ceae675559bace2a%252Fpa%252FYJ65230_37670bb1935bd6863f4bf94064c99280.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_37670bb1935bd6863f4bf94064c99280.jpg not downloaded yet
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_99e365ade24836fc4919514d7b74b299.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f869fd0>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_343624c3-373e-513f-a631-a9401780e978/343624c3-373e-513f-a631-a9401780e978_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247eae4e01721332b04317e84461afa6%252Fpa%252FRL93891_3cc8caede4726ed0d052bb6cba720372.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_3cc8caede4726ed0d052bb6cba720372.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 343624c3-373e-513f-a631-a9401780e978
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_9ebb434a4b4994a017994e9cb3bf2bf4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_4d2539b7a982f4fc6730e46b157b7960.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_4d2539b7a982f4fc6730e46b157b7960.jpg not downloaded yet
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa3%252F52a3d967080496c1ceae675559bace2a%252Fpa%252FYJ65230_5bde1d4223cf639878bcb13be7d778d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_5bde1d4223cf639878bcb13be7d778d3.jpg not downloaded yet
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_36941efe5b950245db647fab0c87c9fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_36941efe5b950245db647fab0c87c9fb.jpg not downloaded yet
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4edbd0>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_92ea9cd165455b14b8936476c89697f8.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_92ea9cd165455b14b8936476c89697f8.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 33a0871a-57e2-54c6-93fe-e9f467f9dccc
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d483cd0>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f84444e-222a-598e-b072-2131cad2713c/5f84444e-222a-598e-b072-2131cad2713c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff1%252F91f13e35a449f69e2a45ae5ccf7a7e14%252Fpa%252FBX84836_7b79d0e6a623c623ff53091f199ba239.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_7b79d0e6a623c623ff53091f199ba239.jpg saved to cache
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f84444e-222a-598e-b072-2131cad2713c
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_6e9e1f8f4928ef3282e3545566e856ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_2524e26b11f4b04130694ecbf05047d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_8faa7beed92f66881dfb66c09ef50a4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_8faa7beed92f66881dfb66c09ef50a4d.jpg not downloaded yet
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_3c12c8f254a68362507260f2380e44a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_0ccfef0b24040c26b7b5e9b0ca8326d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_0ccfef0b24040c26b7b5e9b0ca8326d8.jpg not downloaded yet
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f86a810>
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_99e365ade24836fc4919514d7b74b299.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_99e365ade24836fc4919514d7b74b299.jpg saved to cache
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 19d1220d-6dde-5042-96e4-7b520ea935a0
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d483310>
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f84444e-222a-598e-b072-2131cad2713c/5f84444e-222a-598e-b072-2131cad2713c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff1%252F91f13e35a449f69e2a45ae5ccf7a7e14%252Fpa%252FBX84836_9ebb434a4b4994a017994e9cb3bf2bf4.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_9ebb434a4b4994a017994e9cb3bf2bf4.jpg saved to cache
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f84444e-222a-598e-b072-2131cad2713c
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_222096101770d2fa58653d3bf571eaf7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_222096101770d2fa58653d3bf571eaf7.jpg not downloaded yet
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_982239f90e6c1ac7a0a51c1bf6a2c502.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_3821cbf4c48e20137608a4b5715b2813.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_d90b00b1911317243b31282850fbd3ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_d90b00b1911317243b31282850fbd3ae.jpg not downloaded yet
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_6338a76e4469bcdcff710e4d591f9e52.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_8bfd4d32aae106787641415aeb70e0dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca72850>
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_6e9e1f8f4928ef3282e3545566e856ed.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_6e9e1f8f4928ef3282e3545566e856ed.jpg saved to cache
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 33a0871a-57e2-54c6-93fe-e9f467f9dccc
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d812050>
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fd6%252Fa3d6bf58f4444d070d041a1139c00976%252Fpa%252FXE84016_2524e26b11f4b04130694ecbf05047d0.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_2524e26b11f4b04130694ecbf05047d0.jpg saved to cache
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 19d1220d-6dde-5042-96e4-7b520ea935a0
2026-03-28 12:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19d1220d-6dde-5042-96e4-7b520ea935a0, skipping ID generation
2026-03-28 12:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19d1220d-6dde-5042-96e4-7b520ea935a0 with scrape type 1
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19d1220d-6dde-5042-96e4-7b520ea935a0 sending to next pipeline
2026-03-28 12:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 19d1220d-6dde-5042-96e4-7b520ea935a0, identifier: XE84016
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb91890>
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_343624c3-373e-513f-a631-a9401780e978/343624c3-373e-513f-a631-a9401780e978_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247eae4e01721332b04317e84461afa6%252Fpa%252FRL93891_3c12c8f254a68362507260f2380e44a2.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_3c12c8f254a68362507260f2380e44a2.jpg saved to cache
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 343624c3-373e-513f-a631-a9401780e978
2026-03-28 12:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 343624c3-373e-513f-a631-a9401780e978, skipping ID generation
2026-03-28 12:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 343624c3-373e-513f-a631-a9401780e978 with scrape type 1
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 343624c3-373e-513f-a631-a9401780e978 sending to next pipeline
2026-03-28 12:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 343624c3-373e-513f-a631-a9401780e978, identifier: RL93891
2026-03-28 12:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 19d1220d-6dde-5042-96e4-7b520ea935a0 with identifier: XE84016
2026-03-28 12:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 19d1220d-6dde-5042-96e4-7b520ea935a0 with identifier: XE84016
2026-03-28 12:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 19d1220d-6dde-5042-96e4-7b520ea935a0 with identifier: XE84016 to the API
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_2524e26b11f4b04130694ecbf05047d0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:10:19Z',
'fuel_type': 'diesel',
'id': '19d1220d-6dde-5042-96e4-7b520ea935a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE84016',
'listing': 'auction',
'location': 'IT, Latina',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 240940,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60885,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_78b264a7fcc1b1c3497f9782192862bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_5a5ca039ec676da4f4e7328bfa6e164f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54557,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_bf0bbc2ca47dada3c3c98b7e4f75ef6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_0a24371c72024f71db1efa27a2b02dc7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48583,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_7452c62f75ec058ddcad861a21f4698b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60120,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_fa54d5e5940807952b3f8cb4da2d3d5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55546,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_2524e26b11f4b04130694ecbf05047d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67259,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_d6da383ea053d81116329695521c765d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_99e365ade24836fc4919514d7b74b299.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1220d-6dde-5042-96e4-7b520ea935a0/19d1220d-6dde-5042-96e4-7b520ea935a0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/d6/a3d6bf58f4444d070d041a1139c00976/pa/XE84016_bf3acc3e9492fee8d08d72548d53a6de.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Trend & Fun BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trend & Fun BlueMotion Tech',
'year': 2012}
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE84016%27 HTTP/1.1" 200 None
2026-03-28 12:01:30 [auto1.it] INFO: Saving data for XE84016: {'created_time': 1774699290.059783, 'last_price_update_time': 1774699290.059794, 'auction_closing_time': 1774883419.0}
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XE84016') HTTP/1.1" 204 0
2026-03-28 12:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 343624c3-373e-513f-a631-a9401780e978 with identifier: RL93891
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 12:01:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 343624c3-373e-513f-a631-a9401780e978 with identifier: RL93891
2026-03-28 12:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 343624c3-373e-513f-a631-a9401780e978 with identifier: RL93891 to the API
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_3c12c8f254a68362507260f2380e44a2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 77,
'expiration_date': '2026-03-30T15:55:55Z',
'fuel_type': 'petrol',
'id': '343624c3-373e-513f-a631-a9401780e978',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL93891',
'listing': 'auction',
'location': 'IT, Lallio BG',
'make': 'Fiat',
'model': 'Qubo',
'odometer': 172633,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343624c3-373e-513f-a631-a9401780e978/343624c3-373e-513f-a631-a9401780e978_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_45eecde2fe8f0b6d67afd3630b876e26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343624c3-373e-513f-a631-a9401780e978/343624c3-373e-513f-a631-a9401780e978_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67394,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_3c12c8f254a68362507260f2380e44a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343624c3-373e-513f-a631-a9401780e978/343624c3-373e-513f-a631-a9401780e978_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73361,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_088e73ac6cd15d0ce589d3329c17cab6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343624c3-373e-513f-a631-a9401780e978/343624c3-373e-513f-a631-a9401780e978_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67708,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_b6b8146f4078858a9cbcac8449f1a16f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343624c3-373e-513f-a631-a9401780e978/343624c3-373e-513f-a631-a9401780e978_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/7e/247eae4e01721332b04317e84461afa6/pa/RL93891_3cc8caede4726ed0d052bb6cba720372.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Qubo 1.4 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2012}
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL93891%27 HTTP/1.1" 200 None
2026-03-28 12:01:30 [auto1.it] INFO: Saving data for RL93891: {'created_time': 1774699290.533272, 'last_price_update_time': 1774699290.53328, 'auction_closing_time': 1774886155.0}
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RL93891') HTTP/1.1" 204 0
2026-03-28 12:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_43a213b340bfa9c74e695fe4c5886151.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_7d5a802e26e1079fc8d8a5db41609117.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_94120cf692ec9135bb1fc8231223d915.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_37670bb1935bd6863f4bf94064c99280.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f532810>
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f84444e-222a-598e-b072-2131cad2713c/5f84444e-222a-598e-b072-2131cad2713c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff1%252F91f13e35a449f69e2a45ae5ccf7a7e14%252Fpa%252FBX84836_982239f90e6c1ac7a0a51c1bf6a2c502.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_982239f90e6c1ac7a0a51c1bf6a2c502.jpg saved to cache
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f84444e-222a-598e-b072-2131cad2713c
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca16d90>
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2314c75-4344-5c8f-8b89-d0a0441e6f2e/b2314c75-4344-5c8f-8b89-d0a0441e6f2e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa3%252F52a3d967080496c1ceae675559bace2a%252Fpa%252FYJ65230_3821cbf4c48e20137608a4b5715b2813.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_3821cbf4c48e20137608a4b5715b2813.jpg saved to cache
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2314c75-4344-5c8f-8b89-d0a0441e6f2e
2026-03-28 12:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbcd090>
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_6338a76e4469bcdcff710e4d591f9e52.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_6338a76e4469bcdcff710e4d591f9e52.jpg saved to cache
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 33a0871a-57e2-54c6-93fe-e9f467f9dccc
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c959450>
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f84444e-222a-598e-b072-2131cad2713c/5f84444e-222a-598e-b072-2131cad2713c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff1%252F91f13e35a449f69e2a45ae5ccf7a7e14%252Fpa%252FBX84836_8bfd4d32aae106787641415aeb70e0dc.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_8bfd4d32aae106787641415aeb70e0dc.jpg saved to cache
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f84444e-222a-598e-b072-2131cad2713c
2026-03-28 12:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_59fc85fb61c6153536b82aac46545d2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_36941efe5b950245db647fab0c87c9fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_ae727b949b072ce58e03418c7133ddaf.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c92b5d0>
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_43a213b340bfa9c74e695fe4c5886151.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_43a213b340bfa9c74e695fe4c5886151.jpg saved to cache
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f89dd6f-47b9-5614-b3d5-7d24010e1917
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cace650>
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2314c75-4344-5c8f-8b89-d0a0441e6f2e/b2314c75-4344-5c8f-8b89-d0a0441e6f2e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa3%252F52a3d967080496c1ceae675559bace2a%252Fpa%252FYJ65230_7d5a802e26e1079fc8d8a5db41609117.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_7d5a802e26e1079fc8d8a5db41609117.jpg saved to cache
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2314c75-4344-5c8f-8b89-d0a0441e6f2e
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca4b990>
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2314c75-4344-5c8f-8b89-d0a0441e6f2e/b2314c75-4344-5c8f-8b89-d0a0441e6f2e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa3%252F52a3d967080496c1ceae675559bace2a%252Fpa%252FYJ65230_94120cf692ec9135bb1fc8231223d915.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_94120cf692ec9135bb1fc8231223d915.jpg saved to cache
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2314c75-4344-5c8f-8b89-d0a0441e6f2e
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb7f1d0>
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2314c75-4344-5c8f-8b89-d0a0441e6f2e/b2314c75-4344-5c8f-8b89-d0a0441e6f2e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa3%252F52a3d967080496c1ceae675559bace2a%252Fpa%252FYJ65230_37670bb1935bd6863f4bf94064c99280.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_37670bb1935bd6863f4bf94064c99280.jpg saved to cache
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2314c75-4344-5c8f-8b89-d0a0441e6f2e
2026-03-28 12:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_9dee1b43b5d65d1680c15248b647d6c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_5bde1d4223cf639878bcb13be7d778d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB90809> (referer: https://www.auto1.com/v1/car-details-view/LB90809/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_0ccfef0b24040c26b7b5e9b0ca8326d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f591b90>
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_59fc85fb61c6153536b82aac46545d2b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_59fc85fb61c6153536b82aac46545d2b.jpg saved to cache
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 202afcd8-3aa8-5196-8906-130b49fa0733
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d810410>
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_36941efe5b950245db647fab0c87c9fb.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_36941efe5b950245db647fab0c87c9fb.jpg saved to cache
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f89dd6f-47b9-5614-b3d5-7d24010e1917
2026-03-28 12:01:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d46d950>
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_ae727b949b072ce58e03418c7133ddaf.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_ae727b949b072ce58e03418c7133ddaf.jpg saved to cache
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 33a0871a-57e2-54c6-93fe-e9f467f9dccc
2026-03-28 12:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_533dfc74108d9f637ab7dfe90c90bb28.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_222096101770d2fa58653d3bf571eaf7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_7189f8baec7726397f6c99b6ae077b34.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_d90b00b1911317243b31282850fbd3ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c96ef90>
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_9dee1b43b5d65d1680c15248b647d6c7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_9dee1b43b5d65d1680c15248b647d6c7.jpg saved to cache
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 202afcd8-3aa8-5196-8906-130b49fa0733
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca40e10>
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2314c75-4344-5c8f-8b89-d0a0441e6f2e/b2314c75-4344-5c8f-8b89-d0a0441e6f2e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa3%252F52a3d967080496c1ceae675559bace2a%252Fpa%252FYJ65230_5bde1d4223cf639878bcb13be7d778d3.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_5bde1d4223cf639878bcb13be7d778d3.jpg saved to cache
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2314c75-4344-5c8f-8b89-d0a0441e6f2e
2026-03-28 12:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2314c75-4344-5c8f-8b89-d0a0441e6f2e, skipping ID generation
2026-03-28 12:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2314c75-4344-5c8f-8b89-d0a0441e6f2e with scrape type 1
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2314c75-4344-5c8f-8b89-d0a0441e6f2e sending to next pipeline
2026-03-28 12:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b2314c75-4344-5c8f-8b89-d0a0441e6f2e, identifier: YJ65230
2026-03-28 12:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a274e13-7bc1-5c34-b52e-ac70c25ad473 with identifier: LB90809
2026-03-28 12:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a274e13-7bc1-5c34-b52e-ac70c25ad473 with scrape type 1
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a274e13-7bc1-5c34-b52e-ac70c25ad473
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_82c7c5cc003d547ee0c8fb643e8ae761.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_82c7c5cc003d547ee0c8fb643e8ae761.jpg not downloaded yet
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4820d0>
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_0ccfef0b24040c26b7b5e9b0ca8326d8.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_0ccfef0b24040c26b7b5e9b0ca8326d8.jpg saved to cache
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f89dd6f-47b9-5614-b3d5-7d24010e1917
2026-03-28 12:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b2314c75-4344-5c8f-8b89-d0a0441e6f2e with identifier: YJ65230
2026-03-28 12:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b2314c75-4344-5c8f-8b89-d0a0441e6f2e with identifier: YJ65230
2026-03-28 12:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b2314c75-4344-5c8f-8b89-d0a0441e6f2e with identifier: YJ65230 to the API
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_5bde1d4223cf639878bcb13be7d778d3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 229,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '3.0L',
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:24:24Z',
'fuel_type': 'diesel',
'id': 'b2314c75-4344-5c8f-8b89-d0a0441e6f2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ65230',
'listing': 'auction',
'location': 'IT, Lecco',
'make': 'Audi',
'model': 'A6',
'odometer': 322229,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2314c75-4344-5c8f-8b89-d0a0441e6f2e/b2314c75-4344-5c8f-8b89-d0a0441e6f2e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_3821cbf4c48e20137608a4b5715b2813.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2314c75-4344-5c8f-8b89-d0a0441e6f2e/b2314c75-4344-5c8f-8b89-d0a0441e6f2e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76189,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_7d5a802e26e1079fc8d8a5db41609117.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2314c75-4344-5c8f-8b89-d0a0441e6f2e/b2314c75-4344-5c8f-8b89-d0a0441e6f2e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_94120cf692ec9135bb1fc8231223d915.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2314c75-4344-5c8f-8b89-d0a0441e6f2e/b2314c75-4344-5c8f-8b89-d0a0441e6f2e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_37670bb1935bd6863f4bf94064c99280.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2314c75-4344-5c8f-8b89-d0a0441e6f2e/b2314c75-4344-5c8f-8b89-d0a0441e6f2e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img52/a3/52a3d967080496c1ceae675559bace2a/pa/YJ65230_5bde1d4223cf639878bcb13be7d778d3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2006}
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ65230%27 HTTP/1.1" 200 None
2026-03-28 12:01:32 [auto1.it] INFO: Saving data for YJ65230: {'created_time': 1774699292.845549, 'last_price_update_time': 1774699292.845559, 'auction_closing_time': 1774884264.0}
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YJ65230') HTTP/1.1" 204 0
2026-03-28 12:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_f469c4091cfc5ec79d20abe0a5f41d0e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_c6883f76afe08059f48d9e1af9eb0b82.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_c6883f76afe08059f48d9e1af9eb0b82.jpg not downloaded yet
2026-03-28 12:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_6de5e2063114497934cfe2b0d302e313.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_07a70fac849a4b76171338543a4dfbc7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_d5acdfc84814c4162a5c6e74a59b8e23.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_d5acdfc84814c4162a5c6e74a59b8e23.jpg not downloaded yet
2026-03-28 12:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb785d0>
2026-03-28 12:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_533dfc74108d9f637ab7dfe90c90bb28.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_533dfc74108d9f637ab7dfe90c90bb28.jpg saved to cache
2026-03-28 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f89dd6f-47b9-5614-b3d5-7d24010e1917
2026-03-28 12:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4c8f90>
2026-03-28 12:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_222096101770d2fa58653d3bf571eaf7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_222096101770d2fa58653d3bf571eaf7.jpg saved to cache
2026-03-28 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f89dd6f-47b9-5614-b3d5-7d24010e1917
2026-03-28 12:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca824d0>
2026-03-28 12:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_7189f8baec7726397f6c99b6ae077b34.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_7189f8baec7726397f6c99b6ae077b34.jpg saved to cache
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f89dd6f-47b9-5614-b3d5-7d24010e1917
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d570250>
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_d90b00b1911317243b31282850fbd3ae.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_d90b00b1911317243b31282850fbd3ae.jpg saved to cache
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f89dd6f-47b9-5614-b3d5-7d24010e1917
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_e3789bce54f79dcc59b8ef3fa5e2238f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_e3789bce54f79dcc59b8ef3fa5e2238f.jpg not downloaded yet
2026-03-28 12:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_623ebc41aed736b590c90fee5c5a57fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_b3a4a59c80571321ba60f659618699e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_505546c2285e07182413494948f4198e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_ded20b2d3a28568801cd18b58ed77371.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_728cc1ddc4fdeae278908fc2dda9110a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_728cc1ddc4fdeae278908fc2dda9110a.jpg not downloaded yet
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_3e74f4190ee4fc85cfac4dc9ad07a4db.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_3e74f4190ee4fc85cfac4dc9ad07a4db.jpg not downloaded yet
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5702d0>
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f84444e-222a-598e-b072-2131cad2713c/5f84444e-222a-598e-b072-2131cad2713c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff1%252F91f13e35a449f69e2a45ae5ccf7a7e14%252Fpa%252FBX84836_f469c4091cfc5ec79d20abe0a5f41d0e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_f469c4091cfc5ec79d20abe0a5f41d0e.jpg saved to cache
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f84444e-222a-598e-b072-2131cad2713c
2026-03-28 12:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f84444e-222a-598e-b072-2131cad2713c, skipping ID generation
2026-03-28 12:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f84444e-222a-598e-b072-2131cad2713c with scrape type 1
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f84444e-222a-598e-b072-2131cad2713c sending to next pipeline
2026-03-28 12:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5f84444e-222a-598e-b072-2131cad2713c, identifier: BX84836
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca73f10>
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd7%252F26d731bd1f0190cdaf0b7c771d474075%252Fpa%252FMX89615_6de5e2063114497934cfe2b0d302e313.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_6de5e2063114497934cfe2b0d302e313.jpg saved to cache
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c5c3a64-672a-5c42-ad54-94525f5a1beb
2026-03-28 12:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c5c3a64-672a-5c42-ad54-94525f5a1beb, skipping ID generation
2026-03-28 12:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c5c3a64-672a-5c42-ad54-94525f5a1beb with scrape type 1
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c5c3a64-672a-5c42-ad54-94525f5a1beb sending to next pipeline
2026-03-28 12:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9c5c3a64-672a-5c42-ad54-94525f5a1beb, identifier: MX89615
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb7b310>
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_07a70fac849a4b76171338543a4dfbc7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_07a70fac849a4b76171338543a4dfbc7.jpg saved to cache
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7e5922e0-4510-5fd3-9a45-9d86124bf86e
2026-03-28 12:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5f84444e-222a-598e-b072-2131cad2713c with identifier: BX84836
2026-03-28 12:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5f84444e-222a-598e-b072-2131cad2713c with identifier: BX84836
2026-03-28 12:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5f84444e-222a-598e-b072-2131cad2713c with identifier: BX84836 to the API
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_f469c4091cfc5ec79d20abe0a5f41d0e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.0L',
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:14:40Z',
'fuel_type': 'petrol',
'id': '5f84444e-222a-598e-b072-2131cad2713c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX84836',
'listing': 'auction',
'location': 'IT, Alessandria',
'make': 'Citroen',
'model': 'C1',
'odometer': 94167,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f84444e-222a-598e-b072-2131cad2713c/5f84444e-222a-598e-b072-2131cad2713c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_7b79d0e6a623c623ff53091f199ba239.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f84444e-222a-598e-b072-2131cad2713c/5f84444e-222a-598e-b072-2131cad2713c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59020,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_9ebb434a4b4994a017994e9cb3bf2bf4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f84444e-222a-598e-b072-2131cad2713c/5f84444e-222a-598e-b072-2131cad2713c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56422,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_982239f90e6c1ac7a0a51c1bf6a2c502.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f84444e-222a-598e-b072-2131cad2713c/5f84444e-222a-598e-b072-2131cad2713c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_8bfd4d32aae106787641415aeb70e0dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f84444e-222a-598e-b072-2131cad2713c/5f84444e-222a-598e-b072-2131cad2713c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57350,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/f1/91f13e35a449f69e2a45ae5ccf7a7e14/pa/BX84836_f469c4091cfc5ec79d20abe0a5f41d0e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-09-16',
'seats_number': 4,
'seller_name': None,
'title': 'Citroen C1 1.0 Pulp',
'transmission': 'manual',
'trim': 'Pulp',
'year': 2009}
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX84836%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.it] INFO: Saving data for BX84836: {'created_time': 1774699293.877256, 'last_price_update_time': 1774699293.877266, 'auction_closing_time': 1774883680.0}
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BX84836') HTTP/1.1" 204 0
2026-03-28 12:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9c5c3a64-672a-5c42-ad54-94525f5a1beb with identifier: MX89615
2026-03-28 12:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9c5c3a64-672a-5c42-ad54-94525f5a1beb with identifier: MX89615
2026-03-28 12:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9c5c3a64-672a-5c42-ad54-94525f5a1beb with identifier: MX89615 to the API
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_6de5e2063114497934cfe2b0d302e313.jpg>
{'auction_title': '',
'c_o_2_emission_value': 98,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:06:39Z',
'fuel_type': 'petrol',
'id': '9c5c3a64-672a-5c42-ad54-94525f5a1beb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX89615',
'listing': 'auction',
'location': 'IT, Beinasco',
'make': 'Smart',
'model': 'forfour',
'odometer': 99141,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71183,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_6de5e2063114497934cfe2b0d302e313.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74310,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_6671e571755ab797dba5c011cb11f806.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66467,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_b5b9b24f7b845abfd2856b8eff3d082f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61907,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_ebdb2900cf58dbb2ec7fa89e42745ef6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73498,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_ba493caae10bbcd862f09f26d64ccbfd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67189,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_06881741fbeaa9c6981b793735e8cd4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_42164db87e15b29a3c925673ac0d7db7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_2f37996c4020885bef07b0819bfa34c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76958,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_931944c022c35ffc51eac97c71178a21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c5c3a64-672a-5c42-ad54-94525f5a1beb/9c5c3a64-672a-5c42-ad54-94525f5a1beb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d7/26d731bd1f0190cdaf0b7c771d474075/pa/MX89615_17340291c0c7bbb4e1a0537c3ad96299.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-31',
'seats_number': 4,
'seller_name': None,
'title': 'Smart forfour 0.9 Turbo Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2018}
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX89615%27 HTTP/1.1" 200 None
2026-03-28 12:01:34 [auto1.it] INFO: Saving data for MX89615: {'created_time': 1774699294.260734, 'last_price_update_time': 1774699294.260745, 'auction_closing_time': 1774883199.0}
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MX89615') HTTP/1.1" 204 0
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_972bfb1932eaab3314941c5713cd8a43.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_972bfb1932eaab3314941c5713cd8a43.jpg not downloaded yet
2026-03-28 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_d9feec1273b2c785c397435532ba0fd7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_f1273a2327f09aaeec4a0192770a764e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_89ff3c046f7c77c4a36f17a24ab350ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB64949/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX60727/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TV81460/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_e9dfbc63883960f4452b4b3d99673b7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_e9dfbc63883960f4452b4b3d99673b7d.jpg not downloaded yet
2026-03-28 12:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbefbd0>
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_623ebc41aed736b590c90fee5c5a57fb.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_623ebc41aed736b590c90fee5c5a57fb.jpg saved to cache
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d24e46a-4936-5251-973c-958aa2ab4326
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d699fd0>
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c09ea6e-ff64-5664-85a8-60dcb96f4be4/3c09ea6e-ff64-5664-85a8-60dcb96f4be4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f5b8747fb7b63b18ade81cd52237a2%252Fpa%252FCZ80815_b3a4a59c80571321ba60f659618699e0.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_b3a4a59c80571321ba60f659618699e0.jpg saved to cache
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c09ea6e-ff64-5664-85a8-60dcb96f4be4
2026-03-28 12:01:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca72610>
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F60%252F8360bdb631ab67af097d790eaacd824e%252Fpa%252FJD08634_505546c2285e07182413494948f4198e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_505546c2285e07182413494948f4198e.jpg saved to cache
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 33a0871a-57e2-54c6-93fe-e9f467f9dccc
2026-03-28 12:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33a0871a-57e2-54c6-93fe-e9f467f9dccc, skipping ID generation
2026-03-28 12:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33a0871a-57e2-54c6-93fe-e9f467f9dccc with scrape type 1
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33a0871a-57e2-54c6-93fe-e9f467f9dccc sending to next pipeline
2026-03-28 12:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 33a0871a-57e2-54c6-93fe-e9f467f9dccc, identifier: JD08634
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb7c510>
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_ded20b2d3a28568801cd18b58ed77371.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_ded20b2d3a28568801cd18b58ed77371.jpg saved to cache
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7e5922e0-4510-5fd3-9a45-9d86124bf86e
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_b14a924cf3ac4965703300325cb7bccc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_b14a924cf3ac4965703300325cb7bccc.jpg not downloaded yet
2026-03-28 12:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 33a0871a-57e2-54c6-93fe-e9f467f9dccc with identifier: JD08634
2026-03-28 12:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 33a0871a-57e2-54c6-93fe-e9f467f9dccc with identifier: JD08634
2026-03-28 12:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 33a0871a-57e2-54c6-93fe-e9f467f9dccc with identifier: JD08634 to the API
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_505546c2285e07182413494948f4198e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 101,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.5L',
'engine_horse_power': 222,
'expiration_date': '2026-03-30T15:27:25Z',
'fuel_type': 'hybrid',
'id': '33a0871a-57e2-54c6-93fe-e9f467f9dccc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD08634',
'listing': 'auction',
'location': 'IT, Cesano Maderno',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 37203,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75265,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_ce4331f5dae8ba7899ae42ff3a7514bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2501696,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_6338a76e4469bcdcff710e4d591f9e52.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68867,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_22202a5b9a53ea55466b7771d53f8341.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54748,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_6e9e1f8f4928ef3282e3545566e856ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_93dd3efad86353ea95667b299d1f4a71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_ce549b16188ef71738aa40d2599b7bdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2095774,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_ae727b949b072ce58e03418c7133ddaf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_7c0aef45a751eaffe5a9526718c35e2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69906,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_92ea9cd165455b14b8936476c89697f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a0871a-57e2-54c6-93fe-e9f467f9dccc/33a0871a-57e2-54c6-93fe-e9f467f9dccc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2840401,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img83/60/8360bdb631ab67af097d790eaacd824e/pa/JD08634_505546c2285e07182413494948f4198e.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota RAV 4 2.5 Hybrid 4x4 Style',
'transmission': 'automatic',
'trim': '4x4 Style',
'year': 2020}
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD08634%27 HTTP/1.1" 200 None
2026-03-28 12:01:35 [auto1.it] INFO: Saving data for JD08634: {'created_time': 1774699295.049647, 'last_price_update_time': 1774699295.049655, 'auction_closing_time': 1774884445.0}
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JD08634') HTTP/1.1" 204 0
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_c6883f76afe08059f48d9e1af9eb0b82.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_d5acdfc84814c4162a5c6e74a59b8e23.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_e464b6443e1b884a0f084af48bab0ee9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_dff56ade9bb6be53d3f35a3148163b35.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_dff56ade9bb6be53d3f35a3148163b35.jpg not downloaded yet
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4d0d10>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_d9feec1273b2c785c397435532ba0fd7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_d9feec1273b2c785c397435532ba0fd7.jpg saved to cache
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d24e46a-4936-5251-973c-958aa2ab4326
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbfc2d0>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_f1273a2327f09aaeec4a0192770a764e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_f1273a2327f09aaeec4a0192770a764e.jpg saved to cache
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e5922e0-4510-5fd3-9a45-9d86124bf86e
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c958890>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_89ff3c046f7c77c4a36f17a24ab350ce.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_89ff3c046f7c77c4a36f17a24ab350ce.jpg saved to cache
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e5922e0-4510-5fd3-9a45-9d86124bf86e
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d49f510>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_c6883f76afe08059f48d9e1af9eb0b82.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_c6883f76afe08059f48d9e1af9eb0b82.jpg saved to cache
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a274e13-7bc1-5c34-b52e-ac70c25ad473
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca76690>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_d5acdfc84814c4162a5c6e74a59b8e23.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_d5acdfc84814c4162a5c6e74a59b8e23.jpg saved to cache
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a274e13-7bc1-5c34-b52e-ac70c25ad473
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb55390>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c09ea6e-ff64-5664-85a8-60dcb96f4be4/3c09ea6e-ff64-5664-85a8-60dcb96f4be4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f5b8747fb7b63b18ade81cd52237a2%252Fpa%252FCZ80815_e464b6443e1b884a0f084af48bab0ee9.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_e464b6443e1b884a0f084af48bab0ee9.jpg saved to cache
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c09ea6e-ff64-5664-85a8-60dcb96f4be4
2026-03-28 12:01:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c09ea6e-ff64-5664-85a8-60dcb96f4be4, skipping ID generation
2026-03-28 12:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c09ea6e-ff64-5664-85a8-60dcb96f4be4 with scrape type 1
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c09ea6e-ff64-5664-85a8-60dcb96f4be4 sending to next pipeline
2026-03-28 12:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3c09ea6e-ff64-5664-85a8-60dcb96f4be4, identifier: CZ80815
2026-03-28 12:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3c09ea6e-ff64-5664-85a8-60dcb96f4be4 with identifier: CZ80815
2026-03-28 12:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3c09ea6e-ff64-5664-85a8-60dcb96f4be4 with identifier: CZ80815
2026-03-28 12:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3c09ea6e-ff64-5664-85a8-60dcb96f4be4 with identifier: CZ80815 to the API
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_e464b6443e1b884a0f084af48bab0ee9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:12:25Z',
'fuel_type': 'petrol',
'id': '3c09ea6e-ff64-5664-85a8-60dcb96f4be4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ80815',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'Ford',
'model': 'Ka',
'odometer': 140029,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c09ea6e-ff64-5664-85a8-60dcb96f4be4/3c09ea6e-ff64-5664-85a8-60dcb96f4be4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_e464b6443e1b884a0f084af48bab0ee9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c09ea6e-ff64-5664-85a8-60dcb96f4be4/3c09ea6e-ff64-5664-85a8-60dcb96f4be4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_9fd26cbe2f7d943de5a22239c145b302.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c09ea6e-ff64-5664-85a8-60dcb96f4be4/3c09ea6e-ff64-5664-85a8-60dcb96f4be4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75109,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_11ef814e9a0407f3db94d5a5c6bd85e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c09ea6e-ff64-5664-85a8-60dcb96f4be4/3c09ea6e-ff64-5664-85a8-60dcb96f4be4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58051,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_b3a4a59c80571321ba60f659618699e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c09ea6e-ff64-5664-85a8-60dcb96f4be4/3c09ea6e-ff64-5664-85a8-60dcb96f4be4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72498,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/f5/86f5b8747fb7b63b18ade81cd52237a2/pa/CZ80815_efcad9a0d91498cf908bbc9a83dc92e3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-02-28',
'seats_number': 4,
'seller_name': None,
'title': 'Ford Ka 1.2 Plus',
'transmission': 'manual',
'trim': 'Plus',
'year': 2013}
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ80815%27 HTTP/1.1" 200 None
2026-03-28 12:01:35 [auto1.it] INFO: Saving data for CZ80815: {'created_time': 1774699295.869467, 'last_price_update_time': 1774699295.869477, 'auction_closing_time': 1774883545.0}
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CZ80815') HTTP/1.1" 204 0
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_3e74f4190ee4fc85cfac4dc9ad07a4db.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_e3789bce54f79dcc59b8ef3fa5e2238f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_8faa7beed92f66881dfb66c09ef50a4d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_21889b7d44bae0ce8c2a47d38b769971.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH45027/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_4d2539b7a982f4fc6730e46b157b7960.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_51cdb54f3691ef5915794a0f0965ec20.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_82c7c5cc003d547ee0c8fb643e8ae761.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_e6c74da635cdacf56afb5c419096a9f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_63700bb1f76003e3ad88eb083eddc6df.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3e470510>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_3e74f4190ee4fc85cfac4dc9ad07a4db.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_3e74f4190ee4fc85cfac4dc9ad07a4db.jpg saved to cache
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a274e13-7bc1-5c34-b52e-ac70c25ad473
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d65e8d0>
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_e3789bce54f79dcc59b8ef3fa5e2238f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_e3789bce54f79dcc59b8ef3fa5e2238f.jpg saved to cache
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a274e13-7bc1-5c34-b52e-ac70c25ad473
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_728cc1ddc4fdeae278908fc2dda9110a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME27860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_972bfb1932eaab3314941c5713cd8a43.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_feefb250c658a093814f401d96a3ab3b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_b14a924cf3ac4965703300325cb7bccc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca38c90>
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_8faa7beed92f66881dfb66c09ef50a4d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_8faa7beed92f66881dfb66c09ef50a4d.jpg saved to cache
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f89dd6f-47b9-5614-b3d5-7d24010e1917
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4288d0>
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b66dc5679559ba59f68094c5ebada3%252Fpa%252FHB76167_21889b7d44bae0ce8c2a47d38b769971.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_21889b7d44bae0ce8c2a47d38b769971.jpg saved to cache
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e5922e0-4510-5fd3-9a45-9d86124bf86e
2026-03-28 12:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e5922e0-4510-5fd3-9a45-9d86124bf86e, skipping ID generation
2026-03-28 12:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e5922e0-4510-5fd3-9a45-9d86124bf86e with scrape type 1
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e5922e0-4510-5fd3-9a45-9d86124bf86e sending to next pipeline
2026-03-28 12:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7e5922e0-4510-5fd3-9a45-9d86124bf86e, identifier: HB76167
2026-03-28 12:01:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c989c90>
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_4d2539b7a982f4fc6730e46b157b7960.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_4d2539b7a982f4fc6730e46b157b7960.jpg saved to cache
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f89dd6f-47b9-5614-b3d5-7d24010e1917
2026-03-28 12:01:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cad66d0>
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fb4%252F56b44c0e6d120cdf2c0234d49665f477%252Fpa%252FDK59825_51cdb54f3691ef5915794a0f0965ec20.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_51cdb54f3691ef5915794a0f0965ec20.jpg saved to cache
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f89dd6f-47b9-5614-b3d5-7d24010e1917
2026-03-28 12:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f89dd6f-47b9-5614-b3d5-7d24010e1917, skipping ID generation
2026-03-28 12:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f89dd6f-47b9-5614-b3d5-7d24010e1917 with scrape type 1
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f89dd6f-47b9-5614-b3d5-7d24010e1917 sending to next pipeline
2026-03-28 12:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8f89dd6f-47b9-5614-b3d5-7d24010e1917, identifier: DK59825
2026-03-28 12:01:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbd1450>
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_82c7c5cc003d547ee0c8fb643e8ae761.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_82c7c5cc003d547ee0c8fb643e8ae761.jpg saved to cache
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a274e13-7bc1-5c34-b52e-ac70c25ad473
2026-03-28 12:01:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb20a50>
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff2%252F06f2a6a0204a8c7f10dbefe573b3310b%252Fpa%252FCK02940_e6c74da635cdacf56afb5c419096a9f2.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_e6c74da635cdacf56afb5c419096a9f2.jpg saved to cache
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 202afcd8-3aa8-5196-8906-130b49fa0733
2026-03-28 12:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 202afcd8-3aa8-5196-8906-130b49fa0733, skipping ID generation
2026-03-28 12:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 202afcd8-3aa8-5196-8906-130b49fa0733 with scrape type 1
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 202afcd8-3aa8-5196-8906-130b49fa0733 sending to next pipeline
2026-03-28 12:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 202afcd8-3aa8-5196-8906-130b49fa0733, identifier: CK02940
2026-03-28 12:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c9895d0>
2026-03-28 12:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d832aa8-d665-54b0-a41e-39953f141455/9d832aa8-d665-54b0-a41e-39953f141455_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fbe%252F14bedd6dbde45625f5c100caee65851b%252Fpa%252FNW63690_63700bb1f76003e3ad88eb083eddc6df.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_63700bb1f76003e3ad88eb083eddc6df.jpg saved to cache
2026-03-28 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d832aa8-d665-54b0-a41e-39953f141455
2026-03-28 12:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7e5922e0-4510-5fd3-9a45-9d86124bf86e with identifier: HB76167
2026-03-28 12:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7e5922e0-4510-5fd3-9a45-9d86124bf86e with identifier: HB76167
2026-03-28 12:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7e5922e0-4510-5fd3-9a45-9d86124bf86e with identifier: HB76167 to the API
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_21889b7d44bae0ce8c2a47d38b769971.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:38:48Z',
'fuel_type': 'diesel',
'id': '7e5922e0-4510-5fd3-9a45-9d86124bf86e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB76167',
'listing': 'auction',
'location': 'IT, Mantova',
'make': 'Audi',
'model': 'Q3',
'odometer': 105039,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_e18b00df4ae5457b369536c1142a35c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458722,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_a8186f5fccf870d068248e52367f628c.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_a958c2c2567674a71810cf5d0428a0a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_21889b7d44bae0ce8c2a47d38b769971.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_89ff3c046f7c77c4a36f17a24ab350ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_f1273a2327f09aaeec4a0192770a764e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68643,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_ded20b2d3a28568801cd18b58ed77371.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_b7ad491cc76539c0336df3eb2353a64e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_07a70fac849a4b76171338543a4dfbc7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5922e0-4510-5fd3-9a45-9d86124bf86e/7e5922e0-4510-5fd3-9a45-9d86124bf86e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335138,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/img75/b6/75b66dc5679559ba59f68094c5ebada3/pa/HB76167_9cb603419042accd782f8d0188d16d1b.jpg',
'Width': 1200}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 35 TDI S Line',
'transmission': 'automatic',
'trim': 'S Line',
'year': 2020}
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB76167%27 HTTP/1.1" 200 None
2026-03-28 12:01:37 [auto1.it] INFO: Saving data for HB76167: {'created_time': 1774699297.468157, 'last_price_update_time': 1774699297.46817, 'auction_closing_time': 1774885128.0}
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HB76167') HTTP/1.1" 204 0
2026-03-28 12:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8f89dd6f-47b9-5614-b3d5-7d24010e1917 with identifier: DK59825
2026-03-28 12:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8f89dd6f-47b9-5614-b3d5-7d24010e1917 with identifier: DK59825
2026-03-28 12:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8f89dd6f-47b9-5614-b3d5-7d24010e1917 with identifier: DK59825 to the API
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_51cdb54f3691ef5915794a0f0965ec20.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:28:21Z',
'fuel_type': 'petrol',
'id': '8f89dd6f-47b9-5614-b3d5-7d24010e1917',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK59825',
'listing': 'auction',
'location': 'IT, Piacenza',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 106981,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_533dfc74108d9f637ab7dfe90c90bb28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_43a213b340bfa9c74e695fe4c5886151.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2282443,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_51cdb54f3691ef5915794a0f0965ec20.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_7189f8baec7726397f6c99b6ae077b34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2362396,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_4d2539b7a982f4fc6730e46b157b7960.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61964,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_36941efe5b950245db647fab0c87c9fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1959861,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_8faa7beed92f66881dfb66c09ef50a4d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66697,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_0ccfef0b24040c26b7b5e9b0ca8326d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62942,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_222096101770d2fa58653d3bf571eaf7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f89dd6f-47b9-5614-b3d5-7d24010e1917/8f89dd6f-47b9-5614-b3d5-7d24010e1917_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/b4/56b44c0e6d120cdf2c0234d49665f477/pa/DK59825_d90b00b1911317243b31282850fbd3ae.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.0 VVT-i',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK59825%27 HTTP/1.1" 200 None
2026-03-28 12:01:37 [auto1.it] INFO: Saving data for DK59825: {'created_time': 1774699297.884869, 'last_price_update_time': 1774699297.884879, 'auction_closing_time': 1774884501.0}
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DK59825') HTTP/1.1" 204 0
2026-03-28 12:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 202afcd8-3aa8-5196-8906-130b49fa0733 with identifier: CK02940
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 12:01:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 202afcd8-3aa8-5196-8906-130b49fa0733 with identifier: CK02940
2026-03-28 12:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 202afcd8-3aa8-5196-8906-130b49fa0733 with identifier: CK02940 to the API
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_e6c74da635cdacf56afb5c419096a9f2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:22:00Z',
'fuel_type': 'petrol',
'id': '202afcd8-3aa8-5196-8906-130b49fa0733',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK02940',
'listing': 'auction',
'location': 'IT, Tradein',
'make': 'Renault',
'model': 'Captur',
'odometer': 138151,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3405580,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_e6c74da635cdacf56afb5c419096a9f2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_cc7f66009bc148f3b9a726f4c7de0f50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_8cf5999543302e46c2b8258af4cfab6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_07fd649091b1d80a303055c6616140e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_a2c12f59de85dac5ace1685779cca0b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3247956,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_59fc85fb61c6153536b82aac46545d2b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_3500e983be7b31b0ff5202251f2f37b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_7398709e16d3150f3369a0ef18b1fbe8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3338064,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_9dee1b43b5d65d1680c15248b647d6c7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202afcd8-3aa8-5196-8906-130b49fa0733/202afcd8-3aa8-5196-8906-130b49fa0733_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69021,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/f2/06f2a6a0204a8c7f10dbefe573b3310b/pa/CK02940_66090f35fe1a5a565c5120cc654af02e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 0.9 Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2015}
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK02940%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.it] INFO: Saving data for CK02940: {'created_time': 1774699298.438418, 'last_price_update_time': 1774699298.438428, 'auction_closing_time': 1774884120.0}
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CK02940') HTTP/1.1" 204 0
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cafef50>
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_728cc1ddc4fdeae278908fc2dda9110a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_728cc1ddc4fdeae278908fc2dda9110a.jpg saved to cache
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a274e13-7bc1-5c34-b52e-ac70c25ad473
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cabe490>
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_972bfb1932eaab3314941c5713cd8a43.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_972bfb1932eaab3314941c5713cd8a43.jpg saved to cache
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a274e13-7bc1-5c34-b52e-ac70c25ad473
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb81810>
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_feefb250c658a093814f401d96a3ab3b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_feefb250c658a093814f401d96a3ab3b.jpg saved to cache
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0b2331b2-bba6-56f9-b66a-9e6924ff7f48
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cabf290>
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_b14a924cf3ac4965703300325cb7bccc.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_b14a924cf3ac4965703300325cb7bccc.jpg saved to cache
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a274e13-7bc1-5c34-b52e-ac70c25ad473
2026-03-28 12:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_41c068d1ed39abcd6f7eebd227edf95b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_e9dfbc63883960f4452b4b3d99673b7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_dff56ade9bb6be53d3f35a3148163b35.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_287eb1f0bc990689305a99dbd3b3cf37.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_9778677d7e35af8f6265dcaddc8c2262.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4a8350>
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_41c068d1ed39abcd6f7eebd227edf95b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_41c068d1ed39abcd6f7eebd227edf95b.jpg saved to cache
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d24e46a-4936-5251-973c-958aa2ab4326
2026-03-28 12:01:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb44450>
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_e9dfbc63883960f4452b4b3d99673b7d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_e9dfbc63883960f4452b4b3d99673b7d.jpg saved to cache
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a274e13-7bc1-5c34-b52e-ac70c25ad473
2026-03-28 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_ba6b33877cd9b2708d4e8ffd3d9b8a16.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_e28076736df3b2b91f76e8c04a5142bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_42ead4553d68c94a5bb37f7a48c576ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6d4990>
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fd3%252F8cd3a95c8f5920b0eee382bc1ce65b8d%252Fpa%252FLB90809_dff56ade9bb6be53d3f35a3148163b35.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_dff56ade9bb6be53d3f35a3148163b35.jpg saved to cache
2026-03-28 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a274e13-7bc1-5c34-b52e-ac70c25ad473
2026-03-28 12:01:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a274e13-7bc1-5c34-b52e-ac70c25ad473, skipping ID generation
2026-03-28 12:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a274e13-7bc1-5c34-b52e-ac70c25ad473 with scrape type 1
2026-03-28 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a274e13-7bc1-5c34-b52e-ac70c25ad473 sending to next pipeline
2026-03-28 12:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3a274e13-7bc1-5c34-b52e-ac70c25ad473, identifier: LB90809
2026-03-28 12:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c9ad710>
2026-03-28 12:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fd6%252F0ed612adffd3cdebf2b2e6acb9537961%252Fpa%252FNZ66288_287eb1f0bc990689305a99dbd3b3cf37.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_287eb1f0bc990689305a99dbd3b3cf37.jpg saved to cache
2026-03-28 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d24e46a-4936-5251-973c-958aa2ab4326
2026-03-28 12:01:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d24e46a-4936-5251-973c-958aa2ab4326, skipping ID generation
2026-03-28 12:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d24e46a-4936-5251-973c-958aa2ab4326 with scrape type 1
2026-03-28 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d24e46a-4936-5251-973c-958aa2ab4326 sending to next pipeline
2026-03-28 12:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2d24e46a-4936-5251-973c-958aa2ab4326, identifier: NZ66288
2026-03-28 12:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cac0890>
2026-03-28 12:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d832aa8-d665-54b0-a41e-39953f141455/9d832aa8-d665-54b0-a41e-39953f141455_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fbe%252F14bedd6dbde45625f5c100caee65851b%252Fpa%252FNW63690_9778677d7e35af8f6265dcaddc8c2262.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_9778677d7e35af8f6265dcaddc8c2262.jpg saved to cache
2026-03-28 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d832aa8-d665-54b0-a41e-39953f141455
2026-03-28 12:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3a274e13-7bc1-5c34-b52e-ac70c25ad473 with identifier: LB90809
2026-03-28 12:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3a274e13-7bc1-5c34-b52e-ac70c25ad473 with identifier: LB90809
2026-03-28 12:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3a274e13-7bc1-5c34-b52e-ac70c25ad473 with identifier: LB90809 to the API
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_dff56ade9bb6be53d3f35a3148163b35.jpg>
{'auction_title': '',
'c_o_2_emission_value': 153,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:54:39Z',
'fuel_type': 'petrol',
'id': '3a274e13-7bc1-5c34-b52e-ac70c25ad473',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB90809',
'listing': 'auction',
'location': 'IT, Salerno',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 141767,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2026259,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_82c7c5cc003d547ee0c8fb643e8ae761.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60536,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_c6883f76afe08059f48d9e1af9eb0b82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62920,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_d5acdfc84814c4162a5c6e74a59b8e23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50800,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_e3789bce54f79dcc59b8ef3fa5e2238f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_728cc1ddc4fdeae278908fc2dda9110a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62772,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_3e74f4190ee4fc85cfac4dc9ad07a4db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_972bfb1932eaab3314941c5713cd8a43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2077543,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_e9dfbc63883960f4452b4b3d99673b7d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_b14a924cf3ac4965703300325cb7bccc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a274e13-7bc1-5c34-b52e-ac70c25ad473/3a274e13-7bc1-5c34-b52e-ac70c25ad473_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2303669,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8c/d3/8cd3a95c8f5920b0eee382bc1ce65b8d/pa/LB90809_dff56ade9bb6be53d3f35a3148163b35.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-04-26',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Mokka X 1.6 Advance S&S',
'transmission': 'manual',
'trim': 'Advance S&S',
'year': 2018}
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB90809%27 HTTP/1.1" 200 None
2026-03-28 12:01:39 [auto1.it] INFO: Saving data for LB90809: {'created_time': 1774699299.748132, 'last_price_update_time': 1774699299.748142, 'auction_closing_time': 1774886079.0}
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LB90809') HTTP/1.1" 204 0
2026-03-28 12:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2d24e46a-4936-5251-973c-958aa2ab4326 with identifier: NZ66288
2026-03-28 12:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2d24e46a-4936-5251-973c-958aa2ab4326 with identifier: NZ66288
2026-03-28 12:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2d24e46a-4936-5251-973c-958aa2ab4326 with identifier: NZ66288 to the API
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_287eb1f0bc990689305a99dbd3b3cf37.jpg>
{'auction_title': '',
'c_o_2_emission_value': 214,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '3.0L',
'engine_horse_power': 173,
'expiration_date': '2026-03-30T15:45:37Z',
'fuel_type': 'diesel',
'id': '2d24e46a-4936-5251-973c-958aa2ab4326',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ66288',
'listing': 'auction',
'location': 'IT, Legnano',
'make': 'Toyota',
'model': 'Land Cruiser',
'odometer': 96341,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_287eb1f0bc990689305a99dbd3b3cf37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2013861,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_9bf7e27dc411a21bea953ed63214accc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_95b145af78001062e5ae02f77c9882e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1862350,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_41c068d1ed39abcd6f7eebd227edf95b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_8c6372639dfc7fbdc6ec898a0f854256.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1932843,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_b960add7f0fe6f515d56ca76fa64b99a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50286,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_40219bd20f5be6737604909c24a20509.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67618,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_d9feec1273b2c785c397435532ba0fd7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_22f479551c70f1ab85add68748f8193b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d24e46a-4936-5251-973c-958aa2ab4326/2d24e46a-4936-5251-973c-958aa2ab4326_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61800,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/d6/0ed612adffd3cdebf2b2e6acb9537961/pa/NZ66288_623ebc41aed736b590c90fee5c5a57fb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-07-26',
'seats_number': 7,
'seller_name': None,
'title': 'Toyota Land Cruiser 3.0 D-4D Executive+',
'transmission': 'automatic',
'trim': 'Executive+',
'year': 2010}
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ66288%27 HTTP/1.1" 200 None
2026-03-28 12:01:40 [auto1.it] INFO: Saving data for NZ66288: {'created_time': 1774699300.147381, 'last_price_update_time': 1774699300.147392, 'auction_closing_time': 1774885537.0}
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NZ66288') HTTP/1.1" 204 0
2026-03-28 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ08821/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB86450/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TV81460> (referer: https://www.auto1.com/v1/car-details-view/TV81460/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX60727> (referer: https://www.auto1.com/v1/car-details-view/SX60727/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB64949> (referer: https://www.auto1.com/v1/car-details-view/PB64949/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL74097/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cac27d0>
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_ba6b33877cd9b2708d4e8ffd3d9b8a16.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_ba6b33877cd9b2708d4e8ffd3d9b8a16.jpg saved to cache
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0b2331b2-bba6-56f9-b66a-9e6924ff7f48
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7aaa50>
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d832aa8-d665-54b0-a41e-39953f141455/9d832aa8-d665-54b0-a41e-39953f141455_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fbe%252F14bedd6dbde45625f5c100caee65851b%252Fpa%252FNW63690_e28076736df3b2b91f76e8c04a5142bb.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_e28076736df3b2b91f76e8c04a5142bb.jpg saved to cache
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d832aa8-d665-54b0-a41e-39953f141455
2026-03-28 12:01:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d832aa8-d665-54b0-a41e-39953f141455, skipping ID generation
2026-03-28 12:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d832aa8-d665-54b0-a41e-39953f141455 with scrape type 1
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d832aa8-d665-54b0-a41e-39953f141455 sending to next pipeline
2026-03-28 12:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9d832aa8-d665-54b0-a41e-39953f141455, identifier: NW63690
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cae1c50>
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_42ead4553d68c94a5bb37f7a48c576ba.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_42ead4553d68c94a5bb37f7a48c576ba.jpg saved to cache
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0b2331b2-bba6-56f9-b66a-9e6924ff7f48
2026-03-28 12:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9d832aa8-d665-54b0-a41e-39953f141455 with identifier: NW63690
2026-03-28 12:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9d832aa8-d665-54b0-a41e-39953f141455 with identifier: NW63690
2026-03-28 12:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9d832aa8-d665-54b0-a41e-39953f141455 with identifier: NW63690 to the API
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_e28076736df3b2b91f76e8c04a5142bb.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 3',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:05:44Z',
'fuel_type': 'diesel',
'id': '9d832aa8-d665-54b0-a41e-39953f141455',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW63690',
'listing': 'auction',
'location': 'IT, Creazzo VI',
'make': 'Citroen',
'model': 'C4',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d832aa8-d665-54b0-a41e-39953f141455/9d832aa8-d665-54b0-a41e-39953f141455_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_70eed1bfd21b16e49ae1ea7106358e48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d832aa8-d665-54b0-a41e-39953f141455/9d832aa8-d665-54b0-a41e-39953f141455_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117056,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_e28076736df3b2b91f76e8c04a5142bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d832aa8-d665-54b0-a41e-39953f141455/9d832aa8-d665-54b0-a41e-39953f141455_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_04fd180dbc444ddc05aba21b795ecb8e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d832aa8-d665-54b0-a41e-39953f141455/9d832aa8-d665-54b0-a41e-39953f141455_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65524,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_9778677d7e35af8f6265dcaddc8c2262.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d832aa8-d665-54b0-a41e-39953f141455/9d832aa8-d665-54b0-a41e-39953f141455_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/be/14bedd6dbde45625f5c100caee65851b/pa/NW63690_63700bb1f76003e3ad88eb083eddc6df.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2005-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2005}
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW63690%27 HTTP/1.1" 200 None
2026-03-28 12:01:40 [auto1.it] INFO: Saving data for NW63690: {'created_time': 1774699300.758705, 'last_price_update_time': 1774699300.758716, 'auction_closing_time': 1774883144.0}
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NW63690') HTTP/1.1" 204 0
2026-03-28 12:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME27860> (referer: https://www.auto1.com/v1/car-details-view/ME27860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b with identifier: TV81460
2026-03-28 12:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b with scrape type 1
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fe9%252F8ce916e78c117337bfceb4e66712a5ed%252Fpa%252FTV81460_32467695b9ce25a6c1a67c1b3ef83e29.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_32467695b9ce25a6c1a67c1b3ef83e29.jpg not downloaded yet
2026-03-28 12:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d83c700-59c6-525f-93a6-99dedd768a75 with identifier: SX60727
2026-03-28 12:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d83c700-59c6-525f-93a6-99dedd768a75 with scrape type 1
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0d83c700-59c6-525f-93a6-99dedd768a75
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc5%252Fc7c5b789228c0ef379226d359a7fe3dc%252Fpa%252FSX60727_cc86a92575af59f48a158213053f0a78.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_cc86a92575af59f48a158213053f0a78.jpg not downloaded yet
2026-03-28 12:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7aab9ee-b288-5fb5-b653-3902730a1f77 with identifier: PB64949
2026-03-28 12:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7aab9ee-b288-5fb5-b653-3902730a1f77 with scrape type 1
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7aab9ee-b288-5fb5-b653-3902730a1f77
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_8cf35bfb75e4200640b90a0642f72ef3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_8cf35bfb75e4200640b90a0642f72ef3.jpg not downloaded yet
2026-03-28 12:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fe9%252F8ce916e78c117337bfceb4e66712a5ed%252Fpa%252FTV81460_de3ec38aea4a0d853bb539acc9d310de.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_de3ec38aea4a0d853bb539acc9d310de.jpg not downloaded yet
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc5%252Fc7c5b789228c0ef379226d359a7fe3dc%252Fpa%252FSX60727_48abd65853100ec1d00c7503630ea215.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_48abd65853100ec1d00c7503630ea215.jpg not downloaded yet
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_5f4e67d8e9fac1b0683f01fcd273e79c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_5f4e67d8e9fac1b0683f01fcd273e79c.jpg not downloaded yet
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fe9%252F8ce916e78c117337bfceb4e66712a5ed%252Fpa%252FTV81460_8a73b85331fb513db7bc56da12e2fbdb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_8a73b85331fb513db7bc56da12e2fbdb.jpg not downloaded yet
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc5%252Fc7c5b789228c0ef379226d359a7fe3dc%252Fpa%252FSX60727_4e1439fe30197c46dc2e3a8f402c9314.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_4e1439fe30197c46dc2e3a8f402c9314.jpg not downloaded yet
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_d2d92af5e7f32134d55c8cb067c0a9ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_d2d92af5e7f32134d55c8cb067c0a9ee.jpg not downloaded yet
2026-03-28 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_c9b3864c1e3c61fb3b5f9085fb95d63f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fe9%252F8ce916e78c117337bfceb4e66712a5ed%252Fpa%252FTV81460_4618a29776fb3672b83dcba4da62dd32.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_4618a29776fb3672b83dcba4da62dd32.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc5%252Fc7c5b789228c0ef379226d359a7fe3dc%252Fpa%252FSX60727_0b631fc53ad763220bdeafe3d5ab4468.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_0b631fc53ad763220bdeafe3d5ab4468.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_068ba9473ef2e30516ed99c987f30b71.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_068ba9473ef2e30516ed99c987f30b71.jpg not downloaded yet
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH45027> (referer: https://www.auto1.com/v1/car-details-view/ZH45027/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a11116e8-744f-56f3-a329-6a95fc21f4fe with identifier: ME27860
2026-03-28 12:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a11116e8-744f-56f3-a329-6a95fc21f4fe with scrape type 1
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_2115c708bd73d2cc528ffdb06e0c02be.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_2115c708bd73d2cc528ffdb06e0c02be.jpg not downloaded yet
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_778e72ca04e4cfe9baa5fcb91dde2085.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fe9%252F8ce916e78c117337bfceb4e66712a5ed%252Fpa%252FTV81460_42e882aaebe0801095bd4f29e09cee9b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_42e882aaebe0801095bd4f29e09cee9b.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc5%252Fc7c5b789228c0ef379226d359a7fe3dc%252Fpa%252FSX60727_d6cdfb90d7ddbb0417aff8489cca3ada.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_d6cdfb90d7ddbb0417aff8489cca3ada.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_fa4c4624b00633598e7b0792c81ba954.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_fa4c4624b00633598e7b0792c81ba954.jpg not downloaded yet
2026-03-28 12:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_ea82d7908cb3b780464e2bb7ff8acd09.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_ea82d7908cb3b780464e2bb7ff8acd09.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_3b1d7088504743721864982bf313d215.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_3b1d7088504743721864982bf313d215.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_07495f91f1bff6267171c45ecdd1481a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_07495f91f1bff6267171c45ecdd1481a.jpg not downloaded yet
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7aa610>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_c9b3864c1e3c61fb3b5f9085fb95d63f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_c9b3864c1e3c61fb3b5f9085fb95d63f.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b2331b2-bba6-56f9-b66a-9e6924ff7f48
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_0b283526c1de44b3cb8b411e80e80b58.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_0b283526c1de44b3cb8b411e80e80b58.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_5e7430417c61cfc6d7d11b052c7df979.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_5e7430417c61cfc6d7d11b052c7df979.jpg not downloaded yet
2026-03-28 12:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8 with identifier: ZH45027
2026-03-28 12:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8 with scrape type 1
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fda%252F58daa5aacce573094aea0d2245da36e8%252Fpa%252FZH45027_044541a1676e92bf0731e37a62e38256.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_044541a1676e92bf0731e37a62e38256.jpg not downloaded yet
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d68f790>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_778e72ca04e4cfe9baa5fcb91dde2085.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_778e72ca04e4cfe9baa5fcb91dde2085.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b2331b2-bba6-56f9-b66a-9e6924ff7f48
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_067e657b09ec039f3c8ce22c7899e762.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_067e657b09ec039f3c8ce22c7899e762.jpg not downloaded yet
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_d2d92af5e7f32134d55c8cb067c0a9ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_068ba9473ef2e30516ed99c987f30b71.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_6ad04e25608e5812780e41eed4dc5ebb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_6ad04e25608e5812780e41eed4dc5ebb.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fda%252F58daa5aacce573094aea0d2245da36e8%252Fpa%252FZH45027_a37d3faf2cda5c11d65384adf6ad7d3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_a37d3faf2cda5c11d65384adf6ad7d3d.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_080411e73ca6f872c89cd7c91adb1b6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_080411e73ca6f872c89cd7c91adb1b6a.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_e8d7f93f93ebc595280c94f03fad7894.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_e8d7f93f93ebc595280c94f03fad7894.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fda%252F58daa5aacce573094aea0d2245da36e8%252Fpa%252FZH45027_d896fd8016c2c702668248c879e3323b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_d896fd8016c2c702668248c879e3323b.jpg not downloaded yet
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_0b631fc53ad763220bdeafe3d5ab4468.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_c89a02b2d2440703a563020dfbc060f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_c89a02b2d2440703a563020dfbc060f2.jpg not downloaded yet
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_29903c980c6caf5b341067f3db3f3268.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_8f8b8707e8a38fe3c2132b06dddbdde3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_8f8b8707e8a38fe3c2132b06dddbdde3.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fda%252F58daa5aacce573094aea0d2245da36e8%252Fpa%252FZH45027_fbd5392281b6b3f5db5ba5177060f8eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_fbd5392281b6b3f5db5ba5177060f8eb.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_599e49295f9ca41323fea58954110ac2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_599e49295f9ca41323fea58954110ac2.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fda%252F58daa5aacce573094aea0d2245da36e8%252Fpa%252FZH45027_e741ece6368873a88418bf2f6fc4c553.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_e741ece6368873a88418bf2f6fc4c553.jpg not downloaded yet
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_044541a1676e92bf0731e37a62e38256.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6b27d0>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_d2d92af5e7f32134d55c8cb067c0a9ee.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_d2d92af5e7f32134d55c8cb067c0a9ee.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7aab9ee-b288-5fb5-b653-3902730a1f77
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4de510>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_068ba9473ef2e30516ed99c987f30b71.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_068ba9473ef2e30516ed99c987f30b71.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7aab9ee-b288-5fb5-b653-3902730a1f77
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_52a2901219fb849b28bb8a6759cb840b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_52a2901219fb849b28bb8a6759cb840b.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_6db2b09a2958a4e7becee4e488d81812.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_6db2b09a2958a4e7becee4e488d81812.jpg not downloaded yet
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cabc310>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d83c700-59c6-525f-93a6-99dedd768a75/0d83c700-59c6-525f-93a6-99dedd768a75_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc5%252Fc7c5b789228c0ef379226d359a7fe3dc%252Fpa%252FSX60727_0b631fc53ad763220bdeafe3d5ab4468.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_0b631fc53ad763220bdeafe3d5ab4468.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d83c700-59c6-525f-93a6-99dedd768a75
2026-03-28 12:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d68de10>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_29903c980c6caf5b341067f3db3f3268.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_29903c980c6caf5b341067f3db3f3268.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0b2331b2-bba6-56f9-b66a-9e6924ff7f48
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_d896fd8016c2c702668248c879e3323b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_fbd5392281b6b3f5db5ba5177060f8eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_067e657b09ec039f3c8ce22c7899e762.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ00600/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZF56836/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC77212/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC52671/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3e46aa50>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8/26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fda%252F58daa5aacce573094aea0d2245da36e8%252Fpa%252FZH45027_044541a1676e92bf0731e37a62e38256.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_044541a1676e92bf0731e37a62e38256.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8
2026-03-28 12:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_dc2c65c2e9e0cc3f0655012a8c07cf92.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_afa96310fe9edc81a76902d567640ce7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_fb60efb49e5a2deb257ecf5b12888b6d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX14349/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d627850>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8/26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fda%252F58daa5aacce573094aea0d2245da36e8%252Fpa%252FZH45027_d896fd8016c2c702668248c879e3323b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_d896fd8016c2c702668248c879e3323b.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_e741ece6368873a88418bf2f6fc4c553.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_c89a02b2d2440703a563020dfbc060f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_8f8b8707e8a38fe3c2132b06dddbdde3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_080411e73ca6f872c89cd7c91adb1b6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4e9350>
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8/26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fda%252F58daa5aacce573094aea0d2245da36e8%252Fpa%252FZH45027_fbd5392281b6b3f5db5ba5177060f8eb.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_fbd5392281b6b3f5db5ba5177060f8eb.jpg saved to cache
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cac3ad0>
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_067e657b09ec039f3c8ce22c7899e762.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_067e657b09ec039f3c8ce22c7899e762.jpg saved to cache
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7aab9ee-b288-5fb5-b653-3902730a1f77
2026-03-28 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV97003/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_6ad04e25608e5812780e41eed4dc5ebb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_a37d3faf2cda5c11d65384adf6ad7d3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb73a50>
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_dc2c65c2e9e0cc3f0655012a8c07cf92.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_dc2c65c2e9e0cc3f0655012a8c07cf92.jpg saved to cache
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0b2331b2-bba6-56f9-b66a-9e6924ff7f48
2026-03-28 12:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6aa410>
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_afa96310fe9edc81a76902d567640ce7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_afa96310fe9edc81a76902d567640ce7.jpg saved to cache
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b2331b2-bba6-56f9-b66a-9e6924ff7f48
2026-03-28 12:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d450050>
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbb%252Fe5bbbafcb3f56022e520f4a2c6f17f30%252Fpa%252FJC58161_fb60efb49e5a2deb257ecf5b12888b6d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_fb60efb49e5a2deb257ecf5b12888b6d.jpg saved to cache
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b2331b2-bba6-56f9-b66a-9e6924ff7f48
2026-03-28 12:01:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b2331b2-bba6-56f9-b66a-9e6924ff7f48, skipping ID generation
2026-03-28 12:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b2331b2-bba6-56f9-b66a-9e6924ff7f48 with scrape type 1
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b2331b2-bba6-56f9-b66a-9e6924ff7f48 sending to next pipeline
2026-03-28 12:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0b2331b2-bba6-56f9-b66a-9e6924ff7f48, identifier: JC58161
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d54ebd0>
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8/26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fda%252F58daa5aacce573094aea0d2245da36e8%252Fpa%252FZH45027_e741ece6368873a88418bf2f6fc4c553.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_e741ece6368873a88418bf2f6fc4c553.jpg saved to cache
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb6f850>
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_c89a02b2d2440703a563020dfbc060f2.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_c89a02b2d2440703a563020dfbc060f2.jpg saved to cache
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7aab9ee-b288-5fb5-b653-3902730a1f77
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d558710>
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_8f8b8707e8a38fe3c2132b06dddbdde3.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_8f8b8707e8a38fe3c2132b06dddbdde3.jpg saved to cache
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb73990>
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_080411e73ca6f872c89cd7c91adb1b6a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_080411e73ca6f872c89cd7c91adb1b6a.jpg saved to cache
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7aab9ee-b288-5fb5-b653-3902730a1f77
2026-03-28 12:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0b2331b2-bba6-56f9-b66a-9e6924ff7f48 with identifier: JC58161
2026-03-28 12:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0b2331b2-bba6-56f9-b66a-9e6924ff7f48 with identifier: JC58161
2026-03-28 12:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0b2331b2-bba6-56f9-b66a-9e6924ff7f48 with identifier: JC58161 to the API
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_fb60efb49e5a2deb257ecf5b12888b6d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:38:38Z',
'fuel_type': 'petrol',
'id': '0b2331b2-bba6-56f9-b66a-9e6924ff7f48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC58161',
'listing': 'auction',
'location': 'IT, Modena',
'make': 'Opel',
'model': 'Mokka',
'odometer': 153770,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72988,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_778e72ca04e4cfe9baa5fcb91dde2085.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2527947,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_64fe4b75aef3259df00d31b90f313be9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2343617,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_fb60efb49e5a2deb257ecf5b12888b6d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53799,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_c9b3864c1e3c61fb3b5f9085fb95d63f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2297310,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_afa96310fe9edc81a76902d567640ce7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2318299,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_dc2c65c2e9e0cc3f0655012a8c07cf92.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2227131,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_29903c980c6caf5b341067f3db3f3268.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72823,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_42ead4553d68c94a5bb37f7a48c576ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_ba6b33877cd9b2708d4e8ffd3d9b8a16.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2331b2-bba6-56f9-b66a-9e6924ff7f48/0b2331b2-bba6-56f9-b66a-9e6924ff7f48_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bb/e5bbbafcb3f56022e520f4a2c6f17f30/pa/JC58161_feefb250c658a093814f401d96a3ab3b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-05-10',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Mokka 1.6 Cosmo ecoFlex',
'transmission': 'manual',
'trim': 'Cosmo ecoFlex',
'year': 2016}
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC58161%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.it] INFO: Saving data for JC58161: {'created_time': 1774699303.28499, 'last_price_update_time': 1774699303.284999, 'auction_closing_time': 1774885118.0}
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JC58161') HTTP/1.1" 204 0
2026-03-28 12:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD89174> (referer: https://www.auto1.com/v1/car-details-view/HD89174/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d66a650>
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_6ad04e25608e5812780e41eed4dc5ebb.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_6ad04e25608e5812780e41eed4dc5ebb.jpg saved to cache
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f86c2d0>
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8/26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fda%252F58daa5aacce573094aea0d2245da36e8%252Fpa%252FZH45027_a37d3faf2cda5c11d65384adf6ad7d3d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_a37d3faf2cda5c11d65384adf6ad7d3d.jpg saved to cache
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8
2026-03-28 12:01:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8, skipping ID generation
2026-03-28 12:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8 with scrape type 1
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8 sending to next pipeline
2026-03-28 12:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8, identifier: ZH45027
2026-03-28 12:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8 with identifier: ZH45027
2026-03-28 12:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8 with identifier: ZH45027
2026-03-28 12:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8 with identifier: ZH45027 to the API
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_a37d3faf2cda5c11d65384adf6ad7d3d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:56:08Z',
'fuel_type': 'petrol',
'id': '26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH45027',
'listing': 'auction',
'location': 'IT, Roma RM',
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 109919,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8/26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64834,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_044541a1676e92bf0731e37a62e38256.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8/26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_a37d3faf2cda5c11d65384adf6ad7d3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8/26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_d896fd8016c2c702668248c879e3323b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8/26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51176,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_fbd5392281b6b3f5db5ba5177060f8eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8/26b65bb7-a8a7-57dc-a9f1-38d71e7b37a8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/da/58daa5aacce573094aea0d2245da36e8/pa/ZH45027_e741ece6368873a88418bf2f6fc4c553.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-10-30',
'seats_number': 4,
'seller_name': None,
'title': 'Lancia Ypsilon 1.2 Diva',
'transmission': 'manual',
'trim': 'Diva',
'year': 2011}
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH45027%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.it] INFO: Saving data for ZH45027: {'created_time': 1774699303.846408, 'last_price_update_time': 1774699303.846417, 'auction_closing_time': 1774886168.0}
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZH45027') HTTP/1.1" 204 0
2026-03-28 12:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a883f9ae-a827-5657-937f-6a2db429e2fb with identifier: HD89174
2026-03-28 12:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a883f9ae-a827-5657-937f-6a2db429e2fb with scrape type 1
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a883f9ae-a827-5657-937f-6a2db429e2fb
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb7%252F91b7b277a436c5aa5c5bdce568ade16f%252Fpa%252FHD89174_d7e1634fc25e7ce9ac8dfbfba63eae4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_d7e1634fc25e7ce9ac8dfbfba63eae4b.jpg not downloaded yet
2026-03-28 12:01:43 [auto1.it] INFO: Channel: 24h | Page: 7 | totalHits: 3672 | hits on page: 40
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb7%252F91b7b277a436c5aa5c5bdce568ade16f%252Fpa%252FHD89174_5a356d30c7e2140325569b466728d3a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_5a356d30c7e2140325569b466728d3a1.jpg not downloaded yet
2026-03-28 12:01:43 [auto1.it] INFO: Found listing with ID: GX37056
2026-03-28 12:01:43 [auto1.it] INFO: Found listing with ID: RU00933
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU00933%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.it] INFO: Scrape type for RU00933: 1
2026-03-28 12:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_5e7430417c61cfc6d7d11b052c7df979.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_07495f91f1bff6267171c45ecdd1481a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_3b1d7088504743721864982bf313d215.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb7%252F91b7b277a436c5aa5c5bdce568ade16f%252Fpa%252FHD89174_a456ce78a31a112e3ca0d499bb0ddc0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_a456ce78a31a112e3ca0d499bb0ddc0d.jpg not downloaded yet
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: SP24974
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: WU48756
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: PR17884
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR17884%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [auto1.it] INFO: Scrape type for PR17884: 1
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_e8d7f93f93ebc595280c94f03fad7894.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_0b283526c1de44b3cb8b411e80e80b58.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb7%252F91b7b277a436c5aa5c5bdce568ade16f%252Fpa%252FHD89174_0655e71e24e8e42f6f991ac8a87662c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_0655e71e24e8e42f6f991ac8a87662c8.jpg not downloaded yet
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: XP65023
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP65023%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [auto1.it] INFO: Scrape type for XP65023: 1
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_ea82d7908cb3b780464e2bb7ff8acd09.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb7%252F91b7b277a436c5aa5c5bdce568ade16f%252Fpa%252FHD89174_760ea2e72a5f491bc70fa21429662e04.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_760ea2e72a5f491bc70fa21429662e04.jpg not downloaded yet
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: FV28373
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: WM91137
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: BU89130
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: MR74044
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: JB83443
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: PB47164
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB47164%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [auto1.it] INFO: Scrape type for PB47164: 0
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: RU74019
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: GT62268
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT62268%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [auto1.it] INFO: Scrape type for GT62268: 0
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: NY06096
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: DD11193
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: TU55073
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: JC52693
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: BA37529
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: PR63683
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: KC74563
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: JD73354
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD73354%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [auto1.it] INFO: Scrape type for JD73354: 0
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: MB22824
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: NW35507
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: AG64342
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: RC92896
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: WK68121
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: MM70792
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: RF74009
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF74009%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [auto1.it] INFO: Scrape type for RF74009: 0
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: FD11952
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD11952%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [auto1.it] INFO: Scrape type for FD11952: 0
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: VP67579
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: VM60926
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: RY72509
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: UE94474
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: LG11591
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG11591%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [auto1.it] INFO: Scrape type for LG11591: 0
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: UD99211
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD99211%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [auto1.it] INFO: Scrape type for UD99211: 0
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: SX47374
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX47374%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [auto1.it] INFO: Scrape type for SX47374: 0
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: AP90035
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: NS10029
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS10029%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [auto1.it] INFO: Scrape type for NS10029: 0
2026-03-28 12:01:44 [auto1.it] INFO: Found listing with ID: BY89134
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_fa4c4624b00633598e7b0792c81ba954.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_5a356d30c7e2140325569b466728d3a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7a5350>
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_5e7430417c61cfc6d7d11b052c7df979.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_5e7430417c61cfc6d7d11b052c7df979.jpg saved to cache
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7dc290>
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_07495f91f1bff6267171c45ecdd1481a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_07495f91f1bff6267171c45ecdd1481a.jpg saved to cache
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca25e10>
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_3b1d7088504743721864982bf313d215.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_3b1d7088504743721864982bf313d215.jpg saved to cache
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7aab9ee-b288-5fb5-b653-3902730a1f77
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_d7e1634fc25e7ce9ac8dfbfba63eae4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL74097> (referer: https://www.auto1.com/v1/car-details-view/NL74097/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb5b890>
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_e8d7f93f93ebc595280c94f03fad7894.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_e8d7f93f93ebc595280c94f03fad7894.jpg saved to cache
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4f7550>
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_0b283526c1de44b3cb8b411e80e80b58.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_0b283526c1de44b3cb8b411e80e80b58.jpg saved to cache
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7aab9ee-b288-5fb5-b653-3902730a1f77
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f970cd0>
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_ea82d7908cb3b780464e2bb7ff8acd09.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_ea82d7908cb3b780464e2bb7ff8acd09.jpg saved to cache
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca3c550>
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_fa4c4624b00633598e7b0792c81ba954.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_fa4c4624b00633598e7b0792c81ba954.jpg saved to cache
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7aab9ee-b288-5fb5-b653-3902730a1f77
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca3d390>
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a883f9ae-a827-5657-937f-6a2db429e2fb/a883f9ae-a827-5657-937f-6a2db429e2fb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb7%252F91b7b277a436c5aa5c5bdce568ade16f%252Fpa%252FHD89174_5a356d30c7e2140325569b466728d3a1.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_5a356d30c7e2140325569b466728d3a1.jpg saved to cache
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a883f9ae-a827-5657-937f-6a2db429e2fb
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_0655e71e24e8e42f6f991ac8a87662c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_760ea2e72a5f491bc70fa21429662e04.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6f4ad0>
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a883f9ae-a827-5657-937f-6a2db429e2fb/a883f9ae-a827-5657-937f-6a2db429e2fb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb7%252F91b7b277a436c5aa5c5bdce568ade16f%252Fpa%252FHD89174_d7e1634fc25e7ce9ac8dfbfba63eae4b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_d7e1634fc25e7ce9ac8dfbfba63eae4b.jpg saved to cache
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a883f9ae-a827-5657-937f-6a2db429e2fb
2026-03-28 12:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3125444b-ce32-5f23-a0cd-ca40b478b4d4 with identifier: NL74097
2026-03-28 12:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3125444b-ce32-5f23-a0cd-ca40b478b4d4 with scrape type 1
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3125444b-ce32-5f23-a0cd-ca40b478b4d4
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_e68334a72bdf2da5b976ee19e61636ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_e68334a72bdf2da5b976ee19e61636ce.jpg not downloaded yet
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_a456ce78a31a112e3ca0d499bb0ddc0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_9446252852e8990f23ab169eb34f28eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_9446252852e8990f23ab169eb34f28eb.jpg not downloaded yet
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_599e49295f9ca41323fea58954110ac2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_52a2901219fb849b28bb8a6759cb840b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_b4eaf102bc4bb158efb5e1bb030ec729.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_b4eaf102bc4bb158efb5e1bb030ec729.jpg not downloaded yet
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_83843ca7cef590fca7fcc79443d22a3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_83843ca7cef590fca7fcc79443d22a3d.jpg not downloaded yet
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f5723d0>
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a883f9ae-a827-5657-937f-6a2db429e2fb/a883f9ae-a827-5657-937f-6a2db429e2fb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb7%252F91b7b277a436c5aa5c5bdce568ade16f%252Fpa%252FHD89174_0655e71e24e8e42f6f991ac8a87662c8.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_0655e71e24e8e42f6f991ac8a87662c8.jpg saved to cache
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a883f9ae-a827-5657-937f-6a2db429e2fb
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f5e29d0>
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a883f9ae-a827-5657-937f-6a2db429e2fb/a883f9ae-a827-5657-937f-6a2db429e2fb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb7%252F91b7b277a436c5aa5c5bdce568ade16f%252Fpa%252FHD89174_760ea2e72a5f491bc70fa21429662e04.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_760ea2e72a5f491bc70fa21429662e04.jpg saved to cache
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a883f9ae-a827-5657-937f-6a2db429e2fb
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_d6cdfb90d7ddbb0417aff8489cca3ada.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_2536c43093c27e8aa72504eda0b7b4c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_2536c43093c27e8aa72504eda0b7b4c3.jpg not downloaded yet
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_2115c708bd73d2cc528ffdb06e0c02be.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_2c299092bab7f3681771e1ac4bb07975.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_2c299092bab7f3681771e1ac4bb07975.jpg not downloaded yet
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX14349> (referer: https://www.auto1.com/v1/car-details-view/LX14349/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_6db2b09a2958a4e7becee4e488d81812.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC52671> (referer: https://www.auto1.com/v1/car-details-view/SC52671/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_7f644d0fe4ffee4fd9619bfd1e5871df.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_7f644d0fe4ffee4fd9619bfd1e5871df.jpg not downloaded yet
2026-03-28 12:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d65c490>
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a883f9ae-a827-5657-937f-6a2db429e2fb/a883f9ae-a827-5657-937f-6a2db429e2fb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb7%252F91b7b277a436c5aa5c5bdce568ade16f%252Fpa%252FHD89174_a456ce78a31a112e3ca0d499bb0ddc0d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_a456ce78a31a112e3ca0d499bb0ddc0d.jpg saved to cache
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a883f9ae-a827-5657-937f-6a2db429e2fb
2026-03-28 12:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a883f9ae-a827-5657-937f-6a2db429e2fb, skipping ID generation
2026-03-28 12:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a883f9ae-a827-5657-937f-6a2db429e2fb with scrape type 1
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a883f9ae-a827-5657-937f-6a2db429e2fb sending to next pipeline
2026-03-28 12:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a883f9ae-a827-5657-937f-6a2db429e2fb, identifier: HD89174
2026-03-28 12:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f570350>
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_599e49295f9ca41323fea58954110ac2.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_599e49295f9ca41323fea58954110ac2.jpg saved to cache
2026-03-28 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-03-28 12:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d438550>
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_52a2901219fb849b28bb8a6759cb840b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_52a2901219fb849b28bb8a6759cb840b.jpg saved to cache
2026-03-28 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-03-28 12:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ00600> (referer: https://www.auto1.com/v1/car-details-view/FJ00600/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC77212> (referer: https://www.auto1.com/v1/car-details-view/HC77212/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a883f9ae-a827-5657-937f-6a2db429e2fb with identifier: HD89174
2026-03-28 12:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a883f9ae-a827-5657-937f-6a2db429e2fb with identifier: HD89174
2026-03-28 12:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a883f9ae-a827-5657-937f-6a2db429e2fb with identifier: HD89174 to the API
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_a456ce78a31a112e3ca0d499bb0ddc0d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 145,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:46:39Z',
'fuel_type': 'diesel',
'id': 'a883f9ae-a827-5657-937f-6a2db429e2fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD89174',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 344809,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a883f9ae-a827-5657-937f-6a2db429e2fb/a883f9ae-a827-5657-937f-6a2db429e2fb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74937,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_d7e1634fc25e7ce9ac8dfbfba63eae4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a883f9ae-a827-5657-937f-6a2db429e2fb/a883f9ae-a827-5657-937f-6a2db429e2fb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63408,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_5a356d30c7e2140325569b466728d3a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a883f9ae-a827-5657-937f-6a2db429e2fb/a883f9ae-a827-5657-937f-6a2db429e2fb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57951,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_a456ce78a31a112e3ca0d499bb0ddc0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a883f9ae-a827-5657-937f-6a2db429e2fb/a883f9ae-a827-5657-937f-6a2db429e2fb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_0655e71e24e8e42f6f991ac8a87662c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a883f9ae-a827-5657-937f-6a2db429e2fb/a883f9ae-a827-5657-937f-6a2db429e2fb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/b7/91b7b277a436c5aa5c5bdce568ade16f/pa/HD89174_760ea2e72a5f491bc70fa21429662e04.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-01-28',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 HDi Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2009}
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD89174%27 HTTP/1.1" 200 None
2026-03-28 12:01:45 [auto1.it] INFO: Saving data for HD89174: {'created_time': 1774699305.758368, 'last_price_update_time': 1774699305.758378, 'auction_closing_time': 1774885599.0}
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HD89174') HTTP/1.1" 204 0
2026-03-28 12:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_83843ca7cef590fca7fcc79443d22a3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_bb9ada8073f95c814c843c38a5d749c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_bb9ada8073f95c814c843c38a5d749c5.jpg not downloaded yet
2026-03-28 12:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_42e882aaebe0801095bd4f29e09cee9b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_b4eaf102bc4bb158efb5e1bb030ec729.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZF56836> (referer: https://www.auto1.com/v1/car-details-view/ZF56836/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV97003> (referer: https://www.auto1.com/v1/car-details-view/BV97003/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_48621d42b9312968088fb85597e81e2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_48621d42b9312968088fb85597e81e2d.jpg not downloaded yet
2026-03-28 12:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU00933/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cc07790>
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d83c700-59c6-525f-93a6-99dedd768a75/0d83c700-59c6-525f-93a6-99dedd768a75_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc5%252Fc7c5b789228c0ef379226d359a7fe3dc%252Fpa%252FSX60727_d6cdfb90d7ddbb0417aff8489cca3ada.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_d6cdfb90d7ddbb0417aff8489cca3ada.jpg saved to cache
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d83c700-59c6-525f-93a6-99dedd768a75
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d441190>
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_2115c708bd73d2cc528ffdb06e0c02be.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_2115c708bd73d2cc528ffdb06e0c02be.jpg saved to cache
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-03-28 12:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f8e7b06-aced-5960-83ac-a7e449c0d435 with identifier: LX14349
2026-03-28 12:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f8e7b06-aced-5960-83ac-a7e449c0d435 with scrape type 1
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_eac74d6b9dcd2ddcc62831631ffb82b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_eac74d6b9dcd2ddcc62831631ffb82b7.jpg not downloaded yet
2026-03-28 12:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7eaf50>
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F9f%252Fab9ff8d93f1498f2dbe462335bf121e5%252Fpa%252FME27860_6db2b09a2958a4e7becee4e488d81812.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_6db2b09a2958a4e7becee4e488d81812.jpg saved to cache
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-03-28 12:01:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a11116e8-744f-56f3-a329-6a95fc21f4fe, skipping ID generation
2026-03-28 12:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a11116e8-744f-56f3-a329-6a95fc21f4fe with scrape type 1
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a11116e8-744f-56f3-a329-6a95fc21f4fe sending to next pipeline
2026-03-28 12:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a11116e8-744f-56f3-a329-6a95fc21f4fe, identifier: ME27860
2026-03-28 12:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b6f0271-03d1-55e7-ad95-d6d36d996802 with identifier: SC52671
2026-03-28 12:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b6f0271-03d1-55e7-ad95-d6d36d996802 with scrape type 1
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b6f0271-03d1-55e7-ad95-d6d36d996802
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_b1c88a3db748350e10805a0566b8a1b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_b1c88a3db748350e10805a0566b8a1b1.jpg not downloaded yet
2026-03-28 12:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2743f585-7051-5b70-af74-c89fd1e915e4 with identifier: FJ00600
2026-03-28 12:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2743f585-7051-5b70-af74-c89fd1e915e4 with scrape type 1
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2743f585-7051-5b70-af74-c89fd1e915e4
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_3053eca6929ea710584b2414b1e70c9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_3053eca6929ea710584b2414b1e70c9a.jpg not downloaded yet
2026-03-28 12:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60cab577-266b-522b-8554-2169dae86b8b with identifier: HC77212
2026-03-28 12:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60cab577-266b-522b-8554-2169dae86b8b with scrape type 1
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60cab577-266b-522b-8554-2169dae86b8b
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_f22f84626e6f2feaa9df0252898e6b36.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_f22f84626e6f2feaa9df0252898e6b36.jpg not downloaded yet
2026-03-28 12:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a11116e8-744f-56f3-a329-6a95fc21f4fe with identifier: ME27860
2026-03-28 12:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a11116e8-744f-56f3-a329-6a95fc21f4fe with identifier: ME27860
2026-03-28 12:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a11116e8-744f-56f3-a329-6a95fc21f4fe with identifier: ME27860 to the API
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_6db2b09a2958a4e7becee4e488d81812.jpg>
{'auction_title': '',
'c_o_2_emission_value': 200,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '4.0L',
'engine_horse_power': 470,
'expiration_date': '2026-03-30T15:01:18Z',
'fuel_type': 'petrol',
'id': 'a11116e8-744f-56f3-a329-6a95fc21f4fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME27860',
'listing': 'auction',
'location': 'IT, Pavia',
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 119390,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_2115c708bd73d2cc528ffdb06e0c02be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_ea82d7908cb3b780464e2bb7ff8acd09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_07495f91f1bff6267171c45ecdd1481a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_5e7430417c61cfc6d7d11b052c7df979.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47162,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_6ad04e25608e5812780e41eed4dc5ebb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2153692,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_e8d7f93f93ebc595280c94f03fad7894.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_8f8b8707e8a38fe3c2132b06dddbdde3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2224397,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_599e49295f9ca41323fea58954110ac2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2332268,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_52a2901219fb849b28bb8a6759cb840b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2702475,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_6db2b09a2958a4e7becee4e488d81812.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-26',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 560 4Matic Premium Plus',
'transmission': 'automatic',
'trim': '4Matic Premium Plus',
'year': 2018}
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME27860%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.it] INFO: Saving data for ME27860: {'created_time': 1774699306.805731, 'last_price_update_time': 1774699306.805744, 'auction_closing_time': 1774882878.0}
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ME27860') HTTP/1.1" 204 0
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_383bf4c91d9f57d8574a8fdaf6d9fd76.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_383bf4c91d9f57d8574a8fdaf6d9fd76.jpg not downloaded yet
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_41ea504a6ff6cf53a8b637c43eda368f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_41ea504a6ff6cf53a8b637c43eda368f.jpg not downloaded yet
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_c81e18f9dba1f3d95fc03e66dcc5699a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_c81e18f9dba1f3d95fc03e66dcc5699a.jpg not downloaded yet
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_d9a108d17a61343fdc1a352a4a2f0739.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_d9a108d17a61343fdc1a352a4a2f0739.jpg not downloaded yet
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_90b281bb2ecd2760eff89b9de4d15cd2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_90b281bb2ecd2760eff89b9de4d15cd2.jpg not downloaded yet
2026-03-28 12:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_4618a29776fb3672b83dcba4da62dd32.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4abb90>
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_83843ca7cef590fca7fcc79443d22a3d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_83843ca7cef590fca7fcc79443d22a3d.jpg saved to cache
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3125444b-ce32-5f23-a0cd-ca40b478b4d4
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca30650>
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b/842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fe9%252F8ce916e78c117337bfceb4e66712a5ed%252Fpa%252FTV81460_42e882aaebe0801095bd4f29e09cee9b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_42e882aaebe0801095bd4f29e09cee9b.jpg saved to cache
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6f6390>
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_b4eaf102bc4bb158efb5e1bb030ec729.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_b4eaf102bc4bb158efb5e1bb030ec729.jpg saved to cache
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3125444b-ce32-5f23-a0cd-ca40b478b4d4
2026-03-28 12:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 939d870a-2472-5d56-875a-9ded5ded9aac with identifier: ZF56836
2026-03-28 12:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 939d870a-2472-5d56-875a-9ded5ded9aac with scrape type 1
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 939d870a-2472-5d56-875a-9ded5ded9aac
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_531a508c321c3103f6913724165e7c2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_531a508c321c3103f6913724165e7c2f.jpg not downloaded yet
2026-03-28 12:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 598f1509-b6c4-51f8-8911-bdcdd670920f with identifier: BV97003
2026-03-28 12:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 598f1509-b6c4-51f8-8911-bdcdd670920f with scrape type 1
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 598f1509-b6c4-51f8-8911-bdcdd670920f
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F24%252Fb724d8534f80d7726fa981df08c1178f%252Fpa%252FBV97003_ce2170c8411739fbea359e9446e453da.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_ce2170c8411739fbea359e9446e453da.jpg not downloaded yet
2026-03-28 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_2536c43093c27e8aa72504eda0b7b4c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_4e1439fe30197c46dc2e3a8f402c9314.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_8a73b85331fb513db7bc56da12e2fbdb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_1e5f2985773c222e4d08368fcd11ab38.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_1e5f2985773c222e4d08368fcd11ab38.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_c8e9ae90861f51a1e8717de749b0faf8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_c8e9ae90861f51a1e8717de749b0faf8.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_a55570bbff05c30dd7f9e1dc7d4935dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_a55570bbff05c30dd7f9e1dc7d4935dc.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_f02fc68701a7d28b206b5560801d211b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_f02fc68701a7d28b206b5560801d211b.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_d7c8351d053c27eda2b220c585429fc2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_d7c8351d053c27eda2b220c585429fc2.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F24%252Fb724d8534f80d7726fa981df08c1178f%252Fpa%252FBV97003_03d028e4cac85844d1a64293855251bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_03d028e4cac85844d1a64293855251bf.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_88f517a5c812e972565011330860c366.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_88f517a5c812e972565011330860c366.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_33ea20c7fcc8f44e8369111bb77af0ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_33ea20c7fcc8f44e8369111bb77af0ec.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_635690328de0f9ef54811f3f1a11d3d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_635690328de0f9ef54811f3f1a11d3d6.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_343e72f394b097f120047673988b7474.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_343e72f394b097f120047673988b7474.jpg not downloaded yet
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbab810>
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b/842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fe9%252F8ce916e78c117337bfceb4e66712a5ed%252Fpa%252FTV81460_4618a29776fb3672b83dcba4da62dd32.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_4618a29776fb3672b83dcba4da62dd32.jpg saved to cache
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_6d551cb210a34d26d1e79737daf43ac2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_6d551cb210a34d26d1e79737daf43ac2.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F24%252Fb724d8534f80d7726fa981df08c1178f%252Fpa%252FBV97003_17c6ba363f38cee1c7879e5d0f7c62c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_17c6ba363f38cee1c7879e5d0f7c62c7.jpg not downloaded yet
2026-03-28 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_bb9ada8073f95c814c843c38a5d749c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_3c187713e6728e616791e3b6dfc2fdb2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_3c187713e6728e616791e3b6dfc2fdb2.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_8747c88df6412906976f841c4884c6e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_8747c88df6412906976f841c4884c6e8.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_5b73730f8520bd67c67507dc804f75b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_5b73730f8520bd67c67507dc804f75b1.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_96c2149c57934fdf6ae18d338a43b8ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_96c2149c57934fdf6ae18d338a43b8ea.jpg not downloaded yet
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cba9f90>
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_2536c43093c27e8aa72504eda0b7b4c3.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_2536c43093c27e8aa72504eda0b7b4c3.jpg saved to cache
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3125444b-ce32-5f23-a0cd-ca40b478b4d4
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3e4683d0>
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d83c700-59c6-525f-93a6-99dedd768a75/0d83c700-59c6-525f-93a6-99dedd768a75_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc5%252Fc7c5b789228c0ef379226d359a7fe3dc%252Fpa%252FSX60727_4e1439fe30197c46dc2e3a8f402c9314.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_4e1439fe30197c46dc2e3a8f402c9314.jpg saved to cache
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d83c700-59c6-525f-93a6-99dedd768a75
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6b2f50>
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b/842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fe9%252F8ce916e78c117337bfceb4e66712a5ed%252Fpa%252FTV81460_8a73b85331fb513db7bc56da12e2fbdb.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_8a73b85331fb513db7bc56da12e2fbdb.jpg saved to cache
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b
2026-03-28 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_5f4e67d8e9fac1b0683f01fcd273e79c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_de3ec38aea4a0d853bb539acc9d310de.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_4a3beb45bc06914af87e96614321118b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_4a3beb45bc06914af87e96614321118b.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F24%252Fb724d8534f80d7726fa981df08c1178f%252Fpa%252FBV97003_0284b5514ecdca08f7a07d367a32e2b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_0284b5514ecdca08f7a07d367a32e2b7.jpg not downloaded yet
2026-03-28 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_48abd65853100ec1d00c7503630ea215.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_c7446054954f668bb012648d681917fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_c7446054954f668bb012648d681917fa.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_0485c9184dd199257df421db14c947f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_0485c9184dd199257df421db14c947f1.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_e2474454c1b57074f31775a8f79721c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_e2474454c1b57074f31775a8f79721c3.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_9c7fd73106b7eee73f982378fd774c80.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_9c7fd73106b7eee73f982378fd774c80.jpg not downloaded yet
2026-03-28 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_8cf35bfb75e4200640b90a0642f72ef3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_58f732aae10b7ad2a54d3d32b7662cea.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_58f732aae10b7ad2a54d3d32b7662cea.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F24%252Fb724d8534f80d7726fa981df08c1178f%252Fpa%252FBV97003_e5a1899f1df72bd10dc41548b5c51dec.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_e5a1899f1df72bd10dc41548b5c51dec.jpg not downloaded yet
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca21990>
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_bb9ada8073f95c814c843c38a5d749c5.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_bb9ada8073f95c814c843c38a5d749c5.jpg saved to cache
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3125444b-ce32-5f23-a0cd-ca40b478b4d4
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_edb08aee4935e7ba2ad3c5a00be9b175.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_edb08aee4935e7ba2ad3c5a00be9b175.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_e87b59bf6481a457782dae4b8d190adf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_e87b59bf6481a457782dae4b8d190adf.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_160397f8f815733c082095f7df0ead29.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_160397f8f815733c082095f7df0ead29.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_5d1931040918d3e7a9e1ed3687b8a7d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_5d1931040918d3e7a9e1ed3687b8a7d3.jpg not downloaded yet
2026-03-28 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_f22f84626e6f2feaa9df0252898e6b36.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_04172265b8498e99c2e4145dce7eaa8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_04172265b8498e99c2e4145dce7eaa8d.jpg not downloaded yet
2026-03-28 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP65023/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_37855beeea9a67381281cd7fd7c1af1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_37855beeea9a67381281cd7fd7c1af1b.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_c3b36ca719edb9488c99f4c25d96f54e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_c3b36ca719edb9488c99f4c25d96f54e.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_df94767585ae8e949f1d77ce6b87281a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_df94767585ae8e949f1d77ce6b87281a.jpg not downloaded yet
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_8365e6147718afad652389e716cc9773.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_8365e6147718afad652389e716cc9773.jpg not downloaded yet
2026-03-28 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR17884/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5d6a90>
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_5f4e67d8e9fac1b0683f01fcd273e79c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_5f4e67d8e9fac1b0683f01fcd273e79c.jpg saved to cache
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7aab9ee-b288-5fb5-b653-3902730a1f77
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4653d0>
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b/842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fe9%252F8ce916e78c117337bfceb4e66712a5ed%252Fpa%252FTV81460_de3ec38aea4a0d853bb539acc9d310de.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_de3ec38aea4a0d853bb539acc9d310de.jpg saved to cache
2026-03-28 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c961490>
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d83c700-59c6-525f-93a6-99dedd768a75/0d83c700-59c6-525f-93a6-99dedd768a75_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc5%252Fc7c5b789228c0ef379226d359a7fe3dc%252Fpa%252FSX60727_48abd65853100ec1d00c7503630ea215.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_48abd65853100ec1d00c7503630ea215.jpg saved to cache
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d83c700-59c6-525f-93a6-99dedd768a75
2026-03-28 12:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_90b281bb2ecd2760eff89b9de4d15cd2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_c81e18f9dba1f3d95fc03e66dcc5699a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_b9f7c8f855234d4d942bbdb701f5553c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_b9f7c8f855234d4d942bbdb701f5553c.jpg not downloaded yet
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_6dfb5d184d909cebda9d2913ac0dac78.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_6dfb5d184d909cebda9d2913ac0dac78.jpg not downloaded yet
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_904a1448d11fe41ade31d88388b4b912.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_904a1448d11fe41ade31d88388b4b912.jpg not downloaded yet
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_96f69fb0b7eacfde644cf14f822f75fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_96f69fb0b7eacfde644cf14f822f75fa.jpg not downloaded yet
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_f8439fb9c66fec878540e5e94649caee.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_f8439fb9c66fec878540e5e94649caee.jpg not downloaded yet
2026-03-28 12:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7adbd0>
2026-03-28 12:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F78%252Fc378a840f40aaf9c78118fda8145a2fa%252Fpa%252FPB64949_8cf35bfb75e4200640b90a0642f72ef3.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_8cf35bfb75e4200640b90a0642f72ef3.jpg saved to cache
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7aab9ee-b288-5fb5-b653-3902730a1f77
2026-03-28 12:01:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7aab9ee-b288-5fb5-b653-3902730a1f77, skipping ID generation
2026-03-28 12:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7aab9ee-b288-5fb5-b653-3902730a1f77 with scrape type 1
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7aab9ee-b288-5fb5-b653-3902730a1f77 sending to next pipeline
2026-03-28 12:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d7aab9ee-b288-5fb5-b653-3902730a1f77, identifier: PB64949
2026-03-28 12:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_d9a108d17a61343fdc1a352a4a2f0739.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_0f0936b228b4e140829a5712ffb78f3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_0f0936b228b4e140829a5712ffb78f3e.jpg not downloaded yet
2026-03-28 12:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d7aab9ee-b288-5fb5-b653-3902730a1f77 with identifier: PB64949
2026-03-28 12:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d7aab9ee-b288-5fb5-b653-3902730a1f77 with identifier: PB64949
2026-03-28 12:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d7aab9ee-b288-5fb5-b653-3902730a1f77 with identifier: PB64949 to the API
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_8cf35bfb75e4200640b90a0642f72ef3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 191,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 306,
'expiration_date': '2026-03-30T15:08:25Z',
'fuel_type': 'petrol',
'id': 'd7aab9ee-b288-5fb5-b653-3902730a1f77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB64949',
'listing': 'auction',
'location': 'IT, Perugia',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 62667,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61873,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_8cf35bfb75e4200640b90a0642f72ef3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78375,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_5f4e67d8e9fac1b0683f01fcd273e79c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_d2d92af5e7f32134d55c8cb067c0a9ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_068ba9473ef2e30516ed99c987f30b71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56795,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_fa4c4624b00633598e7b0792c81ba954.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_3b1d7088504743721864982bf313d215.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68332,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_0b283526c1de44b3cb8b411e80e80b58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_067e657b09ec039f3c8ce22c7899e762.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_080411e73ca6f872c89cd7c91adb1b6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7aab9ee-b288-5fb5-b653-3902730a1f77/d7aab9ee-b288-5fb5-b653-3902730a1f77_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58542,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/78/c378a840f40aaf9c78118fda8145a2fa/pa/PB64949_c89a02b2d2440703a563020dfbc060f2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-21',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 35 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2021}
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB64949%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [auto1.it] INFO: Saving data for PB64949: {'created_time': 1774699308.784849, 'last_price_update_time': 1774699308.784859, 'auction_closing_time': 1774883305.0}
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PB64949') HTTP/1.1" 204 0
2026-03-28 12:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d706710>
2026-03-28 12:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_f22f84626e6f2feaa9df0252898e6b36.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_f22f84626e6f2feaa9df0252898e6b36.jpg saved to cache
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60cab577-266b-522b-8554-2169dae86b8b
2026-03-28 12:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_343e72f394b097f120047673988b7474.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_17c6ba363f38cee1c7879e5d0f7c62c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_93d8bb3ff1ba3f3759a85c0c6823c44b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_93d8bb3ff1ba3f3759a85c0c6823c44b.jpg not downloaded yet
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_1d356fef4cd7b45b25c0b0331f202d09.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_1d356fef4cd7b45b25c0b0331f202d09.jpg not downloaded yet
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_9ff227b770e0477dffb544ecd6655991.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_9ff227b770e0477dffb544ecd6655991.jpg not downloaded yet
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_508ade47a3c4fc5d8f0b7353093d860e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_508ade47a3c4fc5d8f0b7353093d860e.jpg not downloaded yet
2026-03-28 12:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_6d551cb210a34d26d1e79737daf43ac2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_4117c7482b64665498689d9b8d703b71.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_4117c7482b64665498689d9b8d703b71.jpg not downloaded yet
2026-03-28 12:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cc15950>
2026-03-28 12:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_90b281bb2ecd2760eff89b9de4d15cd2.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_90b281bb2ecd2760eff89b9de4d15cd2.jpg saved to cache
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60cab577-266b-522b-8554-2169dae86b8b
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4e8590>
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_c81e18f9dba1f3d95fc03e66dcc5699a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_c81e18f9dba1f3d95fc03e66dcc5699a.jpg saved to cache
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b6f0271-03d1-55e7-ad95-d6d36d996802
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_782ea19ef7792e4b9f9c244ffca410c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_782ea19ef7792e4b9f9c244ffca410c4.jpg not downloaded yet
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d427890>
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_d9a108d17a61343fdc1a352a4a2f0739.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_d9a108d17a61343fdc1a352a4a2f0739.jpg saved to cache
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2743f585-7051-5b70-af74-c89fd1e915e4
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d50e690>
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_343e72f394b097f120047673988b7474.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_343e72f394b097f120047673988b7474.jpg saved to cache
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60cab577-266b-522b-8554-2169dae86b8b
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d50e610>
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_598f1509-b6c4-51f8-8911-bdcdd670920f/598f1509-b6c4-51f8-8911-bdcdd670920f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F24%252Fb724d8534f80d7726fa981df08c1178f%252Fpa%252FBV97003_17c6ba363f38cee1c7879e5d0f7c62c7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_17c6ba363f38cee1c7879e5d0f7c62c7.jpg saved to cache
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 598f1509-b6c4-51f8-8911-bdcdd670920f
2026-03-28 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_0284b5514ecdca08f7a07d367a32e2b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f92fd90>
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_6d551cb210a34d26d1e79737daf43ac2.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_6d551cb210a34d26d1e79737daf43ac2.jpg saved to cache
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 939d870a-2472-5d56-875a-9ded5ded9aac
2026-03-28 12:01:49 [auto1.it] INFO: Channel: 24h | Page: 8 | totalHits: 3672 | hits on page: 40
2026-03-28 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_160397f8f815733c082095f7df0ead29.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_5d1931040918d3e7a9e1ed3687b8a7d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: TW88152
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW88152%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.it] INFO: Scrape type for TW88152: 0
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: MU21056
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: BG29864
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG29864%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.it] INFO: Scrape type for BG29864: 0
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: XE56181
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: WY26414
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY26414%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.it] INFO: Scrape type for WY26414: 0
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: CP34925
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: UB84582
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: HY41860
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY41860%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.it] INFO: Scrape type for HY41860: 0
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: CB28979
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: FD69176
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD69176%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.it] INFO: Scrape type for FD69176: 0
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: RG05236
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: MN63848
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: GC15950
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: ZU87038
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU87038%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.it] INFO: Scrape type for ZU87038: 0
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: YR71782
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: RX70685
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: ZG33148
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG33148%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.it] INFO: Scrape type for ZG33148: 0
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: JP42061
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: PR59695
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: YC40082
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: AL09653
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: DK55043
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: AG82147
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG82147%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.it] INFO: Scrape type for AG82147: 0
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: RG79014
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG79014%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.it] INFO: Scrape type for RG79014: 0
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: NU26591
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: UB42424
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: RV63380
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: JE70672
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: KL44785
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: TU59167
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: TD04886
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: NK26905
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: PL47981
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL47981%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.it] INFO: Scrape type for PL47981: 0
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: EP64063
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: XS31843
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS31843%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.it] INFO: Scrape type for XS31843: 0
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: DP98022
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: TZ57511
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: XF75286
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: MN96094
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN96094%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.it] INFO: Scrape type for MN96094: 0
2026-03-28 12:01:49 [auto1.it] INFO: Found listing with ID: YD21144
2026-03-28 12:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_4a3beb45bc06914af87e96614321118b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_04172265b8498e99c2e4145dce7eaa8d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f92dbd0>
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_598f1509-b6c4-51f8-8911-bdcdd670920f/598f1509-b6c4-51f8-8911-bdcdd670920f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F24%252Fb724d8534f80d7726fa981df08c1178f%252Fpa%252FBV97003_0284b5514ecdca08f7a07d367a32e2b7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_0284b5514ecdca08f7a07d367a32e2b7.jpg saved to cache
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 598f1509-b6c4-51f8-8911-bdcdd670920f
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cc12010>
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_160397f8f815733c082095f7df0ead29.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_160397f8f815733c082095f7df0ead29.jpg saved to cache
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2743f585-7051-5b70-af74-c89fd1e915e4
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d555ad0>
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_5d1931040918d3e7a9e1ed3687b8a7d3.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_5d1931040918d3e7a9e1ed3687b8a7d3.jpg saved to cache
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60cab577-266b-522b-8554-2169dae86b8b
2026-03-28 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_e68334a72bdf2da5b976ee19e61636ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_9446252852e8990f23ab169eb34f28eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_e87b59bf6481a457782dae4b8d190adf.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca2f290>
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_4a3beb45bc06914af87e96614321118b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_4a3beb45bc06914af87e96614321118b.jpg saved to cache
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 939d870a-2472-5d56-875a-9ded5ded9aac
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4ecc90>
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_04172265b8498e99c2e4145dce7eaa8d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_04172265b8498e99c2e4145dce7eaa8d.jpg saved to cache
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 939d870a-2472-5d56-875a-9ded5ded9aac
2026-03-28 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_7f644d0fe4ffee4fd9619bfd1e5871df.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_2c299092bab7f3681771e1ac4bb07975.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_edb08aee4935e7ba2ad3c5a00be9b175.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d68a810>
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_e68334a72bdf2da5b976ee19e61636ce.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_e68334a72bdf2da5b976ee19e61636ce.jpg saved to cache
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3125444b-ce32-5f23-a0cd-ca40b478b4d4
2026-03-28 12:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb35390>
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_9446252852e8990f23ab169eb34f28eb.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_9446252852e8990f23ab169eb34f28eb.jpg saved to cache
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3125444b-ce32-5f23-a0cd-ca40b478b4d4
2026-03-28 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_b9f7c8f855234d4d942bbdb701f5553c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_1d356fef4cd7b45b25c0b0331f202d09.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_0f0936b228b4e140829a5712ffb78f3e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_4117c7482b64665498689d9b8d703b71.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_93d8bb3ff1ba3f3759a85c0c6823c44b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4dba10>
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_e87b59bf6481a457782dae4b8d190adf.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_e87b59bf6481a457782dae4b8d190adf.jpg saved to cache
2026-03-28 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b6f0271-03d1-55e7-ad95-d6d36d996802
2026-03-28 12:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d613a10>
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_7f644d0fe4ffee4fd9619bfd1e5871df.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_7f644d0fe4ffee4fd9619bfd1e5871df.jpg saved to cache
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3125444b-ce32-5f23-a0cd-ca40b478b4d4
2026-03-28 12:01:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d424dd0>
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_2c299092bab7f3681771e1ac4bb07975.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_2c299092bab7f3681771e1ac4bb07975.jpg saved to cache
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3125444b-ce32-5f23-a0cd-ca40b478b4d4
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d464b90>
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_edb08aee4935e7ba2ad3c5a00be9b175.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_edb08aee4935e7ba2ad3c5a00be9b175.jpg saved to cache
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-03-28 12:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_f8439fb9c66fec878540e5e94649caee.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca83990>
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_b9f7c8f855234d4d942bbdb701f5553c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_b9f7c8f855234d4d942bbdb701f5553c.jpg saved to cache
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 939d870a-2472-5d56-875a-9ded5ded9aac
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d669450>
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_1d356fef4cd7b45b25c0b0331f202d09.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_1d356fef4cd7b45b25c0b0331f202d09.jpg saved to cache
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8b6f0271-03d1-55e7-ad95-d6d36d996802
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d535650>
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_0f0936b228b4e140829a5712ffb78f3e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_0f0936b228b4e140829a5712ffb78f3e.jpg saved to cache
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 939d870a-2472-5d56-875a-9ded5ded9aac
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb82fd0>
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_4117c7482b64665498689d9b8d703b71.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_4117c7482b64665498689d9b8d703b71.jpg saved to cache
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 939d870a-2472-5d56-875a-9ded5ded9aac
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4f9250>
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_93d8bb3ff1ba3f3759a85c0c6823c44b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_93d8bb3ff1ba3f3759a85c0c6823c44b.jpg saved to cache
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-03-28 12:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR17884> (referer: https://www.auto1.com/v1/car-details-view/PR17884/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP65023> (referer: https://www.auto1.com/v1/car-details-view/XP65023/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d56bed0>
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_f8439fb9c66fec878540e5e94649caee.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_f8439fb9c66fec878540e5e94649caee.jpg saved to cache
2026-03-28 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60cab577-266b-522b-8554-2169dae86b8b
2026-03-28 12:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_904a1448d11fe41ade31d88388b4b912.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_508ade47a3c4fc5d8f0b7353093d860e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_9ff227b770e0477dffb544ecd6655991.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_782ea19ef7792e4b9f9c244ffca410c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_96f69fb0b7eacfde644cf14f822f75fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_c3b36ca719edb9488c99f4c25d96f54e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:50 [auto1.it] INFO: Channel: 24h | Page: 9 | totalHits: 3672 | hits on page: 40
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: RT57270
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT57270%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.it] INFO: Scrape type for RT57270: 0
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: JC99655
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: YN59096
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: PC10641
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: MH04778
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: HG07035
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG07035%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.it] INFO: Scrape type for HG07035: 0
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: RB57838
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB57838%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.it] INFO: Scrape type for RB57838: 0
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: UW00940
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: CR16346
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: PD21393
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: AU50392
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU50392%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.it] INFO: Scrape type for AU50392: 0
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: XK62729
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: BD17279
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: VV69855
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV69855%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.it] INFO: Scrape type for VV69855: 0
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: WP22813
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP22813%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.it] INFO: Scrape type for WP22813: 0
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: PZ74443
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: DF91853
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: KA05234
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA05234%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.it] INFO: Scrape type for KA05234: 0
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: NA17081
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA17081%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.it] INFO: Scrape type for NA17081: 0
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: XL36522
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL36522%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.it] INFO: Scrape type for XL36522: 0
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: WJ93918
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ93918%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.it] INFO: Scrape type for WJ93918: 0
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: PW21371
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW21371%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.it] INFO: Scrape type for PW21371: 0
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: TR54078
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: LG70821
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: TL02972
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL02972%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.it] INFO: Scrape type for TL02972: 0
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: PD30072
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: PN93360
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: WH30921
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH30921%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.it] INFO: Scrape type for WH30921: 0
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: WC55302
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC55302%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.it] INFO: Scrape type for WC55302: 0
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: GP46420
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: LD02725
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD02725%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.it] INFO: Scrape type for LD02725: 0
2026-03-28 12:01:50 [auto1.it] INFO: Found listing with ID: SB80667
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB80667%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [auto1.it] INFO: Scrape type for SB80667: 0
2026-03-28 12:01:51 [auto1.it] INFO: Found listing with ID: HW51602
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW51602%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [auto1.it] INFO: Scrape type for HW51602: 0
2026-03-28 12:01:51 [auto1.it] INFO: Found listing with ID: DX75497
2026-03-28 12:01:51 [auto1.it] INFO: Found listing with ID: KF97174
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF97174%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [auto1.it] INFO: Scrape type for KF97174: 0
2026-03-28 12:01:51 [auto1.it] INFO: Found listing with ID: UT33269
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT33269%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [auto1.it] INFO: Scrape type for UT33269: 0
2026-03-28 12:01:51 [auto1.it] INFO: Found listing with ID: GJ33186
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ33186%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [auto1.it] INFO: Scrape type for GJ33186: 0
2026-03-28 12:01:51 [auto1.it] INFO: Found listing with ID: CJ50775
2026-03-28 12:01:51 [auto1.it] INFO: Found listing with ID: YB09690
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB09690%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [auto1.it] INFO: Scrape type for YB09690: 0
2026-03-28 12:01:51 [auto1.it] INFO: Found listing with ID: UC99700
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC99700%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [auto1.it] INFO: Scrape type for UC99700: 0
2026-03-28 12:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_37855beeea9a67381281cd7fd7c1af1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_e5a1899f1df72bd10dc41548b5c51dec.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_6dfb5d184d909cebda9d2913ac0dac78.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_8365e6147718afad652389e716cc9773.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_df94767585ae8e949f1d77ce6b87281a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_e2474454c1b57074f31775a8f79721c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b55122a7-834f-5bc0-806d-2baee269eaf4 with identifier: PR17884
2026-03-28 12:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b55122a7-834f-5bc0-806d-2baee269eaf4 with scrape type 1
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b55122a7-834f-5bc0-806d-2baee269eaf4
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_9746ac36f889212064daa882c175c615.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_9746ac36f889212064daa882c175c615.jpg not downloaded yet
2026-03-28 12:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a03dd6b-308f-516d-904e-9356a820ad90 with identifier: XP65023
2026-03-28 12:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a03dd6b-308f-516d-904e-9356a820ad90 with scrape type 1
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a03dd6b-308f-516d-904e-9356a820ad90
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_92e5ac640e7127d54c71ec5b141fffb5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_92e5ac640e7127d54c71ec5b141fffb5.jpg not downloaded yet
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb64ed0>
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_904a1448d11fe41ade31d88388b4b912.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_904a1448d11fe41ade31d88388b4b912.jpg saved to cache
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b6f0271-03d1-55e7-ad95-d6d36d996802
2026-03-28 12:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb65090>
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_508ade47a3c4fc5d8f0b7353093d860e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_508ade47a3c4fc5d8f0b7353093d860e.jpg saved to cache
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60cab577-266b-522b-8554-2169dae86b8b
2026-03-28 12:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca771d0>
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_9ff227b770e0477dffb544ecd6655991.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_9ff227b770e0477dffb544ecd6655991.jpg saved to cache
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2743f585-7051-5b70-af74-c89fd1e915e4
2026-03-28 12:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3caaa750>
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_782ea19ef7792e4b9f9c244ffca410c4.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_782ea19ef7792e4b9f9c244ffca410c4.jpg saved to cache
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 939d870a-2472-5d56-875a-9ded5ded9aac
2026-03-28 12:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca75c10>
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_96f69fb0b7eacfde644cf14f822f75fa.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_96f69fb0b7eacfde644cf14f822f75fa.jpg saved to cache
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2743f585-7051-5b70-af74-c89fd1e915e4
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca75350>
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_c3b36ca719edb9488c99f4c25d96f54e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_c3b36ca719edb9488c99f4c25d96f54e.jpg saved to cache
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b6f0271-03d1-55e7-ad95-d6d36d996802
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_5a62da67035653967edcaccb250120db.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_5a62da67035653967edcaccb250120db.jpg not downloaded yet
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_9fb545b2fe7267ff4db75341fdaf9c5d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_9fb545b2fe7267ff4db75341fdaf9c5d.jpg not downloaded yet
2026-03-28 12:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_0485c9184dd199257df421db14c947f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_dea0bfd0f352975a57d24c92be80c296.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_dea0bfd0f352975a57d24c92be80c296.jpg not downloaded yet
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_e26624bd0abbe1afc441bb8bc762c16d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_e26624bd0abbe1afc441bb8bc762c16d.jpg not downloaded yet
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4583d0>
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_37855beeea9a67381281cd7fd7c1af1b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_37855beeea9a67381281cd7fd7c1af1b.jpg saved to cache
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d706c90>
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_598f1509-b6c4-51f8-8911-bdcdd670920f/598f1509-b6c4-51f8-8911-bdcdd670920f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F24%252Fb724d8534f80d7726fa981df08c1178f%252Fpa%252FBV97003_e5a1899f1df72bd10dc41548b5c51dec.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_e5a1899f1df72bd10dc41548b5c51dec.jpg saved to cache
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 598f1509-b6c4-51f8-8911-bdcdd670920f
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6b3f90>
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_6dfb5d184d909cebda9d2913ac0dac78.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_6dfb5d184d909cebda9d2913ac0dac78.jpg saved to cache
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7041d0>
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_8365e6147718afad652389e716cc9773.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_8365e6147718afad652389e716cc9773.jpg saved to cache
2026-03-28 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60cab577-266b-522b-8554-2169dae86b8b
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb7a150>
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_df94767585ae8e949f1d77ce6b87281a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_df94767585ae8e949f1d77ce6b87281a.jpg saved to cache
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2743f585-7051-5b70-af74-c89fd1e915e4
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d704510>
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_e2474454c1b57074f31775a8f79721c3.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_e2474454c1b57074f31775a8f79721c3.jpg saved to cache
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2743f585-7051-5b70-af74-c89fd1e915e4
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_96c2149c57934fdf6ae18d338a43b8ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_94baf0d4f8315a5267176d70948aa5ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_94baf0d4f8315a5267176d70948aa5ac.jpg not downloaded yet
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_b8f6a1787b28222788ba266416468731.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_b8f6a1787b28222788ba266416468731.jpg not downloaded yet
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_c7446054954f668bb012648d681917fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_8747c88df6412906976f841c4884c6e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_92e5ac640e7127d54c71ec5b141fffb5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_8dfc94a1723c57b1b32c8ae3237c969d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_8dfc94a1723c57b1b32c8ae3237c969d.jpg not downloaded yet
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_f246e2a572c96760afbfbdde1737f398.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_f246e2a572c96760afbfbdde1737f398.jpg not downloaded yet
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_9746ac36f889212064daa882c175c615.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d712b90>
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_0485c9184dd199257df421db14c947f1.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_0485c9184dd199257df421db14c947f1.jpg saved to cache
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b6f0271-03d1-55e7-ad95-d6d36d996802
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_7951003d2e02bcfabb79d81c9ea9a752.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_7951003d2e02bcfabb79d81c9ea9a752.jpg not downloaded yet
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_b75b3e3fd19295d5fb2658204c2ca77c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_b75b3e3fd19295d5fb2658204c2ca77c.jpg not downloaded yet
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_33ea20c7fcc8f44e8369111bb77af0ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_2728fed28c262448c94e4b69b53c84df.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_2728fed28c262448c94e4b69b53c84df.jpg not downloaded yet
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_9fd5774b06d7c4fe3f8bddd73b465e58.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_9fd5774b06d7c4fe3f8bddd73b465e58.jpg not downloaded yet
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_5b73730f8520bd67c67507dc804f75b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_643fbf05c20f3285a36a30d5f901ed75.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_643fbf05c20f3285a36a30d5f901ed75.jpg not downloaded yet
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_384584c07e7c940b20d7157fba680485.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_384584c07e7c940b20d7157fba680485.jpg not downloaded yet
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6cb9d0>
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_96c2149c57934fdf6ae18d338a43b8ea.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_96c2149c57934fdf6ae18d338a43b8ea.jpg saved to cache
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60cab577-266b-522b-8554-2169dae86b8b
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca3bb10>
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_c7446054954f668bb012648d681917fa.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_c7446054954f668bb012648d681917fa.jpg saved to cache
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4cf610>
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_8747c88df6412906976f841c4884c6e8.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_8747c88df6412906976f841c4884c6e8.jpg saved to cache
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b6f0271-03d1-55e7-ad95-d6d36d996802
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d50d350>
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_92e5ac640e7127d54c71ec5b141fffb5.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_92e5ac640e7127d54c71ec5b141fffb5.jpg saved to cache
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a03dd6b-308f-516d-904e-9356a820ad90
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_000323dcd17c15d7d619b4ea414e705b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_000323dcd17c15d7d619b4ea414e705b.jpg not downloaded yet
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_d51383b89e725b90318b32c0e1c2db67.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_d51383b89e725b90318b32c0e1c2db67.jpg not downloaded yet
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d46eed0>
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_9746ac36f889212064daa882c175c615.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_9746ac36f889212064daa882c175c615.jpg saved to cache
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b55122a7-834f-5bc0-806d-2baee269eaf4
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_3c187713e6728e616791e3b6dfc2fdb2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_88f517a5c812e972565011330860c366.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_03d028e4cac85844d1a64293855251bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_d3669f6e49aebc9242bca64f4381f3ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_d3669f6e49aebc9242bca64f4381f3ef.jpg not downloaded yet
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_faf0b233ce898355720e31a2b7f22667.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_faf0b233ce898355720e31a2b7f22667.jpg not downloaded yet
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4a2490>
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_33ea20c7fcc8f44e8369111bb77af0ec.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_33ea20c7fcc8f44e8369111bb77af0ec.jpg saved to cache
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b6f0271-03d1-55e7-ad95-d6d36d996802
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c95dbd0>
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_5b73730f8520bd67c67507dc804f75b1.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_5b73730f8520bd67c67507dc804f75b1.jpg saved to cache
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2743f585-7051-5b70-af74-c89fd1e915e4
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_f02fc68701a7d28b206b5560801d211b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca4b890>
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_3c187713e6728e616791e3b6dfc2fdb2.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_3c187713e6728e616791e3b6dfc2fdb2.jpg saved to cache
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbc7e10>
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_88f517a5c812e972565011330860c366.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_88f517a5c812e972565011330860c366.jpg saved to cache
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca05c10>
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_598f1509-b6c4-51f8-8911-bdcdd670920f/598f1509-b6c4-51f8-8911-bdcdd670920f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F24%252Fb724d8534f80d7726fa981df08c1178f%252Fpa%252FBV97003_03d028e4cac85844d1a64293855251bf.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_03d028e4cac85844d1a64293855251bf.jpg saved to cache
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 598f1509-b6c4-51f8-8911-bdcdd670920f
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_b8f6a1787b28222788ba266416468731.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_e26624bd0abbe1afc441bb8bc762c16d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca6a490>
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_f02fc68701a7d28b206b5560801d211b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_f02fc68701a7d28b206b5560801d211b.jpg saved to cache
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60cab577-266b-522b-8554-2169dae86b8b
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_dea0bfd0f352975a57d24c92be80c296.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_9c7fd73106b7eee73f982378fd774c80.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_58f732aae10b7ad2a54d3d32b7662cea.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_635690328de0f9ef54811f3f1a11d3d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_d7c8351d053c27eda2b220c585429fc2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d613e90>
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_b8f6a1787b28222788ba266416468731.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_b8f6a1787b28222788ba266416468731.jpg saved to cache
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a03dd6b-308f-516d-904e-9356a820ad90
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_643fbf05c20f3285a36a30d5f901ed75.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_2728fed28c262448c94e4b69b53c84df.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca39890>
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_e26624bd0abbe1afc441bb8bc762c16d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_e26624bd0abbe1afc441bb8bc762c16d.jpg saved to cache
2026-03-28 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a03dd6b-308f-516d-904e-9356a820ad90
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_9fb545b2fe7267ff4db75341fdaf9c5d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_d3669f6e49aebc9242bca64f4381f3ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c840e90>
2026-03-28 12:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_dea0bfd0f352975a57d24c92be80c296.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_dea0bfd0f352975a57d24c92be80c296.jpg saved to cache
2026-03-28 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b55122a7-834f-5bc0-806d-2baee269eaf4
2026-03-28 12:01:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6ff3d0>
2026-03-28 12:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F21%252F19210a9b9f6cdc0ca0b3d57e43c2f1e1%252Fpa%252FHC77212_9c7fd73106b7eee73f982378fd774c80.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_9c7fd73106b7eee73f982378fd774c80.jpg saved to cache
2026-03-28 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60cab577-266b-522b-8554-2169dae86b8b
2026-03-28 12:01:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60cab577-266b-522b-8554-2169dae86b8b, skipping ID generation
2026-03-28 12:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60cab577-266b-522b-8554-2169dae86b8b with scrape type 1
2026-03-28 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60cab577-266b-522b-8554-2169dae86b8b sending to next pipeline
2026-03-28 12:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 60cab577-266b-522b-8554-2169dae86b8b, identifier: HC77212
2026-03-28 12:01:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c969cd0>
2026-03-28 12:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_58f732aae10b7ad2a54d3d32b7662cea.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_58f732aae10b7ad2a54d3d32b7662cea.jpg saved to cache
2026-03-28 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 939d870a-2472-5d56-875a-9ded5ded9aac
2026-03-28 12:01:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cabd5d0>
2026-03-28 12:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_635690328de0f9ef54811f3f1a11d3d6.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_635690328de0f9ef54811f3f1a11d3d6.jpg saved to cache
2026-03-28 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2743f585-7051-5b70-af74-c89fd1e915e4
2026-03-28 12:01:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d610950>
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_d7c8351d053c27eda2b220c585429fc2.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_d7c8351d053c27eda2b220c585429fc2.jpg saved to cache
2026-03-28 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 939d870a-2472-5d56-875a-9ded5ded9aac
2026-03-28 12:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_b75b3e3fd19295d5fb2658204c2ca77c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_9fd5774b06d7c4fe3f8bddd73b465e58.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 60cab577-266b-522b-8554-2169dae86b8b with identifier: HC77212
2026-03-28 12:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 60cab577-266b-522b-8554-2169dae86b8b with identifier: HC77212
2026-03-28 12:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 60cab577-266b-522b-8554-2169dae86b8b with identifier: HC77212 to the API
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_9c7fd73106b7eee73f982378fd774c80.jpg>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:54:45Z',
'fuel_type': 'diesel',
'id': '60cab577-266b-522b-8554-2169dae86b8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC77212',
'listing': 'auction',
'location': 'IT, Modena',
'make': 'Audi',
'model': 'A4',
'odometer': 147258,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_f22f84626e6f2feaa9df0252898e6b36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_90b281bb2ecd2760eff89b9de4d15cd2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61723,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_f02fc68701a7d28b206b5560801d211b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61420,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_343e72f394b097f120047673988b7474.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_96c2149c57934fdf6ae18d338a43b8ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2376290,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_9c7fd73106b7eee73f982378fd774c80.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52217,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_5d1931040918d3e7a9e1ed3687b8a7d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_8365e6147718afad652389e716cc9773.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70985,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_f8439fb9c66fec878540e5e94649caee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cab577-266b-522b-8554-2169dae86b8b/60cab577-266b-522b-8554-2169dae86b8b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2810539,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img19/21/19210a9b9f6cdc0ca0b3d57e43c2f1e1/pa/HC77212_508ade47a3c4fc5d8f0b7353093d860e.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-06-07',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC77212%27 HTTP/1.1" 200 None
2026-03-28 12:01:54 [auto1.it] INFO: Saving data for HC77212: {'created_time': 1774699314.651456, 'last_price_update_time': 1774699314.651466, 'auction_closing_time': 1774886085.0}
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HC77212') HTTP/1.1" 204 0
2026-03-28 12:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_94baf0d4f8315a5267176d70948aa5ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_000323dcd17c15d7d619b4ea414e705b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6610d0>
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_643fbf05c20f3285a36a30d5f901ed75.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_643fbf05c20f3285a36a30d5f901ed75.jpg saved to cache
2026-03-28 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b55122a7-834f-5bc0-806d-2baee269eaf4
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca22290>
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_2728fed28c262448c94e4b69b53c84df.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_2728fed28c262448c94e4b69b53c84df.jpg saved to cache
2026-03-28 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b55122a7-834f-5bc0-806d-2baee269eaf4
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d430950>
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_9fb545b2fe7267ff4db75341fdaf9c5d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_9fb545b2fe7267ff4db75341fdaf9c5d.jpg saved to cache
2026-03-28 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a03dd6b-308f-516d-904e-9356a820ad90
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d47c8d0>
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_d3669f6e49aebc9242bca64f4381f3ef.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_d3669f6e49aebc9242bca64f4381f3ef.jpg saved to cache
2026-03-28 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b55122a7-834f-5bc0-806d-2baee269eaf4
2026-03-28 12:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_7951003d2e02bcfabb79d81c9ea9a752.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca837d0>
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_b75b3e3fd19295d5fb2658204c2ca77c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_b75b3e3fd19295d5fb2658204c2ca77c.jpg saved to cache
2026-03-28 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a03dd6b-308f-516d-904e-9356a820ad90
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca3ed50>
2026-03-28 12:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_9fd5774b06d7c4fe3f8bddd73b465e58.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_9fd5774b06d7c4fe3f8bddd73b465e58.jpg saved to cache
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a03dd6b-308f-516d-904e-9356a820ad90
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d63e910>
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_94baf0d4f8315a5267176d70948aa5ac.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_94baf0d4f8315a5267176d70948aa5ac.jpg saved to cache
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b55122a7-834f-5bc0-806d-2baee269eaf4
2026-03-28 12:01:55 [auto1.it] INFO: Channel: 24h | Page: 10 | totalHits: 3672 | hits on page: 40
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca3cf10>
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_000323dcd17c15d7d619b4ea414e705b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_000323dcd17c15d7d619b4ea414e705b.jpg saved to cache
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b55122a7-834f-5bc0-806d-2baee269eaf4
2026-03-28 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_c8e9ae90861f51a1e8717de749b0faf8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: EG31110
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG31110%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for EG31110: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: SK62476
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK62476%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for SK62476: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: KR24813
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: WL53741
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL53741%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for WL53741: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: KK99486
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: XW14976
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: CV32353
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: RB84694
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB84694%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for RB84694: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: YE49798
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: DJ31826
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ31826%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for DJ31826: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: UL30423
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: MT45417
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT45417%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for MT45417: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: FV07755
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV07755%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for FV07755: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: SW75734
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: HJ71706
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ71706%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for HJ71706: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: XV92434
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV92434%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for XV92434: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: UK64691
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: ZY56429
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY56429%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for ZY56429: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: AN61279
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: LT86375
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: TP07930
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP07930%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for TP07930: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: TY62021
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: EH51725
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: HC48656
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC48656%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for HC48656: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: NL55256
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: FG90237
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG90237%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for FG90237: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: YH23554
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: NK99622
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK99622%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for NK99622: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: JF19899
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF19899%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for JF19899: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: YN45355
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: GK54745
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK54745%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for GK54745: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: SR88948
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: NR71125
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR71125%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for NR71125: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: NS64988
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: HT01283
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT01283%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for HT01283: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: HV13929
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: GV28161
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV28161%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for GV28161: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: AE80998
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE80998%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.it] INFO: Scrape type for AE80998: 0
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: PD66788
2026-03-28 12:01:55 [auto1.it] INFO: Found listing with ID: EY62849
2026-03-28 12:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d69b650>
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_7951003d2e02bcfabb79d81c9ea9a752.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_7951003d2e02bcfabb79d81c9ea9a752.jpg saved to cache
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b55122a7-834f-5bc0-806d-2baee269eaf4
2026-03-28 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_f246e2a572c96760afbfbdde1737f398.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_a55570bbff05c30dd7f9e1dc7d4935dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_5a62da67035653967edcaccb250120db.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_8dfc94a1723c57b1b32c8ae3237c969d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f5b0d10>
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_c8e9ae90861f51a1e8717de749b0faf8.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_c8e9ae90861f51a1e8717de749b0faf8.jpg saved to cache
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b6f0271-03d1-55e7-ad95-d6d36d996802
2026-03-28 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_faf0b233ce898355720e31a2b7f22667.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_ce2170c8411739fbea359e9446e453da.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_d51383b89e725b90318b32c0e1c2db67.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_384584c07e7c940b20d7157fba680485.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_383bf4c91d9f57d8574a8fdaf6d9fd76.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca053d0>
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_f246e2a572c96760afbfbdde1737f398.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_f246e2a572c96760afbfbdde1737f398.jpg saved to cache
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a03dd6b-308f-516d-904e-9356a820ad90
2026-03-28 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_531a508c321c3103f6913724165e7c2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_b1c88a3db748350e10805a0566b8a1b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb655d0>
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_a55570bbff05c30dd7f9e1dc7d4935dc.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_a55570bbff05c30dd7f9e1dc7d4935dc.jpg saved to cache
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2743f585-7051-5b70-af74-c89fd1e915e4
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d569690>
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_5a62da67035653967edcaccb250120db.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_5a62da67035653967edcaccb250120db.jpg saved to cache
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b55122a7-834f-5bc0-806d-2baee269eaf4
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d773150>
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F96%252F619602b361efea2b6bd477de793b6278%252Fpa%252FPR17884_8dfc94a1723c57b1b32c8ae3237c969d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_8dfc94a1723c57b1b32c8ae3237c969d.jpg saved to cache
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b55122a7-834f-5bc0-806d-2baee269eaf4
2026-03-28 12:01:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b55122a7-834f-5bc0-806d-2baee269eaf4, skipping ID generation
2026-03-28 12:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b55122a7-834f-5bc0-806d-2baee269eaf4 with scrape type 1
2026-03-28 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b55122a7-834f-5bc0-806d-2baee269eaf4 sending to next pipeline
2026-03-28 12:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b55122a7-834f-5bc0-806d-2baee269eaf4, identifier: PR17884
2026-03-28 12:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b55122a7-834f-5bc0-806d-2baee269eaf4 with identifier: PR17884
2026-03-28 12:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b55122a7-834f-5bc0-806d-2baee269eaf4 with identifier: PR17884
2026-03-28 12:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b55122a7-834f-5bc0-806d-2baee269eaf4 with identifier: PR17884 to the API
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_8dfc94a1723c57b1b32c8ae3237c969d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:33:09Z',
'fuel_type': 'diesel',
'id': 'b55122a7-834f-5bc0-806d-2baee269eaf4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR17884',
'listing': 'auction',
'location': 'IT, Corsico',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 210880,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_9746ac36f889212064daa882c175c615.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_5a62da67035653967edcaccb250120db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_dea0bfd0f352975a57d24c92be80c296.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71779,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_94baf0d4f8315a5267176d70948aa5ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_8dfc94a1723c57b1b32c8ae3237c969d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_7951003d2e02bcfabb79d81c9ea9a752.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_2728fed28c262448c94e4b69b53c84df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_643fbf05c20f3285a36a30d5f901ed75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_000323dcd17c15d7d619b4ea414e705b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55122a7-834f-5bc0-806d-2baee269eaf4/b55122a7-834f-5bc0-806d-2baee269eaf4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75043,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/96/619602b361efea2b6bd477de793b6278/pa/PR17884_d3669f6e49aebc9242bca64f4381f3ef.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel Teckna',
'transmission': 'manual',
'trim': 'Teckna',
'year': 2013}
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR17884%27 HTTP/1.1" 200 None
2026-03-28 12:01:56 [auto1.it] INFO: Saving data for PR17884: {'created_time': 1774699316.383426, 'last_price_update_time': 1774699316.383436, 'auction_closing_time': 1774884789.0}
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR17884') HTTP/1.1" 204 0
2026-03-28 12:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_cc86a92575af59f48a158213053f0a78.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_1e5f2985773c222e4d08368fcd11ab38.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_eac74d6b9dcd2ddcc62831631ffb82b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_32467695b9ce25a6c1a67c1b3ef83e29.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_41ea504a6ff6cf53a8b637c43eda368f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU00933> (referer: https://www.auto1.com/v1/car-details-view/RU00933/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca20a50>
2026-03-28 12:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_faf0b233ce898355720e31a2b7f22667.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_faf0b233ce898355720e31a2b7f22667.jpg saved to cache
2026-03-28 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a03dd6b-308f-516d-904e-9356a820ad90
2026-03-28 12:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbef7d0>
2026-03-28 12:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_598f1509-b6c4-51f8-8911-bdcdd670920f/598f1509-b6c4-51f8-8911-bdcdd670920f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F24%252Fb724d8534f80d7726fa981df08c1178f%252Fpa%252FBV97003_ce2170c8411739fbea359e9446e453da.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_ce2170c8411739fbea359e9446e453da.jpg saved to cache
2026-03-28 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 598f1509-b6c4-51f8-8911-bdcdd670920f
2026-03-28 12:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 598f1509-b6c4-51f8-8911-bdcdd670920f, skipping ID generation
2026-03-28 12:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 598f1509-b6c4-51f8-8911-bdcdd670920f with scrape type 1
2026-03-28 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 598f1509-b6c4-51f8-8911-bdcdd670920f sending to next pipeline
2026-03-28 12:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 598f1509-b6c4-51f8-8911-bdcdd670920f, identifier: BV97003
2026-03-28 12:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4dad10>
2026-03-28 12:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_d51383b89e725b90318b32c0e1c2db67.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_d51383b89e725b90318b32c0e1c2db67.jpg saved to cache
2026-03-28 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a03dd6b-308f-516d-904e-9356a820ad90
2026-03-28 12:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb84b50>
2026-03-28 12:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F46%252F2b4656624b77c06f0895bf07fcb7ade3%252Fpa%252FXP65023_384584c07e7c940b20d7157fba680485.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_384584c07e7c940b20d7157fba680485.jpg saved to cache
2026-03-28 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a03dd6b-308f-516d-904e-9356a820ad90
2026-03-28 12:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a03dd6b-308f-516d-904e-9356a820ad90, skipping ID generation
2026-03-28 12:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a03dd6b-308f-516d-904e-9356a820ad90 with scrape type 1
2026-03-28 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a03dd6b-308f-516d-904e-9356a820ad90 sending to next pipeline
2026-03-28 12:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1a03dd6b-308f-516d-904e-9356a820ad90, identifier: XP65023
2026-03-28 12:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c92bb10>
2026-03-28 12:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_383bf4c91d9f57d8574a8fdaf6d9fd76.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_383bf4c91d9f57d8574a8fdaf6d9fd76.jpg saved to cache
2026-03-28 12:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3125444b-ce32-5f23-a0cd-ca40b478b4d4
2026-03-28 12:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbed010>
2026-03-28 12:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fd0%252F6bd051fda3f20de328110c5c3b01c216%252Fpa%252FZF56836_531a508c321c3103f6913724165e7c2f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_531a508c321c3103f6913724165e7c2f.jpg saved to cache
2026-03-28 12:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 939d870a-2472-5d56-875a-9ded5ded9aac
2026-03-28 12:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 939d870a-2472-5d56-875a-9ded5ded9aac, skipping ID generation
2026-03-28 12:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 939d870a-2472-5d56-875a-9ded5ded9aac with scrape type 1
2026-03-28 12:01:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 939d870a-2472-5d56-875a-9ded5ded9aac sending to next pipeline
2026-03-28 12:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 939d870a-2472-5d56-875a-9ded5ded9aac, identifier: ZF56836
2026-03-28 12:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb2bc50>
2026-03-28 12:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F41%252Ff341bb5c6024ac61bfa1b05d25d82164%252Fpa%252FSC52671_b1c88a3db748350e10805a0566b8a1b1.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_b1c88a3db748350e10805a0566b8a1b1.jpg saved to cache
2026-03-28 12:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b6f0271-03d1-55e7-ad95-d6d36d996802
2026-03-28 12:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b6f0271-03d1-55e7-ad95-d6d36d996802, skipping ID generation
2026-03-28 12:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b6f0271-03d1-55e7-ad95-d6d36d996802 with scrape type 1
2026-03-28 12:01:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b6f0271-03d1-55e7-ad95-d6d36d996802 sending to next pipeline
2026-03-28 12:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8b6f0271-03d1-55e7-ad95-d6d36d996802, identifier: SC52671
2026-03-28 12:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 598f1509-b6c4-51f8-8911-bdcdd670920f with identifier: BV97003
2026-03-28 12:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 598f1509-b6c4-51f8-8911-bdcdd670920f with identifier: BV97003
2026-03-28 12:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 598f1509-b6c4-51f8-8911-bdcdd670920f with identifier: BV97003 to the API
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_ce2170c8411739fbea359e9446e453da.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.4L',
'engine_horse_power': 77,
'expiration_date': '2026-03-30T15:46:52Z',
'fuel_type': 'petrol',
'id': '598f1509-b6c4-51f8-8911-bdcdd670920f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV97003',
'listing': 'auction',
'location': 'IT, Tradein',
'make': 'Fiat',
'model': 'Punto',
'odometer': 175980,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598f1509-b6c4-51f8-8911-bdcdd670920f/598f1509-b6c4-51f8-8911-bdcdd670920f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_ce2170c8411739fbea359e9446e453da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598f1509-b6c4-51f8-8911-bdcdd670920f/598f1509-b6c4-51f8-8911-bdcdd670920f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74675,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_03d028e4cac85844d1a64293855251bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598f1509-b6c4-51f8-8911-bdcdd670920f/598f1509-b6c4-51f8-8911-bdcdd670920f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_17c6ba363f38cee1c7879e5d0f7c62c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598f1509-b6c4-51f8-8911-bdcdd670920f/598f1509-b6c4-51f8-8911-bdcdd670920f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_0284b5514ecdca08f7a07d367a32e2b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598f1509-b6c4-51f8-8911-bdcdd670920f/598f1509-b6c4-51f8-8911-bdcdd670920f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76813,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/24/b724d8534f80d7726fa981df08c1178f/pa/BV97003_e5a1899f1df72bd10dc41548b5c51dec.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-11-24',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Punto 1.4 Street',
'transmission': 'manual',
'trim': 'Street',
'year': 2015}
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV97003%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.it] INFO: Saving data for BV97003: {'created_time': 1774699317.76059, 'last_price_update_time': 1774699317.760601, 'auction_closing_time': 1774885612.0}
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BV97003') HTTP/1.1" 204 0
2026-03-28 12:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1a03dd6b-308f-516d-904e-9356a820ad90 with identifier: XP65023
2026-03-28 12:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1a03dd6b-308f-516d-904e-9356a820ad90 with identifier: XP65023
2026-03-28 12:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1a03dd6b-308f-516d-904e-9356a820ad90 with identifier: XP65023 to the API
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_384584c07e7c940b20d7157fba680485.jpg>
{'auction_title': '',
'c_o_2_emission_value': 141,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:21:29Z',
'fuel_type': 'petrol',
'id': '1a03dd6b-308f-516d-904e-9356a820ad90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP65023',
'listing': 'auction',
'location': 'IT, Varese',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 78163,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63733,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_92e5ac640e7127d54c71ec5b141fffb5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65071,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_9fb545b2fe7267ff4db75341fdaf9c5d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_e26624bd0abbe1afc441bb8bc762c16d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_b8f6a1787b28222788ba266416468731.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_f246e2a572c96760afbfbdde1737f398.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_b75b3e3fd19295d5fb2658204c2ca77c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_9fd5774b06d7c4fe3f8bddd73b465e58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2551582,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_384584c07e7c940b20d7157fba680485.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2363825,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_d51383b89e725b90318b32c0e1c2db67.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03dd6b-308f-516d-904e-9356a820ad90/1a03dd6b-308f-516d-904e-9356a820ad90_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2628048,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2b/46/2b4656624b77c06f0895bf07fcb7ade3/pa/XP65023_faf0b233ce898355720e31a2b7f22667.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-10-10',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2019}
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP65023%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.it] INFO: Saving data for XP65023: {'created_time': 1774699318.150035, 'last_price_update_time': 1774699318.150045, 'auction_closing_time': 1774884089.0}
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XP65023') HTTP/1.1" 204 0
2026-03-28 12:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 939d870a-2472-5d56-875a-9ded5ded9aac with identifier: ZF56836
2026-03-28 12:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 939d870a-2472-5d56-875a-9ded5ded9aac with identifier: ZF56836
2026-03-28 12:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 939d870a-2472-5d56-875a-9ded5ded9aac with identifier: ZF56836 to the API
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_531a508c321c3103f6913724165e7c2f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:40:59Z',
'fuel_type': 'diesel',
'id': '939d870a-2472-5d56-875a-9ded5ded9aac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF56836',
'listing': 'auction',
'location': 'IT, Roma RM',
'make': 'Volvo',
'model': 'V60',
'odometer': 149192,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98417,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_531a508c321c3103f6913724165e7c2f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3217748,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_d7c8351d053c27eda2b220c585429fc2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_6d551cb210a34d26d1e79737daf43ac2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87899,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_4a3beb45bc06914af87e96614321118b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2877313,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_58f732aae10b7ad2a54d3d32b7662cea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_04172265b8498e99c2e4145dce7eaa8d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_b9f7c8f855234d4d942bbdb701f5553c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92653,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_0f0936b228b4e140829a5712ffb78f3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93647,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_4117c7482b64665498689d9b8d703b71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_939d870a-2472-5d56-875a-9ded5ded9aac/939d870a-2472-5d56-875a-9ded5ded9aac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2991051,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6b/d0/6bd051fda3f20de328110c5c3b01c216/pa/ZF56836_782ea19ef7792e4b9f9c244ffca410c4.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-09-03',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V60 1.6 D Kinetic',
'transmission': 'automatic',
'trim': 'Kinetic',
'year': 2012}
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF56836%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.it] INFO: Saving data for ZF56836: {'created_time': 1774699318.518207, 'last_price_update_time': 1774699318.518217, 'auction_closing_time': 1774885259.0}
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZF56836') HTTP/1.1" 204 0
2026-03-28 12:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8b6f0271-03d1-55e7-ad95-d6d36d996802 with identifier: SC52671
2026-03-28 12:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8b6f0271-03d1-55e7-ad95-d6d36d996802 with identifier: SC52671
2026-03-28 12:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8b6f0271-03d1-55e7-ad95-d6d36d996802 with identifier: SC52671 to the API
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_b1c88a3db748350e10805a0566b8a1b1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:36:07Z',
'fuel_type': 'diesel',
'id': '8b6f0271-03d1-55e7-ad95-d6d36d996802',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC52671',
'listing': 'auction',
'location': 'IT, Bologna',
'make': 'MINI',
'model': 'MINI',
'odometer': 141604,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_b1c88a3db748350e10805a0566b8a1b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69470,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_c81e18f9dba1f3d95fc03e66dcc5699a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_c8e9ae90861f51a1e8717de749b0faf8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_33ea20c7fcc8f44e8369111bb77af0ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_8747c88df6412906976f841c4884c6e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_0485c9184dd199257df421db14c947f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67664,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_e87b59bf6481a457782dae4b8d190adf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_c3b36ca719edb9488c99f4c25d96f54e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70703,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_904a1448d11fe41ade31d88388b4b912.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f0271-03d1-55e7-ad95-d6d36d996802/8b6f0271-03d1-55e7-ad95-d6d36d996802_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84635,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/41/f341bb5c6024ac61bfa1b05d25d82164/pa/SC52671_1d356fef4cd7b45b25c0b0331f202d09.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-11-26',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Cooper D',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC52671%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.it] INFO: Saving data for SC52671: {'created_time': 1774699318.899183, 'last_price_update_time': 1774699318.899197, 'auction_closing_time': 1774884967.0}
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SC52671') HTTP/1.1" 204 0
2026-03-28 12:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d459150>
2026-03-28 12:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d83c700-59c6-525f-93a6-99dedd768a75/0d83c700-59c6-525f-93a6-99dedd768a75_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc5%252Fc7c5b789228c0ef379226d359a7fe3dc%252Fpa%252FSX60727_cc86a92575af59f48a158213053f0a78.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_cc86a92575af59f48a158213053f0a78.jpg saved to cache
2026-03-28 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d83c700-59c6-525f-93a6-99dedd768a75
2026-03-28 12:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d83c700-59c6-525f-93a6-99dedd768a75, skipping ID generation
2026-03-28 12:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d83c700-59c6-525f-93a6-99dedd768a75 with scrape type 1
2026-03-28 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d83c700-59c6-525f-93a6-99dedd768a75 sending to next pipeline
2026-03-28 12:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0d83c700-59c6-525f-93a6-99dedd768a75, identifier: SX60727
2026-03-28 12:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d611510>
2026-03-28 12:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_1e5f2985773c222e4d08368fcd11ab38.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_1e5f2985773c222e4d08368fcd11ab38.jpg saved to cache
2026-03-28 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-03-28 12:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d55e490>
2026-03-28 12:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_eac74d6b9dcd2ddcc62831631ffb82b7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_eac74d6b9dcd2ddcc62831631ffb82b7.jpg saved to cache
2026-03-28 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-03-28 12:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c837510>
2026-03-28 12:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b/842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fe9%252F8ce916e78c117337bfceb4e66712a5ed%252Fpa%252FTV81460_32467695b9ce25a6c1a67c1b3ef83e29.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_32467695b9ce25a6c1a67c1b3ef83e29.jpg saved to cache
2026-03-28 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b
2026-03-28 12:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b, skipping ID generation
2026-03-28 12:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b with scrape type 1
2026-03-28 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b sending to next pipeline
2026-03-28 12:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b, identifier: TV81460
2026-03-28 12:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d51ec50>
2026-03-28 12:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F9e%252Fe79ec132c91bffb2baa0c0f277180645%252Fpa%252FLX14349_41ea504a6ff6cf53a8b637c43eda368f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_41ea504a6ff6cf53a8b637c43eda368f.jpg saved to cache
2026-03-28 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-03-28 12:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f8e7b06-aced-5960-83ac-a7e449c0d435, skipping ID generation
2026-03-28 12:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f8e7b06-aced-5960-83ac-a7e449c0d435 with scrape type 1
2026-03-28 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f8e7b06-aced-5960-83ac-a7e449c0d435 sending to next pipeline
2026-03-28 12:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7f8e7b06-aced-5960-83ac-a7e449c0d435, identifier: LX14349
2026-03-28 12:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baaecc36-e42f-5e98-bd91-2854358e8859 with identifier: RU00933
2026-03-28 12:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baaecc36-e42f-5e98-bd91-2854358e8859 with scrape type 1
2026-03-28 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item baaecc36-e42f-5e98-bd91-2854358e8859
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F69%252F3b6971a99bf762ae5cb9a64f3ed7ac11%252Fpa%252FRU00933_df0a8fa263cc668aec7d47d0ca084bb6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_df0a8fa263cc668aec7d47d0ca084bb6.jpg not downloaded yet
2026-03-28 12:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0d83c700-59c6-525f-93a6-99dedd768a75 with identifier: SX60727
2026-03-28 12:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0d83c700-59c6-525f-93a6-99dedd768a75 with identifier: SX60727
2026-03-28 12:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0d83c700-59c6-525f-93a6-99dedd768a75 with identifier: SX60727 to the API
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_cc86a92575af59f48a158213053f0a78.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 73,
'expiration_date': '2026-03-30T15:56:44Z',
'fuel_type': 'petrol',
'id': '0d83c700-59c6-525f-93a6-99dedd768a75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX60727',
'listing': 'auction',
'location': 'IT, Giugliano in Campania',
'make': 'Citroen',
'model': 'C3',
'odometer': 165469,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d83c700-59c6-525f-93a6-99dedd768a75/0d83c700-59c6-525f-93a6-99dedd768a75_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_cc86a92575af59f48a158213053f0a78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d83c700-59c6-525f-93a6-99dedd768a75/0d83c700-59c6-525f-93a6-99dedd768a75_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122367,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_48abd65853100ec1d00c7503630ea215.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d83c700-59c6-525f-93a6-99dedd768a75/0d83c700-59c6-525f-93a6-99dedd768a75_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80169,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_4e1439fe30197c46dc2e3a8f402c9314.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d83c700-59c6-525f-93a6-99dedd768a75/0d83c700-59c6-525f-93a6-99dedd768a75_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74844,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_0b631fc53ad763220bdeafe3d5ab4468.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d83c700-59c6-525f-93a6-99dedd768a75/0d83c700-59c6-525f-93a6-99dedd768a75_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/c5/c7c5b789228c0ef379226d359a7fe3dc/pa/SX60727_d6cdfb90d7ddbb0417aff8489cca3ada.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.4 Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2010}
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX60727%27 HTTP/1.1" 200 None
2026-03-28 12:01:59 [auto1.it] INFO: Saving data for SX60727: {'created_time': 1774699319.799796, 'last_price_update_time': 1774699319.799805, 'auction_closing_time': 1774886204.0}
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SX60727') HTTP/1.1" 204 0
2026-03-28 12:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b with identifier: TV81460
2026-03-28 12:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b with identifier: TV81460
2026-03-28 12:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b with identifier: TV81460 to the API
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_32467695b9ce25a6c1a67c1b3ef83e29.jpg>
{'auction_title': '',
'c_o_2_emission_value': 182,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.9L',
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:31:35Z',
'fuel_type': 'diesel',
'id': '842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV81460',
'listing': 'auction',
'location': 'IT, Lallio BG',
'make': 'Saab',
'model': '9-3',
'odometer': 210368,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b/842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73305,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_32467695b9ce25a6c1a67c1b3ef83e29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b/842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66205,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_de3ec38aea4a0d853bb539acc9d310de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b/842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83265,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_8a73b85331fb513db7bc56da12e2fbdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b/842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54558,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_4618a29776fb3672b83dcba4da62dd32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b/842dbf88-5a90-5ec8-9c1e-4d2fcbb6de2b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/e9/8ce916e78c117337bfceb4e66712a5ed/pa/TV81460_42e882aaebe0801095bd4f29e09cee9b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Saab 9-3 1.9 TTiD Aero',
'transmission': 'automatic',
'trim': 'Aero',
'year': 2009}
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV81460%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Saving data for TV81460: {'created_time': 1774699320.183411, 'last_price_update_time': 1774699320.18342, 'auction_closing_time': 1774884695.0}
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TV81460') HTTP/1.1" 204 0
2026-03-28 12:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7f8e7b06-aced-5960-83ac-a7e449c0d435 with identifier: LX14349
2026-03-28 12:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7f8e7b06-aced-5960-83ac-a7e449c0d435 with identifier: LX14349
2026-03-28 12:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7f8e7b06-aced-5960-83ac-a7e449c0d435 with identifier: LX14349 to the API
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_41ea504a6ff6cf53a8b637c43eda368f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:20:44Z',
'fuel_type': 'diesel',
'id': '7f8e7b06-aced-5960-83ac-a7e449c0d435',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX14349',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 198988,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111174,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_eac74d6b9dcd2ddcc62831631ffb82b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_41ea504a6ff6cf53a8b637c43eda368f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_1e5f2985773c222e4d08368fcd11ab38.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69669,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_88f517a5c812e972565011330860c366.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_3c187713e6728e616791e3b6dfc2fdb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99022,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_c7446054954f668bb012648d681917fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_edb08aee4935e7ba2ad3c5a00be9b175.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_37855beeea9a67381281cd7fd7c1af1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_6dfb5d184d909cebda9d2913ac0dac78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_93d8bb3ff1ba3f3759a85c0c6823c44b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Lancia Ypsilon 1.3 JTD Gold',
'transmission': 'manual',
'trim': 'Gold',
'year': 2015}
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX14349%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Saving data for LX14349: {'created_time': 1774699320.532617, 'last_price_update_time': 1774699320.532633, 'auction_closing_time': 1774884044.0}
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LX14349') HTTP/1.1" 204 0
2026-03-28 12:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F69%252F3b6971a99bf762ae5cb9a64f3ed7ac11%252Fpa%252FRU00933_aa0799afb1fb6cb085c4fe1632b9d046.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_aa0799afb1fb6cb085c4fe1632b9d046.jpg not downloaded yet
2026-03-28 12:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB86450> (referer: https://www.auto1.com/v1/car-details-view/XB86450/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ08821> (referer: https://www.auto1.com/v1/car-details-view/TZ08821/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:00 [auto1.it] INFO: Channel: 24h | Page: 11 | totalHits: 3672 | hits on page: 40
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F69%252F3b6971a99bf762ae5cb9a64f3ed7ac11%252Fpa%252FRU00933_06e116f274ed17d82f596a2f3610633f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_06e116f274ed17d82f596a2f3610633f.jpg not downloaded yet
2026-03-28 12:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: LB25951
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: MJ44765
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ44765%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Scrape type for MJ44765: 0
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: TM47514
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: PB29949
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB29949%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Scrape type for PB29949: 0
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: CE18152
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE18152%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Scrape type for CE18152: 0
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: ER01593
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: PN94289
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN94289%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Scrape type for PN94289: 0
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: YY00281
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: UR28230
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: YE38738
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: AT20318
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT20318%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Scrape type for AT20318: 0
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: RG08819
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG08819%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Scrape type for RG08819: 0
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: KZ05620
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ05620%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Scrape type for KZ05620: 0
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: FC17087
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC17087%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Scrape type for FC17087: 0
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: CD48597
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: ML74945
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML74945%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Scrape type for ML74945: 0
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: SD37804
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD37804%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Scrape type for SD37804: 0
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: LR48777
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR48777%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Scrape type for LR48777: 0
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: GU75904
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU75904%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Scrape type for GU75904: 0
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: WK43313
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: BK04078
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: XY04064
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: ML03059
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML03059%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Scrape type for ML03059: 0
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: CX68845
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX68845%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Scrape type for CX68845: 0
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: XY56734
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY56734%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Scrape type for XY56734: 0
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: RG91775
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG91775%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Scrape type for RG91775: 0
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: MV49803
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV49803%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.it] INFO: Scrape type for MV49803: 0
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: SL86512
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: EE91281
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: DC62247
2026-03-28 12:02:00 [auto1.it] INFO: Found listing with ID: XR42745
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR42745%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [auto1.it] INFO: Scrape type for XR42745: 0
2026-03-28 12:02:01 [auto1.it] INFO: Found listing with ID: MF61265
2026-03-28 12:02:01 [auto1.it] INFO: Found listing with ID: UW72001
2026-03-28 12:02:01 [auto1.it] INFO: Found listing with ID: DS35304
2026-03-28 12:02:01 [auto1.it] INFO: Found listing with ID: VZ70094
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ70094%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [auto1.it] INFO: Scrape type for VZ70094: 0
2026-03-28 12:02:01 [auto1.it] INFO: Found listing with ID: CH35422
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH35422%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [auto1.it] INFO: Scrape type for CH35422: 0
2026-03-28 12:02:01 [auto1.it] INFO: Found listing with ID: PK48399
2026-03-28 12:02:01 [auto1.it] INFO: Found listing with ID: CG66796
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG66796%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [auto1.it] INFO: Scrape type for CG66796: 0
2026-03-28 12:02:01 [auto1.it] INFO: Found listing with ID: SH43932
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH43932%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [auto1.it] INFO: Scrape type for SH43932: 0
2026-03-28 12:02:01 [auto1.it] INFO: Found listing with ID: BG88310
2026-03-28 12:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F69%252F3b6971a99bf762ae5cb9a64f3ed7ac11%252Fpa%252FRU00933_edc9bb15db9a5176172cecb62a177c77.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_edc9bb15db9a5176172cecb62a177c77.jpg not downloaded yet
2026-03-28 12:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_d4c8a79adc64fb7eec7ffeb87b3bf06e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_03ddbecad3d901b42faffaa807618151.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_aab33d3f08ec5f7b9290facf6b99df37.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_46d2d1c28892ecddcbe96b679181cd0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F69%252F3b6971a99bf762ae5cb9a64f3ed7ac11%252Fpa%252FRU00933_613efe002c92c73c5e10c9867018db3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_613efe002c92c73c5e10c9867018db3f.jpg not downloaded yet
2026-03-28 12:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fe732c4-902a-53c4-ac9c-283a05255070 with identifier: XB86450
2026-03-28 12:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fe732c4-902a-53c4-ac9c-283a05255070 with scrape type 1
2026-03-28 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8fe732c4-902a-53c4-ac9c-283a05255070
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdd%252F09dd61a26e087bae8edc0b719d61eb4c%252Fpa%252FXB86450_fcc9bb719a7867d71c1a90dcc003b4c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_fcc9bb719a7867d71c1a90dcc003b4c4.jpg already downloaded
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdd%252F09dd61a26e087bae8edc0b719d61eb4c%252Fpa%252FXB86450_4b414a85506c946dceb124df1a763efb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_4b414a85506c946dceb124df1a763efb.jpg already downloaded
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdd%252F09dd61a26e087bae8edc0b719d61eb4c%252Fpa%252FXB86450_2d905d7dd441a856b61848eb3cd6df04.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_2d905d7dd441a856b61848eb3cd6df04.jpg already downloaded
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdd%252F09dd61a26e087bae8edc0b719d61eb4c%252Fpa%252FXB86450_d98b30ffd189dec2944d8d3413f1af1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_d98b30ffd189dec2944d8d3413f1af1b.jpg already downloaded
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdd%252F09dd61a26e087bae8edc0b719d61eb4c%252Fpa%252FXB86450_dcaf402f847cac723cec80fc5a42eb53.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_dcaf402f847cac723cec80fc5a42eb53.jpg already downloaded
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdd%252F09dd61a26e087bae8edc0b719d61eb4c%252Fpa%252FXB86450_bc95d3ffadf035d40d2476be01b079a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_bc95d3ffadf035d40d2476be01b079a9.jpg already downloaded
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdd%252F09dd61a26e087bae8edc0b719d61eb4c%252Fpa%252FXB86450_4e660a313547f37fb631966e599fc665.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_4e660a313547f37fb631966e599fc665.jpg already downloaded
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdd%252F09dd61a26e087bae8edc0b719d61eb4c%252Fpa%252FXB86450_62303e4a93860c18f8ffe52f7c11ea90.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_62303e4a93860c18f8ffe52f7c11ea90.jpg already downloaded
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdd%252F09dd61a26e087bae8edc0b719d61eb4c%252Fpa%252FXB86450_1b1065b98759813d348a614f9cf22602.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_1b1065b98759813d348a614f9cf22602.jpg already downloaded
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdd%252F09dd61a26e087bae8edc0b719d61eb4c%252Fpa%252FXB86450_e6b610f405ba8d6e4575962a30202e1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_e6b610f405ba8d6e4575962a30202e1a.jpg already downloaded
2026-03-28 12:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8fe732c4-902a-53c4-ac9c-283a05255070, identifier: XB86450
2026-03-28 12:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bd0916d-3e3b-5524-ab89-7341693c9a1c with identifier: TZ08821
2026-03-28 12:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bd0916d-3e3b-5524-ab89-7341693c9a1c with scrape type 1
2026-03-28 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bd0916d-3e3b-5524-ab89-7341693c9a1c
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_57681ef51c5aef80c6dcd8a687152361.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_57681ef51c5aef80c6dcd8a687152361.jpg not downloaded yet
2026-03-28 12:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8fe732c4-902a-53c4-ac9c-283a05255070 with identifier: XB86450
2026-03-28 12:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8fe732c4-902a-53c4-ac9c-283a05255070 with identifier: XB86450
2026-03-28 12:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8fe732c4-902a-53c4-ac9c-283a05255070 with identifier: XB86450 to the API
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XB86450>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:01:34Z',
'fuel_type': 'petrol',
'id': '8fe732c4-902a-53c4-ac9c-283a05255070',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB86450',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 89649,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_fcc9bb719a7867d71c1a90dcc003b4c4.jpg',
'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_4b414a85506c946dceb124df1a763efb.jpg',
'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_2d905d7dd441a856b61848eb3cd6df04.jpg',
'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_d98b30ffd189dec2944d8d3413f1af1b.jpg',
'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_dcaf402f847cac723cec80fc5a42eb53.jpg',
'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_bc95d3ffadf035d40d2476be01b079a9.jpg',
'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_4e660a313547f37fb631966e599fc665.jpg',
'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_62303e4a93860c18f8ffe52f7c11ea90.jpg',
'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_1b1065b98759813d348a614f9cf22602.jpg',
'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_e6b610f405ba8d6e4575962a30202e1a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe732c4-902a-53c4-ac9c-283a05255070/8fe732c4-902a-53c4-ac9c-283a05255070_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70333,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_fcc9bb719a7867d71c1a90dcc003b4c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe732c4-902a-53c4-ac9c-283a05255070/8fe732c4-902a-53c4-ac9c-283a05255070_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64624,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_4b414a85506c946dceb124df1a763efb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe732c4-902a-53c4-ac9c-283a05255070/8fe732c4-902a-53c4-ac9c-283a05255070_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69051,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_2d905d7dd441a856b61848eb3cd6df04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe732c4-902a-53c4-ac9c-283a05255070/8fe732c4-902a-53c4-ac9c-283a05255070_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_d98b30ffd189dec2944d8d3413f1af1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe732c4-902a-53c4-ac9c-283a05255070/8fe732c4-902a-53c4-ac9c-283a05255070_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_dcaf402f847cac723cec80fc5a42eb53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe732c4-902a-53c4-ac9c-283a05255070/8fe732c4-902a-53c4-ac9c-283a05255070_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2578608,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_bc95d3ffadf035d40d2476be01b079a9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe732c4-902a-53c4-ac9c-283a05255070/8fe732c4-902a-53c4-ac9c-283a05255070_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74413,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_4e660a313547f37fb631966e599fc665.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe732c4-902a-53c4-ac9c-283a05255070/8fe732c4-902a-53c4-ac9c-283a05255070_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_62303e4a93860c18f8ffe52f7c11ea90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe732c4-902a-53c4-ac9c-283a05255070/8fe732c4-902a-53c4-ac9c-283a05255070_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_1b1065b98759813d348a614f9cf22602.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe732c4-902a-53c4-ac9c-283a05255070/8fe732c4-902a-53c4-ac9c-283a05255070_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69049,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/dd/09dd61a26e087bae8edc0b719d61eb4c/pa/XB86450_e6b610f405ba8d6e4575962a30202e1a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-05-24',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.4 FSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2012}
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB86450%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [auto1.it] INFO: Saving data for XB86450: {'created_time': 1774699321.78563, 'last_price_update_time': 1774699321.78564, 'auction_closing_time': 1774882894.0}
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XB86450') HTTP/1.1" 204 0
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_2dab6f9ec036c48eb43464ab33c97d2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_2dab6f9ec036c48eb43464ab33c97d2a.jpg not downloaded yet
2026-03-28 12:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_aa0799afb1fb6cb085c4fe1632b9d046.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6632d0>
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_d4c8a79adc64fb7eec7ffeb87b3bf06e.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_d4c8a79adc64fb7eec7ffeb87b3bf06e.jpg saved to cache
2026-03-28 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d713010>
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_03ddbecad3d901b42faffaa807618151.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_03ddbecad3d901b42faffaa807618151.jpg saved to cache
2026-03-28 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4eba90>
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a215c5-ced0-5710-902b-4d1eb099193f/d0a215c5-ced0-5710-902b-4d1eb099193f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F53%252F0e53db5ea8bec8342189676a4163729d%252Fpa%252FYY84618_aab33d3f08ec5f7b9290facf6b99df37.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_aab33d3f08ec5f7b9290facf6b99df37.jpg saved to cache
2026-03-28 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0a215c5-ced0-5710-902b-4d1eb099193f
2026-03-28 12:02:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0a215c5-ced0-5710-902b-4d1eb099193f, skipping ID generation
2026-03-28 12:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0a215c5-ced0-5710-902b-4d1eb099193f with scrape type 1
2026-03-28 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0a215c5-ced0-5710-902b-4d1eb099193f sending to next pipeline
2026-03-28 12:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d0a215c5-ced0-5710-902b-4d1eb099193f, identifier: YY84618
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d425ed0>
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_46d2d1c28892ecddcbe96b679181cd0b.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_46d2d1c28892ecddcbe96b679181cd0b.jpg saved to cache
2026-03-28 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f41dd270-0b52-51c5-8e19-140d8dbc8234
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_ab640622305ec6d84d5d5538b7fe6a5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_ab640622305ec6d84d5d5538b7fe6a5e.jpg not downloaded yet
2026-03-28 12:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d0a215c5-ced0-5710-902b-4d1eb099193f with identifier: YY84618
2026-03-28 12:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d0a215c5-ced0-5710-902b-4d1eb099193f with identifier: YY84618
2026-03-28 12:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d0a215c5-ced0-5710-902b-4d1eb099193f with identifier: YY84618 to the API
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_aab33d3f08ec5f7b9290facf6b99df37.jpg>
{'auction_title': '',
'c_o_2_emission_value': 221,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 3',
'engine': '2.8L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:41:45Z',
'fuel_type': 'diesel',
'id': 'd0a215c5-ced0-5710-902b-4d1eb099193f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY84618',
'listing': 'auction',
'location': 'IT, Verona',
'make': 'Chrysler',
'model': 'Voyager',
'odometer': 147919,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a215c5-ced0-5710-902b-4d1eb099193f/d0a215c5-ced0-5710-902b-4d1eb099193f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_aab33d3f08ec5f7b9290facf6b99df37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a215c5-ced0-5710-902b-4d1eb099193f/d0a215c5-ced0-5710-902b-4d1eb099193f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75189,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_614f37b0532ec6c81977b2a1eccfac0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a215c5-ced0-5710-902b-4d1eb099193f/d0a215c5-ced0-5710-902b-4d1eb099193f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74557,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_667681f371a6318d73265248c926a919.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a215c5-ced0-5710-902b-4d1eb099193f/d0a215c5-ced0-5710-902b-4d1eb099193f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65347,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_bd1d6f0ca6960b0103d7f1f6e778a547.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a215c5-ced0-5710-902b-4d1eb099193f/d0a215c5-ced0-5710-902b-4d1eb099193f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46564,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/53/0e53db5ea8bec8342189676a4163729d/pa/YY84618_c994ee98cd5d7e1e033a0658127ca52b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-09-26',
'seats_number': 7,
'seller_name': None,
'title': 'Chrysler Voyager 2.8 CRD LX',
'transmission': 'automatic',
'trim': 'LX',
'year': 2006}
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY84618%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.it] INFO: Saving data for YY84618: {'created_time': 1774699322.769402, 'last_price_update_time': 1774699322.769413, 'auction_closing_time': 1774885305.0}
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YY84618') HTTP/1.1" 204 0
2026-03-28 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_e48b781e87323cad6f5dea56529f12c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_df0a8fa263cc668aec7d47d0ca084bb6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_edc9bb15db9a5176172cecb62a177c77.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_06e116f274ed17d82f596a2f3610633f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_f3c96f0e870edb6e05856a749e931d1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_f3c96f0e870edb6e05856a749e931d1e.jpg not downloaded yet
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5e87d0>
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baaecc36-e42f-5e98-bd91-2854358e8859/baaecc36-e42f-5e98-bd91-2854358e8859_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F69%252F3b6971a99bf762ae5cb9a64f3ed7ac11%252Fpa%252FRU00933_aa0799afb1fb6cb085c4fe1632b9d046.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_aa0799afb1fb6cb085c4fe1632b9d046.jpg saved to cache
2026-03-28 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item baaecc36-e42f-5e98-bd91-2854358e8859
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_2f4aa6889bf5cfaae0b6b29b787f2ba8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_2f4aa6889bf5cfaae0b6b29b787f2ba8.jpg not downloaded yet
2026-03-28 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_57681ef51c5aef80c6dcd8a687152361.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_00947b8ec7a9c43709205f20abac4da1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_00947b8ec7a9c43709205f20abac4da1.jpg not downloaded yet
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_19ac8bc069d3fdbf1c24071d554899b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_19ac8bc069d3fdbf1c24071d554899b8.jpg not downloaded yet
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6ca4d0>
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_e48b781e87323cad6f5dea56529f12c4.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_e48b781e87323cad6f5dea56529f12c4.jpg saved to cache
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f41dd270-0b52-51c5-8e19-140d8dbc8234
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d55ed50>
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baaecc36-e42f-5e98-bd91-2854358e8859/baaecc36-e42f-5e98-bd91-2854358e8859_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F69%252F3b6971a99bf762ae5cb9a64f3ed7ac11%252Fpa%252FRU00933_df0a8fa263cc668aec7d47d0ca084bb6.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_df0a8fa263cc668aec7d47d0ca084bb6.jpg saved to cache
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item baaecc36-e42f-5e98-bd91-2854358e8859
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c843a50>
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baaecc36-e42f-5e98-bd91-2854358e8859/baaecc36-e42f-5e98-bd91-2854358e8859_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F69%252F3b6971a99bf762ae5cb9a64f3ed7ac11%252Fpa%252FRU00933_edc9bb15db9a5176172cecb62a177c77.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_edc9bb15db9a5176172cecb62a177c77.jpg saved to cache
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item baaecc36-e42f-5e98-bd91-2854358e8859
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d451450>
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baaecc36-e42f-5e98-bd91-2854358e8859/baaecc36-e42f-5e98-bd91-2854358e8859_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F69%252F3b6971a99bf762ae5cb9a64f3ed7ac11%252Fpa%252FRU00933_06e116f274ed17d82f596a2f3610633f.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_06e116f274ed17d82f596a2f3610633f.jpg saved to cache
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item baaecc36-e42f-5e98-bd91-2854358e8859
2026-03-28 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_2dab6f9ec036c48eb43464ab33c97d2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_835839f2a3a8ec826d5053689439e6ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_613efe002c92c73c5e10c9867018db3f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_f100e94920561b5e6facf1013fd7b6f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_f100e94920561b5e6facf1013fd7b6f9.jpg not downloaded yet
2026-03-28 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_ab640622305ec6d84d5d5538b7fe6a5e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_f3c96f0e870edb6e05856a749e931d1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_763700ad6ab8779065f53cce85fb57ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_763700ad6ab8779065f53cce85fb57ff.jpg not downloaded yet
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c840bd0>
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_57681ef51c5aef80c6dcd8a687152361.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_57681ef51c5aef80c6dcd8a687152361.jpg saved to cache
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bd0916d-3e3b-5524-ab89-7341693c9a1c
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_7f51f2d3a624829af48abf572a810018.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_7f51f2d3a624829af48abf572a810018.jpg not downloaded yet
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca46cd0>
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_2dab6f9ec036c48eb43464ab33c97d2a.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_2dab6f9ec036c48eb43464ab33c97d2a.jpg saved to cache
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7bd0916d-3e3b-5524-ab89-7341693c9a1c
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca46650>
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_835839f2a3a8ec826d5053689439e6ef.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_835839f2a3a8ec826d5053689439e6ef.jpg saved to cache
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7a4210>
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baaecc36-e42f-5e98-bd91-2854358e8859/baaecc36-e42f-5e98-bd91-2854358e8859_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F69%252F3b6971a99bf762ae5cb9a64f3ed7ac11%252Fpa%252FRU00933_613efe002c92c73c5e10c9867018db3f.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_613efe002c92c73c5e10c9867018db3f.jpg saved to cache
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item baaecc36-e42f-5e98-bd91-2854358e8859
2026-03-28 12:02:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: baaecc36-e42f-5e98-bd91-2854358e8859, skipping ID generation
2026-03-28 12:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baaecc36-e42f-5e98-bd91-2854358e8859 with scrape type 1
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item baaecc36-e42f-5e98-bd91-2854358e8859 sending to next pipeline
2026-03-28 12:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: baaecc36-e42f-5e98-bd91-2854358e8859, identifier: RU00933
2026-03-28 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_3053eca6929ea710584b2414b1e70c9a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: baaecc36-e42f-5e98-bd91-2854358e8859 with identifier: RU00933
2026-03-28 12:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: baaecc36-e42f-5e98-bd91-2854358e8859 with identifier: RU00933
2026-03-28 12:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: baaecc36-e42f-5e98-bd91-2854358e8859 with identifier: RU00933 to the API
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_613efe002c92c73c5e10c9867018db3f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.3L',
'engine_horse_power': 83,
'expiration_date': '2026-03-30T15:25:20Z',
'fuel_type': 'petrol',
'id': 'baaecc36-e42f-5e98-bd91-2854358e8859',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU00933',
'listing': 'auction',
'location': 'IT, Asti',
'make': 'Honda',
'model': 'Jazz',
'odometer': 110365,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baaecc36-e42f-5e98-bd91-2854358e8859/baaecc36-e42f-5e98-bd91-2854358e8859_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_df0a8fa263cc668aec7d47d0ca084bb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baaecc36-e42f-5e98-bd91-2854358e8859/baaecc36-e42f-5e98-bd91-2854358e8859_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76114,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_aa0799afb1fb6cb085c4fe1632b9d046.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baaecc36-e42f-5e98-bd91-2854358e8859/baaecc36-e42f-5e98-bd91-2854358e8859_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_06e116f274ed17d82f596a2f3610633f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baaecc36-e42f-5e98-bd91-2854358e8859/baaecc36-e42f-5e98-bd91-2854358e8859_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_edc9bb15db9a5176172cecb62a177c77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baaecc36-e42f-5e98-bd91-2854358e8859/baaecc36-e42f-5e98-bd91-2854358e8859_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58337,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/69/3b6971a99bf762ae5cb9a64f3ed7ac11/pa/RU00933_613efe002c92c73c5e10c9867018db3f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Jazz 1.4 DSi ES',
'transmission': 'manual',
'trim': 'ES',
'year': 2006}
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU00933%27 HTTP/1.1" 200 None
2026-03-28 12:02:03 [auto1.it] INFO: Saving data for RU00933: {'created_time': 1774699323.971637, 'last_price_update_time': 1774699323.971647, 'auction_closing_time': 1774884320.0}
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RU00933') HTTP/1.1" 204 0
2026-03-28 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_f2c845b6c55e8a59307b5cb3be8f7330.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_48621d42b9312968088fb85597e81e2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_9931dc970f495139a34b84a7857eb5c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_00947b8ec7a9c43709205f20abac4da1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_2f4aa6889bf5cfaae0b6b29b787f2ba8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD35651/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL38609/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb71b10>
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_ab640622305ec6d84d5d5538b7fe6a5e.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_ab640622305ec6d84d5d5538b7fe6a5e.jpg saved to cache
2026-03-28 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7bd0916d-3e3b-5524-ab89-7341693c9a1c
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d612290>
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_f3c96f0e870edb6e05856a749e931d1e.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_f3c96f0e870edb6e05856a749e931d1e.jpg saved to cache
2026-03-28 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7bd0916d-3e3b-5524-ab89-7341693c9a1c
2026-03-28 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MT10040/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JX99167> (referer: https://www.auto1.com/v1/car-details-view/JX99167/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KG93031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LL57465/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE88474/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c97b590>
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fa9%252Fcca967f33b70cc3124f007a096f86a5d%252Fpa%252FFJ00600_3053eca6929ea710584b2414b1e70c9a.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_3053eca6929ea710584b2414b1e70c9a.jpg saved to cache
2026-03-28 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2743f585-7051-5b70-af74-c89fd1e915e4
2026-03-28 12:02:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2743f585-7051-5b70-af74-c89fd1e915e4, skipping ID generation
2026-03-28 12:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2743f585-7051-5b70-af74-c89fd1e915e4 with scrape type 1
2026-03-28 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2743f585-7051-5b70-af74-c89fd1e915e4 sending to next pipeline
2026-03-28 12:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2743f585-7051-5b70-af74-c89fd1e915e4, identifier: FJ00600
2026-03-28 12:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2743f585-7051-5b70-af74-c89fd1e915e4 with identifier: FJ00600
2026-03-28 12:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2743f585-7051-5b70-af74-c89fd1e915e4 with identifier: FJ00600
2026-03-28 12:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2743f585-7051-5b70-af74-c89fd1e915e4 with identifier: FJ00600 to the API
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_3053eca6929ea710584b2414b1e70c9a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:43:10Z',
'fuel_type': 'diesel',
'id': '2743f585-7051-5b70-af74-c89fd1e915e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ00600',
'listing': 'auction',
'location': 'IT, Genova',
'make': 'BMW',
'model': '1er',
'odometer': 198935,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2466305,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_3053eca6929ea710584b2414b1e70c9a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80568,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_d9a108d17a61343fdc1a352a4a2f0739.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_a55570bbff05c30dd7f9e1dc7d4935dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2718849,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_635690328de0f9ef54811f3f1a11d3d6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_5b73730f8520bd67c67507dc804f75b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_e2474454c1b57074f31775a8f79721c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_160397f8f815733c082095f7df0ead29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85201,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_df94767585ae8e949f1d77ce6b87281a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2592738,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_96f69fb0b7eacfde644cf14f822f75fa.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2743f585-7051-5b70-af74-c89fd1e915e4/2743f585-7051-5b70-af74-c89fd1e915e4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2667159,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/a9/cca967f33b70cc3124f007a096f86a5d/pa/FJ00600_9ff227b770e0477dffb544ecd6655991.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 120d xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2017}
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ00600%27 HTTP/1.1" 200 None
2026-03-28 12:02:04 [auto1.it] INFO: Saving data for FJ00600: {'created_time': 1774699324.897134, 'last_price_update_time': 1774699324.897146, 'auction_closing_time': 1774885390.0}
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FJ00600') HTTP/1.1" 204 0
2026-03-28 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_763700ad6ab8779065f53cce85fb57ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d705090>
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_f2c845b6c55e8a59307b5cb3be8f7330.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_f2c845b6c55e8a59307b5cb3be8f7330.jpg saved to cache
2026-03-28 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2
2026-03-28 12:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb72890>
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F5e%252F885eee18176bf3f4c46b5cf356d838b4%252Fpa%252FNL74097_48621d42b9312968088fb85597e81e2d.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_48621d42b9312968088fb85597e81e2d.jpg saved to cache
2026-03-28 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3125444b-ce32-5f23-a0cd-ca40b478b4d4
2026-03-28 12:02:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3125444b-ce32-5f23-a0cd-ca40b478b4d4, skipping ID generation
2026-03-28 12:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3125444b-ce32-5f23-a0cd-ca40b478b4d4 with scrape type 1
2026-03-28 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3125444b-ce32-5f23-a0cd-ca40b478b4d4 sending to next pipeline
2026-03-28 12:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3125444b-ce32-5f23-a0cd-ca40b478b4d4, identifier: NL74097
2026-03-28 12:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4ec210>
2026-03-28 12:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_9931dc970f495139a34b84a7857eb5c5.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_9931dc970f495139a34b84a7857eb5c5.jpg saved to cache
2026-03-28 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f41dd270-0b52-51c5-8e19-140d8dbc8234
2026-03-28 12:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d425750>
2026-03-28 12:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_00947b8ec7a9c43709205f20abac4da1.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_00947b8ec7a9c43709205f20abac4da1.jpg saved to cache
2026-03-28 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7bd0916d-3e3b-5524-ab89-7341693c9a1c
2026-03-28 12:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5cf410>
2026-03-28 12:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_2f4aa6889bf5cfaae0b6b29b787f2ba8.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_2f4aa6889bf5cfaae0b6b29b787f2ba8.jpg saved to cache
2026-03-28 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7bd0916d-3e3b-5524-ab89-7341693c9a1c
2026-03-28 12:02:05 [auto1.it] INFO: Channel: 24h | Page: 12 | totalHits: 3673 | hits on page: 40
2026-03-28 12:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d08ab98c-1e1d-5d81-ae27-1757a6b71618 with identifier: JX99167
2026-03-28 12:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d08ab98c-1e1d-5d81-ae27-1757a6b71618 with scrape type 1
2026-03-28 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d08ab98c-1e1d-5d81-ae27-1757a6b71618
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F36%252F503633ceb03a870794aebe3c711b3673%252Fpa%252FJX99167_9ce156e44027594b5309b57157c9116f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_9ce156e44027594b5309b57157c9116f.jpg not downloaded yet
2026-03-28 12:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3125444b-ce32-5f23-a0cd-ca40b478b4d4 with identifier: NL74097
2026-03-28 12:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3125444b-ce32-5f23-a0cd-ca40b478b4d4 with identifier: NL74097
2026-03-28 12:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3125444b-ce32-5f23-a0cd-ca40b478b4d4 with identifier: NL74097 to the API
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_48621d42b9312968088fb85597e81e2d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:21:42Z',
'fuel_type': 'diesel',
'id': '3125444b-ce32-5f23-a0cd-ca40b478b4d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL74097',
'listing': 'auction',
'location': 'IT, Creazzo VI',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 103607,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2422839,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_e68334a72bdf2da5b976ee19e61636ce.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2440291,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_9446252852e8990f23ab169eb34f28eb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_b4eaf102bc4bb158efb5e1bb030ec729.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_83843ca7cef590fca7fcc79443d22a3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_2536c43093c27e8aa72504eda0b7b4c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2476166,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_2c299092bab7f3681771e1ac4bb07975.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2442010,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_7f644d0fe4ffee4fd9619bfd1e5871df.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_bb9ada8073f95c814c843c38a5d749c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2559412,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_48621d42b9312968088fb85597e81e2d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3125444b-ce32-5f23-a0cd-ca40b478b4d4/3125444b-ce32-5f23-a0cd-ca40b478b4d4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63287,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/5e/885eee18176bf3f4c46b5cf356d838b4/pa/NL74097_383bf4c91d9f57d8574a8fdaf6d9fd76.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-14',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ibiza 1.4 TDI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2016}
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL74097%27 HTTP/1.1" 200 None
2026-03-28 12:02:05 [auto1.it] INFO: Saving data for NL74097: {'created_time': 1774699325.739451, 'last_price_update_time': 1774699325.739463, 'auction_closing_time': 1774884102.0}
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NL74097') HTTP/1.1" 204 0
2026-03-28 12:02:05 [scrapy.extensions.logstats] INFO: Crawled 193 pages (at 96 pages/min), scraped 88 items (at 55 items/min)
2026-03-28 12:02:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-28 12:02:05 [auto1.it] INFO: Found listing with ID: BG88310
2026-03-28 12:02:05 [auto1.it] INFO: Found listing with ID: GC37992
2026-03-28 12:02:05 [auto1.it] INFO: Found listing with ID: VD70212
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VD70212%27 HTTP/1.1" 200 None
2026-03-28 12:02:05 [auto1.it] INFO: Scrape type for VD70212: 0
2026-03-28 12:02:05 [auto1.it] INFO: Found listing with ID: RW64625
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW64625%27 HTTP/1.1" 200 None
2026-03-28 12:02:05 [auto1.it] INFO: Scrape type for RW64625: 0
2026-03-28 12:02:05 [auto1.it] INFO: Found listing with ID: JF27717
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF27717%27 HTTP/1.1" 200 None
2026-03-28 12:02:05 [auto1.it] INFO: Scrape type for JF27717: 0
2026-03-28 12:02:05 [auto1.it] INFO: Found listing with ID: UM17769
2026-03-28 12:02:05 [auto1.it] INFO: Found listing with ID: CK01527
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK01527%27 HTTP/1.1" 200 None
2026-03-28 12:02:05 [auto1.it] INFO: Scrape type for CK01527: 0
2026-03-28 12:02:05 [auto1.it] INFO: Found listing with ID: BE55711
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE55711%27 HTTP/1.1" 200 None
2026-03-28 12:02:05 [auto1.it] INFO: Scrape type for BE55711: 0
2026-03-28 12:02:05 [auto1.it] INFO: Found listing with ID: DL42775
2026-03-28 12:02:05 [auto1.it] INFO: Found listing with ID: YG18213
2026-03-28 12:02:05 [auto1.it] INFO: Found listing with ID: KD20323
2026-03-28 12:02:05 [auto1.it] INFO: Found listing with ID: FY53013
2026-03-28 12:02:05 [auto1.it] INFO: Found listing with ID: LR95961
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR95961%27 HTTP/1.1" 200 None
2026-03-28 12:02:05 [auto1.it] INFO: Scrape type for LR95961: 0
2026-03-28 12:02:05 [auto1.it] INFO: Found listing with ID: XA66823
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XA66823%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Scrape type for XA66823: 0
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: CA11225
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: VG20766
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG20766%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Scrape type for VG20766: 0
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: ST39288
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST39288%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Scrape type for ST39288: 0
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: YF20115
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF20115%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Scrape type for YF20115: 0
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: LG27793
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: GT16338
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: NT95206
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT95206%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Scrape type for NT95206: 0
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: YD65292
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD65292%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Scrape type for YD65292: 0
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: FW75637
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW75637%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Scrape type for FW75637: 0
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: KR30691
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR30691%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Scrape type for KR30691: 0
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: YP66201
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP66201%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Scrape type for YP66201: 0
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: WV42889
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: BD88975
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: XS44510
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: ZA06304
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA06304%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Scrape type for ZA06304: 0
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: PB14031
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB14031%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Scrape type for PB14031: 0
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: GK30834
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK30834%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Scrape type for GK30834: 0
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: DF71809
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF71809%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Scrape type for DF71809: 0
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: LM41534
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: WV91656
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: ML96661
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML96661%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Scrape type for ML96661: 0
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: FU47372
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU47372%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Scrape type for FU47372: 0
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: CS14469
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: PE22085
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE22085%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Scrape type for PE22085: 2
2026-03-28 12:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74f82c50-8850-5df1-9cf8-74820c24cca6 with identifier: PE22085
2026-03-28 12:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74f82c50-8850-5df1-9cf8-74820c24cca6 with scrape type 2
2026-03-28 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74f82c50-8850-5df1-9cf8-74820c24cca6 with scrape type 2
2026-03-28 12:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 74f82c50-8850-5df1-9cf8-74820c24cca6, identifier: PE22085
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F36%252F503633ceb03a870794aebe3c711b3673%252Fpa%252FJX99167_fc43e35c66ca0e404cb1102a0574562e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_fc43e35c66ca0e404cb1102a0574562e.jpg not downloaded yet
2026-03-28 12:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 74f82c50-8850-5df1-9cf8-74820c24cca6 with identifier: PE22085
2026-03-28 12:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 74f82c50-8850-5df1-9cf8-74820c24cca6 with identifier: PE22085
2026-03-28 12:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 74f82c50-8850-5df1-9cf8-74820c24cca6 with identifier: PE22085 to the API
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:56:06Z',
'fuel_type': 'diesel',
'id': '74f82c50-8850-5df1-9cf8-74820c24cca6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE22085',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 83341,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-10',
'seller_name': None,
'title': 'Opel Mokka X 1.6 CDTI DPF Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2019}
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE22085%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Saving data for PE22085: {'auction_closing_time': 1774716966.0, 'created_time': 1774515650.85818, 'last_price_update_time': 1774699326.748275}
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PE22085') HTTP/1.1" 204 0
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: DW89993
2026-03-28 12:02:06 [auto1.it] INFO: Found listing with ID: LE38713
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE38713%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.it] INFO: Scrape type for LE38713: 0
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F36%252F503633ceb03a870794aebe3c711b3673%252Fpa%252FJX99167_5b66c76051511eb31cffe1646e802201.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_5b66c76051511eb31cffe1646e802201.jpg not downloaded yet
2026-03-28 12:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_035be6143fc1b815a5618079718bd250.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6fe610>
2026-03-28 12:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_763700ad6ab8779065f53cce85fb57ff.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_763700ad6ab8779065f53cce85fb57ff.jpg saved to cache
2026-03-28 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7bd0916d-3e3b-5524-ab89-7341693c9a1c
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F36%252F503633ceb03a870794aebe3c711b3673%252Fpa%252FJX99167_0b2d782a231c9e40a445357c1735a53e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_0b2d782a231c9e40a445357c1735a53e.jpg not downloaded yet
2026-03-28 12:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_9ce156e44027594b5309b57157c9116f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F36%252F503633ceb03a870794aebe3c711b3673%252Fpa%252FJX99167_a695355d8320fca2db0c20d4defe5b81.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_a695355d8320fca2db0c20d4defe5b81.jpg not downloaded yet
2026-03-28 12:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6bb990>
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_035be6143fc1b815a5618079718bd250.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_035be6143fc1b815a5618079718bd250.jpg saved to cache
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f41dd270-0b52-51c5-8e19-140d8dbc8234
2026-03-28 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_7a3a80cb36d1635b1cb7b4684c566633.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_91d69bf2cc1e06b7af281813069ea9c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_fc43e35c66ca0e404cb1102a0574562e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_f100e94920561b5e6facf1013fd7b6f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_5c51ef0c758dce9a70fc493392d50750.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d668890>
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d08ab98c-1e1d-5d81-ae27-1757a6b71618/d08ab98c-1e1d-5d81-ae27-1757a6b71618_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F36%252F503633ceb03a870794aebe3c711b3673%252Fpa%252FJX99167_9ce156e44027594b5309b57157c9116f.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_9ce156e44027594b5309b57157c9116f.jpg saved to cache
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d08ab98c-1e1d-5d81-ae27-1757a6b71618
2026-03-28 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_5b66c76051511eb31cffe1646e802201.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_19ac8bc069d3fdbf1c24071d554899b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_7f51f2d3a624829af48abf572a810018.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbedf10>
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_7a3a80cb36d1635b1cb7b4684c566633.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_7a3a80cb36d1635b1cb7b4684c566633.jpg saved to cache
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3c876ba-8c5c-5a96-b9ef-da114c2fbe33
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca66d50>
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F97%252Fce9775394d55717d3bed687b423fd95e%252Fpa%252FRD34551_91d69bf2cc1e06b7af281813069ea9c0.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_91d69bf2cc1e06b7af281813069ea9c0.jpg saved to cache
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2
2026-03-28 12:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2, skipping ID generation
2026-03-28 12:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2 with scrape type 1
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2 sending to next pipeline
2026-03-28 12:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2, identifier: RD34551
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f970e50>
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d08ab98c-1e1d-5d81-ae27-1757a6b71618/d08ab98c-1e1d-5d81-ae27-1757a6b71618_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F36%252F503633ceb03a870794aebe3c711b3673%252Fpa%252FJX99167_fc43e35c66ca0e404cb1102a0574562e.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_fc43e35c66ca0e404cb1102a0574562e.jpg saved to cache
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d08ab98c-1e1d-5d81-ae27-1757a6b71618
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f881650>
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_f100e94920561b5e6facf1013fd7b6f9.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_f100e94920561b5e6facf1013fd7b6f9.jpg saved to cache
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7bd0916d-3e3b-5524-ab89-7341693c9a1c
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d810350>
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F53%252F7a53629a39e73e109fcd59e3dfd534dc%252Fpa%252FYH77376_5c51ef0c758dce9a70fc493392d50750.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_5c51ef0c758dce9a70fc493392d50750.jpg saved to cache
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f41dd270-0b52-51c5-8e19-140d8dbc8234
2026-03-28 12:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f41dd270-0b52-51c5-8e19-140d8dbc8234, skipping ID generation
2026-03-28 12:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f41dd270-0b52-51c5-8e19-140d8dbc8234 with scrape type 1
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f41dd270-0b52-51c5-8e19-140d8dbc8234 sending to next pipeline
2026-03-28 12:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f41dd270-0b52-51c5-8e19-140d8dbc8234, identifier: YH77376
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f862950>
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d08ab98c-1e1d-5d81-ae27-1757a6b71618/d08ab98c-1e1d-5d81-ae27-1757a6b71618_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F36%252F503633ceb03a870794aebe3c711b3673%252Fpa%252FJX99167_5b66c76051511eb31cffe1646e802201.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_5b66c76051511eb31cffe1646e802201.jpg saved to cache
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d08ab98c-1e1d-5d81-ae27-1757a6b71618
2026-03-28 12:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca3fc90>
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_19ac8bc069d3fdbf1c24071d554899b8.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_19ac8bc069d3fdbf1c24071d554899b8.jpg saved to cache
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7bd0916d-3e3b-5524-ab89-7341693c9a1c
2026-03-28 12:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c9858d0>
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F52%252Fa3523b98ad8eff22ef1f8cc98e2b89e1%252Fpa%252FTZ08821_7f51f2d3a624829af48abf572a810018.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_7f51f2d3a624829af48abf572a810018.jpg saved to cache
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7bd0916d-3e3b-5524-ab89-7341693c9a1c
2026-03-28 12:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7bd0916d-3e3b-5524-ab89-7341693c9a1c, skipping ID generation
2026-03-28 12:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bd0916d-3e3b-5524-ab89-7341693c9a1c with scrape type 1
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7bd0916d-3e3b-5524-ab89-7341693c9a1c sending to next pipeline
2026-03-28 12:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7bd0916d-3e3b-5524-ab89-7341693c9a1c, identifier: TZ08821
2026-03-28 12:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2 with identifier: RD34551
2026-03-28 12:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2 with identifier: RD34551
2026-03-28 12:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2 with identifier: RD34551 to the API
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_91d69bf2cc1e06b7af281813069ea9c0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 97,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:22:19Z',
'fuel_type': 'petrol',
'id': '6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD34551',
'listing': 'auction',
'location': 'IT, Parma',
'make': 'Citroen',
'model': 'C1',
'odometer': 108228,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2251888,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_c82c65bc88b712b57b79c693ff3e2429.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_91d69bf2cc1e06b7af281813069ea9c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61883,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_f2c845b6c55e8a59307b5cb3be8f7330.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49399,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_835839f2a3a8ec826d5053689439e6ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_03ddbecad3d901b42faffaa807618151.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62286,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_d4c8a79adc64fb7eec7ffeb87b3bf06e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53225,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_5274bdab40c9f83b300afc85b36d658b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2405107,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_53823fc20612aeae80d508b0fc31fdb4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58163,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_4520f4c632b5f9e533e1bc1b472f64bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2/6f0e45b1-5ca3-5fd8-96ed-98ed307bb6e2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2338702,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgce/97/ce9775394d55717d3bed687b423fd95e/pa/RD34551_72cf4f7eb48a7ce8fa21fffd246a331d.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-12-29',
'seats_number': 4,
'seller_name': None,
'title': 'Citroen C1 1.0 VTi Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2014}
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD34551%27 HTTP/1.1" 200 None
2026-03-28 12:02:08 [auto1.it] INFO: Saving data for RD34551: {'created_time': 1774699328.418637, 'last_price_update_time': 1774699328.418648, 'auction_closing_time': 1774884139.0}
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RD34551') HTTP/1.1" 204 0
2026-03-28 12:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f41dd270-0b52-51c5-8e19-140d8dbc8234 with identifier: YH77376
2026-03-28 12:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f41dd270-0b52-51c5-8e19-140d8dbc8234 with identifier: YH77376
2026-03-28 12:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f41dd270-0b52-51c5-8e19-140d8dbc8234 with identifier: YH77376 to the API
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_5c51ef0c758dce9a70fc493392d50750.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.0L',
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:55:23Z',
'fuel_type': 'petrol',
'id': 'f41dd270-0b52-51c5-8e19-140d8dbc8234',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH77376',
'listing': 'auction',
'location': 'IT, Legnano',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 62853,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2130860,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_4f0726d1ddb086b7ab8d34c4339963be.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_5c51ef0c758dce9a70fc493392d50750.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_9931dc970f495139a34b84a7857eb5c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_e48b781e87323cad6f5dea56529f12c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2386915,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_035be6143fc1b815a5618079718bd250.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_46d2d1c28892ecddcbe96b679181cd0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1934760,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_adf39278f00056b0b89174e8126414c8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_88eafe30120279ecf81b2bf76b206859.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70260,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_14f5e2700521da26e232fff5c0b164f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41dd270-0b52-51c5-8e19-140d8dbc8234/f41dd270-0b52-51c5-8e19-140d8dbc8234_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63467,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/53/7a53629a39e73e109fcd59e3dfd534dc/pa/YH77376_b99c82508d6aa2e1b82c91083c6d3929.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-23',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Kona 1.0 TGDI XPrime 2WD',
'transmission': 'manual',
'trim': 'XPrime 2WD',
'year': 2020}
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH77376%27 HTTP/1.1" 200 None
2026-03-28 12:02:08 [auto1.it] INFO: Saving data for YH77376: {'created_time': 1774699328.806981, 'last_price_update_time': 1774699328.806994, 'auction_closing_time': 1774886123.0}
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YH77376') HTTP/1.1" 204 0
2026-03-28 12:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7bd0916d-3e3b-5524-ab89-7341693c9a1c with identifier: TZ08821
2026-03-28 12:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7bd0916d-3e3b-5524-ab89-7341693c9a1c with identifier: TZ08821
2026-03-28 12:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7bd0916d-3e3b-5524-ab89-7341693c9a1c with identifier: TZ08821 to the API
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_7f51f2d3a624829af48abf572a810018.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:40:56Z',
'fuel_type': 'petrol',
'id': '7bd0916d-3e3b-5524-ab89-7341693c9a1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ08821',
'listing': 'auction',
'location': 'IT, Rozzano',
'make': 'Jeep',
'model': 'Avenger',
'odometer': 10946,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84063,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_57681ef51c5aef80c6dcd8a687152361.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82034,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_2dab6f9ec036c48eb43464ab33c97d2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_ab640622305ec6d84d5d5538b7fe6a5e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73383,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_f3c96f0e870edb6e05856a749e931d1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_2f4aa6889bf5cfaae0b6b29b787f2ba8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_00947b8ec7a9c43709205f20abac4da1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3049775,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_19ac8bc069d3fdbf1c24071d554899b8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_f100e94920561b5e6facf1013fd7b6f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_763700ad6ab8779065f53cce85fb57ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bd0916d-3e3b-5524-ab89-7341693c9a1c/7bd0916d-3e3b-5524-ab89-7341693c9a1c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3041484,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga3/52/a3523b98ad8eff22ef1f8cc98e2b89e1/pa/TZ08821_7f51f2d3a624829af48abf572a810018.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2025-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Avenger 1.2 T-GDI Longitude',
'transmission': 'manual',
'trim': 'Longitude',
'year': 2025}
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ08821%27 HTTP/1.1" 200 None
2026-03-28 12:02:09 [auto1.it] INFO: Saving data for TZ08821: {'created_time': 1774699329.271565, 'last_price_update_time': 1774699329.271575, 'auction_closing_time': 1774885256.0}
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TZ08821') HTTP/1.1" 204 0
2026-03-28 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_0b2d782a231c9e40a445357c1735a53e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_a695355d8320fca2db0c20d4defe5b81.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_28fe5570daa61a4fc3fc099e2e16c3ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KG93031> (referer: https://www.auto1.com/v1/car-details-view/KG93031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL38609> (referer: https://www.auto1.com/v1/car-details-view/FL38609/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE88474> (referer: https://www.auto1.com/v1/car-details-view/DE88474/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LL57465> (referer: https://www.auto1.com/v1/car-details-view/LL57465/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MT10040> (referer: https://www.auto1.com/v1/car-details-view/MT10040/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD35651> (referer: https://www.auto1.com/v1/car-details-view/SD35651/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_972945a1a35bd6d477c2569182469c9a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_1e338986092c590877153a308779bb8b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_4d138f41fab376dbdf349b8a8cdd67da.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5ce950>
2026-03-28 12:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d08ab98c-1e1d-5d81-ae27-1757a6b71618/d08ab98c-1e1d-5d81-ae27-1757a6b71618_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F36%252F503633ceb03a870794aebe3c711b3673%252Fpa%252FJX99167_0b2d782a231c9e40a445357c1735a53e.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_0b2d782a231c9e40a445357c1735a53e.jpg saved to cache
2026-03-28 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d08ab98c-1e1d-5d81-ae27-1757a6b71618
2026-03-28 12:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5cf350>
2026-03-28 12:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d08ab98c-1e1d-5d81-ae27-1757a6b71618/d08ab98c-1e1d-5d81-ae27-1757a6b71618_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F36%252F503633ceb03a870794aebe3c711b3673%252Fpa%252FJX99167_a695355d8320fca2db0c20d4defe5b81.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_a695355d8320fca2db0c20d4defe5b81.jpg saved to cache
2026-03-28 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d08ab98c-1e1d-5d81-ae27-1757a6b71618
2026-03-28 12:02:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d08ab98c-1e1d-5d81-ae27-1757a6b71618, skipping ID generation
2026-03-28 12:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d08ab98c-1e1d-5d81-ae27-1757a6b71618 with scrape type 1
2026-03-28 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d08ab98c-1e1d-5d81-ae27-1757a6b71618 sending to next pipeline
2026-03-28 12:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d08ab98c-1e1d-5d81-ae27-1757a6b71618, identifier: JX99167
2026-03-28 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_5aee640c06e93225a95695606ee9eaa2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_1d7047e2934fc693c809c2337e9f3ae8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d08ab98c-1e1d-5d81-ae27-1757a6b71618 with identifier: JX99167
2026-03-28 12:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d08ab98c-1e1d-5d81-ae27-1757a6b71618 with identifier: JX99167
2026-03-28 12:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d08ab98c-1e1d-5d81-ae27-1757a6b71618 with identifier: JX99167 to the API
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_a695355d8320fca2db0c20d4defe5b81.jpg>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': 'Rental',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:11:52Z',
'fuel_type': 'diesel',
'id': 'd08ab98c-1e1d-5d81-ae27-1757a6b71618',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX99167',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Peugeot',
'model': '308',
'odometer': 335283,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08ab98c-1e1d-5d81-ae27-1757a6b71618/d08ab98c-1e1d-5d81-ae27-1757a6b71618_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78359,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_9ce156e44027594b5309b57157c9116f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08ab98c-1e1d-5d81-ae27-1757a6b71618/d08ab98c-1e1d-5d81-ae27-1757a6b71618_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71197,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_fc43e35c66ca0e404cb1102a0574562e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08ab98c-1e1d-5d81-ae27-1757a6b71618/d08ab98c-1e1d-5d81-ae27-1757a6b71618_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_5b66c76051511eb31cffe1646e802201.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08ab98c-1e1d-5d81-ae27-1757a6b71618/d08ab98c-1e1d-5d81-ae27-1757a6b71618_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69707,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_0b2d782a231c9e40a445357c1735a53e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08ab98c-1e1d-5d81-ae27-1757a6b71618/d08ab98c-1e1d-5d81-ae27-1757a6b71618_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/36/503633ceb03a870794aebe3c711b3673/pa/JX99167_a695355d8320fca2db0c20d4defe5b81.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-05-22',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 e-HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX99167%27 HTTP/1.1" 200 None
2026-03-28 12:02:10 [auto1.it] INFO: Saving data for JX99167: {'created_time': 1774699330.035473, 'last_price_update_time': 1774699330.035484, 'auction_closing_time': 1774883512.0}
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JX99167') HTTP/1.1" 204 0
2026-03-28 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_f8867447e59e39b8556c96c39fcd7f08.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_7560b62e6bfd13d0577a620a492c6e22.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4f2310>
2026-03-28 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F9a%252F7e9a6961669f46e8aee65c5097964dfe%252Fpa%252FHA26837_28fe5570daa61a4fc3fc099e2e16c3ef.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_28fe5570daa61a4fc3fc099e2e16c3ef.jpg saved to cache
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3c876ba-8c5c-5a96-b9ef-da114c2fbe33
2026-03-28 12:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3c876ba-8c5c-5a96-b9ef-da114c2fbe33, skipping ID generation
2026-03-28 12:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3c876ba-8c5c-5a96-b9ef-da114c2fbe33 with scrape type 1
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3c876ba-8c5c-5a96-b9ef-da114c2fbe33 sending to next pipeline
2026-03-28 12:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c3c876ba-8c5c-5a96-b9ef-da114c2fbe33, identifier: HA26837
2026-03-28 12:02:10 [auto1.it] INFO: Channel: 24h | Page: 13 | totalHits: 3673 | hits on page: 40
2026-03-28 12:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60455cbd-6315-5d7c-97d4-cc62aac19e39 with identifier: KG93031
2026-03-28 12:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60455cbd-6315-5d7c-97d4-cc62aac19e39 with scrape type 1
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60455cbd-6315-5d7c-97d4-cc62aac19e39
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_4d5149e5c9e466c9dd2ce010b7d9d4ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_4d5149e5c9e466c9dd2ce010b7d9d4ad.jpg not downloaded yet
2026-03-28 12:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ec016fd-a92e-5957-bdef-45d1a6a8e0f2 with identifier: FL38609
2026-03-28 12:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ec016fd-a92e-5957-bdef-45d1a6a8e0f2 with scrape type 1
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4ec016fd-a92e-5957-bdef-45d1a6a8e0f2
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F6d%252Fbb6d410f780090841c993966edcef59d%252Fpa%252FFL38609_30154354976f8385f96f2782d7eb4fb2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_30154354976f8385f96f2782d7eb4fb2.jpg not downloaded yet
2026-03-28 12:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d62110e-0da7-5566-aeb5-7c154a8b350e with identifier: DE88474
2026-03-28 12:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d62110e-0da7-5566-aeb5-7c154a8b350e with scrape type 1
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0d62110e-0da7-5566-aeb5-7c154a8b350e
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fd2%252F5bd27d865c18b794faffd43f8e1e5a3a%252Fpa%252FDE88474_0b027540cc329855c5ad92655a292330.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/d2/5bd27d865c18b794faffd43f8e1e5a3a/pa/DE88474_0b027540cc329855c5ad92655a292330.jpg already downloaded
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fd2%252F5bd27d865c18b794faffd43f8e1e5a3a%252Fpa%252FDE88474_66ba6e0a1cdf746a4421b42e47be4e9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/d2/5bd27d865c18b794faffd43f8e1e5a3a/pa/DE88474_66ba6e0a1cdf746a4421b42e47be4e9a.jpg already downloaded
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fd2%252F5bd27d865c18b794faffd43f8e1e5a3a%252Fpa%252FDE88474_874b79e1d043fe1cf8e540680113a051.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/d2/5bd27d865c18b794faffd43f8e1e5a3a/pa/DE88474_874b79e1d043fe1cf8e540680113a051.jpg already downloaded
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fd2%252F5bd27d865c18b794faffd43f8e1e5a3a%252Fpa%252FDE88474_faf33c59c7aaa3eec7370e5d6ad9985d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/d2/5bd27d865c18b794faffd43f8e1e5a3a/pa/DE88474_faf33c59c7aaa3eec7370e5d6ad9985d.jpg already downloaded
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fd2%252F5bd27d865c18b794faffd43f8e1e5a3a%252Fpa%252FDE88474_0ca6b24be66125f3ecc1557d9de119eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/d2/5bd27d865c18b794faffd43f8e1e5a3a/pa/DE88474_0ca6b24be66125f3ecc1557d9de119eb.jpg already downloaded
2026-03-28 12:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0d62110e-0da7-5566-aeb5-7c154a8b350e, identifier: DE88474
2026-03-28 12:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fe96623-1551-5f21-968e-2c4fed2ce9e6 with identifier: LL57465
2026-03-28 12:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe96623-1551-5f21-968e-2c4fed2ce9e6 with scrape type 1
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1fe96623-1551-5f21-968e-2c4fed2ce9e6
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_246035588c5a17451220de45c4f532f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_246035588c5a17451220de45c4f532f1.jpg not downloaded yet
2026-03-28 12:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61a402c8-c884-5d52-9613-8b1344bce439 with identifier: MT10040
2026-03-28 12:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61a402c8-c884-5d52-9613-8b1344bce439 with scrape type 1
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61a402c8-c884-5d52-9613-8b1344bce439
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_112795b690ed6d72c2527e927aec9188.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_112795b690ed6d72c2527e927aec9188.jpg not downloaded yet
2026-03-28 12:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c with identifier: SD35651
2026-03-28 12:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c with scrape type 1
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_a9df63db6dad767d6262aaee631d326a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_a9df63db6dad767d6262aaee631d326a.jpg not downloaded yet
2026-03-28 12:02:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d520350>
2026-03-28 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_972945a1a35bd6d477c2569182469c9a.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_972945a1a35bd6d477c2569182469c9a.jpg saved to cache
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-03-28 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb73e90>
2026-03-28 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0/c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc8%252F5ec8ed96d2cedcc8210232a7b142ccf2%252Fpa%252FJR85955_1e338986092c590877153a308779bb8b.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_1e338986092c590877153a308779bb8b.jpg saved to cache
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0
2026-03-28 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7be4d0>
2026-03-28 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0/c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc8%252F5ec8ed96d2cedcc8210232a7b142ccf2%252Fpa%252FJR85955_4d138f41fab376dbdf349b8a8cdd67da.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_4d138f41fab376dbdf349b8a8cdd67da.jpg saved to cache
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0
2026-03-28 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_89a51aab0e0de5e54f7f053710d3986b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_c5e6501157e5ca54b3e9e63fc4b1e6c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_37d3ff74cc7ee5ad43e250150424e91e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c3c876ba-8c5c-5a96-b9ef-da114c2fbe33 with identifier: HA26837
2026-03-28 12:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c3c876ba-8c5c-5a96-b9ef-da114c2fbe33 with identifier: HA26837
2026-03-28 12:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c3c876ba-8c5c-5a96-b9ef-da114c2fbe33 with identifier: HA26837 to the API
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_28fe5570daa61a4fc3fc099e2e16c3ef.jpg>
{'auction_title': '',
'c_o_2_emission_value': 168,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:27:58Z',
'fuel_type': 'diesel',
'id': 'c3c876ba-8c5c-5a96-b9ef-da114c2fbe33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA26837',
'listing': 'auction',
'location': "IT, Gradisca d'Isonzo",
'make': 'Fiat',
'model': 'Scudo',
'odometer': 36786,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2085980,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_11a06101d0d8b82a14cd533e5e10c346.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_73ebbb776479748e514eeb8c0a8eff67.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_205db914472903375a1272d085c3035d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_28fe5570daa61a4fc3fc099e2e16c3ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_1035287b1f88d83fbcf0ef3d476b2468.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58040,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_4ce32c3b60f730701361e07b8acae8b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_7a3a80cb36d1635b1cb7b4684c566633.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 821037,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_390859eaca11c5c1b536422d8068b318.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_0618366d3016ad33965e48d930950379.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c876ba-8c5c-5a96-b9ef-da114c2fbe33/c3c876ba-8c5c-5a96-b9ef-da114c2fbe33_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90503,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/9a/7e9a6961669f46e8aee65c5097964dfe/pa/HA26837_1fd30cd7847fc50a5b34bf61e0a5eeea.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-09-20',
'seats_number': 3,
'seller_name': None,
'title': 'Fiat Scudo 1.5 M-Jet L1 Basis',
'transmission': 'manual',
'trim': 'L1 Basis',
'year': 2022}
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA26837%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Saving data for HA26837: {'created_time': 1774699331.081142, 'last_price_update_time': 1774699331.081156, 'auction_closing_time': 1774884478.0}
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HA26837') HTTP/1.1" 204 0
2026-03-28 12:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0d62110e-0da7-5566-aeb5-7c154a8b350e with identifier: DE88474
2026-03-28 12:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0d62110e-0da7-5566-aeb5-7c154a8b350e with identifier: DE88474
2026-03-28 12:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0d62110e-0da7-5566-aeb5-7c154a8b350e with identifier: DE88474 to the API
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DE88474>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:45:06Z',
'fuel_type': 'petrol',
'id': '0d62110e-0da7-5566-aeb5-7c154a8b350e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE88474',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Opel',
'model': 'Corsa',
'odometer': 150123,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/img5b/d2/5bd27d865c18b794faffd43f8e1e5a3a/pa/DE88474_0b027540cc329855c5ad92655a292330.jpg',
'https://img-pa.auto1.com/img5b/d2/5bd27d865c18b794faffd43f8e1e5a3a/pa/DE88474_66ba6e0a1cdf746a4421b42e47be4e9a.jpg',
'https://img-pa.auto1.com/img5b/d2/5bd27d865c18b794faffd43f8e1e5a3a/pa/DE88474_874b79e1d043fe1cf8e540680113a051.jpg',
'https://img-pa.auto1.com/img5b/d2/5bd27d865c18b794faffd43f8e1e5a3a/pa/DE88474_faf33c59c7aaa3eec7370e5d6ad9985d.jpg',
'https://img-pa.auto1.com/img5b/d2/5bd27d865c18b794faffd43f8e1e5a3a/pa/DE88474_0ca6b24be66125f3ecc1557d9de119eb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d62110e-0da7-5566-aeb5-7c154a8b350e/0d62110e-0da7-5566-aeb5-7c154a8b350e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/d2/5bd27d865c18b794faffd43f8e1e5a3a/pa/DE88474_0b027540cc329855c5ad92655a292330.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d62110e-0da7-5566-aeb5-7c154a8b350e/0d62110e-0da7-5566-aeb5-7c154a8b350e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85592,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/d2/5bd27d865c18b794faffd43f8e1e5a3a/pa/DE88474_66ba6e0a1cdf746a4421b42e47be4e9a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d62110e-0da7-5566-aeb5-7c154a8b350e/0d62110e-0da7-5566-aeb5-7c154a8b350e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78236,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/d2/5bd27d865c18b794faffd43f8e1e5a3a/pa/DE88474_874b79e1d043fe1cf8e540680113a051.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d62110e-0da7-5566-aeb5-7c154a8b350e/0d62110e-0da7-5566-aeb5-7c154a8b350e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/d2/5bd27d865c18b794faffd43f8e1e5a3a/pa/DE88474_faf33c59c7aaa3eec7370e5d6ad9985d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d62110e-0da7-5566-aeb5-7c154a8b350e/0d62110e-0da7-5566-aeb5-7c154a8b350e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/d2/5bd27d865c18b794faffd43f8e1e5a3a/pa/DE88474_0ca6b24be66125f3ecc1557d9de119eb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-10-23',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 Elective',
'transmission': 'manual',
'trim': 'Elective',
'year': 2011}
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE88474%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Saving data for DE88474: {'created_time': 1774699331.445626, 'last_price_update_time': 1774699331.445634, 'auction_closing_time': 1774885506.0}
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DE88474') HTTP/1.1" 204 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: VC63991
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC63991%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for VC63991: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: RC58822
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC58822%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for RC58822: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: TV19217
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV19217%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for TV19217: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: SE41207
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: XJ91749
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: KC88615
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC88615%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for KC88615: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: WH06276
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: MC37024
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC37024%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for MC37024: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: BG56608
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG56608%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for BG56608: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: MK89859
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: HK94664
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK94664%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for HK94664: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: EU22988
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU22988%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for EU22988: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: NC70942
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC70942%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for NC70942: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: EP92787
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP92787%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for EP92787: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: LY59830
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: DC45028
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: EZ48642
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: UZ24263
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ24263%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for UZ24263: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: GX06628
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX06628%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for GX06628: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: VE78842
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: NY14439
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: VS64028
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: VC44140
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: GM86126
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: UZ24825
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: AF82865
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: SP92634
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP92634%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for SP92634: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: TE63682
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE63682%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for TE63682: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: BM81624
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM81624%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for BM81624: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: NH43496
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: EA01754
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: FD12268
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD12268%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for FD12268: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: GA58857
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: XK51996
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK51996%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for XK51996: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: UN52705
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: HG71843
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: CE81369
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: XJ87155
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ87155%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for XJ87155: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: CE17965
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE17965%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for CE17965: 0
2026-03-28 12:02:11 [auto1.it] INFO: Found listing with ID: PJ77887
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PJ77887%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.it] INFO: Scrape type for PJ77887: 0
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_fc9448ab706e41114e51ae4b31d344b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_fc9448ab706e41114e51ae4b31d344b8.jpg not downloaded yet
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F6d%252Fbb6d410f780090841c993966edcef59d%252Fpa%252FFL38609_d5e202ed434d7ad0fd0ddabd9e746fe0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_d5e202ed434d7ad0fd0ddabd9e746fe0.jpg not downloaded yet
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_658be710b6af291a2add1b49d216a8b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_658be710b6af291a2add1b49d216a8b1.jpg not downloaded yet
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_95be450e2671e40ac3c13c9dde47b96c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_95be450e2671e40ac3c13c9dde47b96c.jpg not downloaded yet
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_9fda09efe4fc65edd243e6c01782bdc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_9fda09efe4fc65edd243e6c01782bdc1.jpg not downloaded yet
2026-03-28 12:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb72210>
2026-03-28 12:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b1e1282-05f1-5451-93d8-17195d2ca8b4/5b1e1282-05f1-5451-93d8-17195d2ca8b4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fc3%252F65c367b33624734b620c77d49458a0eb%252Fpa%252FVG07643_5aee640c06e93225a95695606ee9eaa2.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_5aee640c06e93225a95695606ee9eaa2.jpg saved to cache
2026-03-28 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b1e1282-05f1-5451-93d8-17195d2ca8b4
2026-03-28 12:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d52ca10>
2026-03-28 12:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_1d7047e2934fc693c809c2337e9f3ae8.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_1d7047e2934fc693c809c2337e9f3ae8.jpg saved to cache
2026-03-28 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d426ad0>
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5/ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb0%252Ff0b0559e70cddccec95a1e2795dba437%252Fpa%252FMC18601_f8867447e59e39b8556c96c39fcd7f08.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_f8867447e59e39b8556c96c39fcd7f08.jpg saved to cache
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3e469510>
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5/ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb0%252Ff0b0559e70cddccec95a1e2795dba437%252Fpa%252FMC18601_7560b62e6bfd13d0577a620a492c6e22.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_7560b62e6bfd13d0577a620a492c6e22.jpg saved to cache
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5
2026-03-28 12:02:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5, skipping ID generation
2026-03-28 12:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5 with scrape type 1
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5 sending to next pipeline
2026-03-28 12:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5, identifier: MC18601
2026-03-28 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_fa50a9f81e0e4df1bc430a309d665a38.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_b187e61c40954f102d75087b7abf6e9b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_7292c548c9e7a511baba7363bd8dcaf8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_e4fbad55a2f522f63c1915e1e647177b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_c8b75aa8b1be4fffc9db4c7fc91b3eeb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_c8b75aa8b1be4fffc9db4c7fc91b3eeb.jpg not downloaded yet
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F6d%252Fbb6d410f780090841c993966edcef59d%252Fpa%252FFL38609_d7cbdff11f2e802a95167b330e4cb46f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_d7cbdff11f2e802a95167b330e4cb46f.jpg not downloaded yet
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_f3f86d1ce01bdf81a56a35d75cf4b3ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_f3f86d1ce01bdf81a56a35d75cf4b3ae.jpg not downloaded yet
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_8b729c0da1bc3920cd75692275e6f162.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_8b729c0da1bc3920cd75692275e6f162.jpg not downloaded yet
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_bbaf36d1f0af093488e86e00be5af573.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_bbaf36d1f0af093488e86e00be5af573.jpg not downloaded yet
2026-03-28 12:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5 with identifier: MC18601
2026-03-28 12:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5 with identifier: MC18601
2026-03-28 12:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5 with identifier: MC18601 to the API
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_7560b62e6bfd13d0577a620a492c6e22.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': 'Rental',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:09:00Z',
'fuel_type': 'diesel',
'id': 'ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC18601',
'listing': 'auction',
'location': 'IT, Modugno',
'make': 'Lancia',
'model': 'Delta',
'odometer': 201378,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5/ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_ce5ad0a217e45e1271c981a061a59452.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5/ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_4eba8df7ccc713ea653c67247d31b61c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5/ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80789,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_7560b62e6bfd13d0577a620a492c6e22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5/ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77844,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_731caf622410693a7655423a3754a848.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5/ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_f8867447e59e39b8556c96c39fcd7f08.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5/ef4f3b6e-e658-58a0-82c9-16b7d99d5bd5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66910,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/b0/f0b0559e70cddccec95a1e2795dba437/pa/MC18601_792ee207a2125b25fdc5c0680d525a95.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-02-16',
'seats_number': 5,
'seller_name': None,
'title': 'Lancia Delta 1.6 Diesel Silver',
'transmission': 'manual',
'trim': 'Silver',
'year': 2012}
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC18601%27 HTTP/1.1" 200 None
2026-03-28 12:02:12 [auto1.it] INFO: Saving data for MC18601: {'created_time': 1774699332.677175, 'last_price_update_time': 1774699332.677185, 'auction_closing_time': 1774883340.0}
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MC18601') HTTP/1.1" 204 0
2026-03-28 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_d86ffec2757efe712a4c2336cb2ac163.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_7b758fea3a2a0e2f6ce34032d75279db.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_caaf365940c3a25d47cd6e30d914c981.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4648d0>
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_89a51aab0e0de5e54f7f053710d3986b.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_89a51aab0e0de5e54f7f053710d3986b.jpg saved to cache
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7f7fd0>
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_c5e6501157e5ca54b3e9e63fc4b1e6c6.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_c5e6501157e5ca54b3e9e63fc4b1e6c6.jpg saved to cache
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d50c910>
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_37d3ff74cc7ee5ad43e250150424e91e.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_37d3ff74cc7ee5ad43e250150424e91e.jpg saved to cache
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_81d1ad98178867b2f136136c36572713.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_81d1ad98178867b2f136136c36572713.jpg not downloaded yet
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F6d%252Fbb6d410f780090841c993966edcef59d%252Fpa%252FFL38609_ded02fa83abda6c86e3ddc093aef56fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_ded02fa83abda6c86e3ddc093aef56fe.jpg not downloaded yet
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_e7228e5591c73e286334b78274bd0a4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_e7228e5591c73e286334b78274bd0a4c.jpg not downloaded yet
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_627e5fd97c2e29cc0018c6ed8d425ec6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_627e5fd97c2e29cc0018c6ed8d425ec6.jpg not downloaded yet
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_91c33dfdb584633d79dea2a44eeef5d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_91c33dfdb584633d79dea2a44eeef5d8.jpg not downloaded yet
2026-03-28 12:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR17462/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY41081/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EV59116/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL91397/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_091993a9309877d3947d7b5d67b41a71.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_06ac722b5982abac49e57f7ffdc694da.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_8e10e622d79f8a780ea575dfd6347448.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_8e10e622d79f8a780ea575dfd6347448.jpg not downloaded yet
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F6d%252Fbb6d410f780090841c993966edcef59d%252Fpa%252FFL38609_9749f3e1a79b52bde5075fe5c719e2f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_9749f3e1a79b52bde5075fe5c719e2f2.jpg not downloaded yet
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_878c21313b72ec762b9ffd29da4be4d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_878c21313b72ec762b9ffd29da4be4d6.jpg not downloaded yet
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_8feeb0de60c585ef2855b937f4d93d1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_8feeb0de60c585ef2855b937f4d93d1d.jpg not downloaded yet
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_a4c0658f6202ea94c8f4414009d7a9ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_a4c0658f6202ea94c8f4414009d7a9ca.jpg not downloaded yet
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb87ed0>
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1f7ff3-70a1-5783-b754-315a4f954457/6b1f7ff3-70a1-5783-b754-315a4f954457_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F26%252Fde266645155c607b63ae52b5b0a1d394%252Fpa%252FCN51839_fa50a9f81e0e4df1bc430a309d665a38.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_fa50a9f81e0e4df1bc430a309d665a38.jpg saved to cache
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b1f7ff3-70a1-5783-b754-315a4f954457
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca6ead0>
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0/c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc8%252F5ec8ed96d2cedcc8210232a7b142ccf2%252Fpa%252FJR85955_b187e61c40954f102d75087b7abf6e9b.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_b187e61c40954f102d75087b7abf6e9b.jpg saved to cache
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c92a810>
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b1e1282-05f1-5451-93d8-17195d2ca8b4/5b1e1282-05f1-5451-93d8-17195d2ca8b4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fc3%252F65c367b33624734b620c77d49458a0eb%252Fpa%252FVG07643_7292c548c9e7a511baba7363bd8dcaf8.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_7292c548c9e7a511baba7363bd8dcaf8.jpg saved to cache
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b1e1282-05f1-5451-93d8-17195d2ca8b4
2026-03-28 12:02:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b1e1282-05f1-5451-93d8-17195d2ca8b4, skipping ID generation
2026-03-28 12:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b1e1282-05f1-5451-93d8-17195d2ca8b4 with scrape type 1
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b1e1282-05f1-5451-93d8-17195d2ca8b4 sending to next pipeline
2026-03-28 12:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5b1e1282-05f1-5451-93d8-17195d2ca8b4, identifier: VG07643
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e4d21e410>
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_e4fbad55a2f522f63c1915e1e647177b.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_e4fbad55a2f522f63c1915e1e647177b.jpg saved to cache
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d554e50>
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8/7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F4f%252F0c4f29a933f307c3bf8779abd6245d6b%252Fpa%252FDE59865_d86ffec2757efe712a4c2336cb2ac163.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_d86ffec2757efe712a4c2336cb2ac163.jpg saved to cache
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d466290>
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe3%252F3ee39e4325c78e16aa50dee295acdaa1%252Fpa%252FLR68259_7b758fea3a2a0e2f6ce34032d75279db.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_7b758fea3a2a0e2f6ce34032d75279db.jpg saved to cache
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-03-28 12:02:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d6224d1-2a5b-5f43-a3e4-ff06578f698d, skipping ID generation
2026-03-28 12:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d with scrape type 1
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d sending to next pipeline
2026-03-28 12:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0d6224d1-2a5b-5f43-a3e4-ff06578f698d, identifier: LR68259
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4655d0>
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0/c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc8%252F5ec8ed96d2cedcc8210232a7b142ccf2%252Fpa%252FJR85955_caaf365940c3a25d47cd6e30d914c981.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_caaf365940c3a25d47cd6e30d914c981.jpg saved to cache
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0
2026-03-28 12:02:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0, skipping ID generation
2026-03-28 12:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0 with scrape type 1
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0 sending to next pipeline
2026-03-28 12:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0, identifier: JR85955
2026-03-28 12:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5b1e1282-05f1-5451-93d8-17195d2ca8b4 with identifier: VG07643
2026-03-28 12:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5b1e1282-05f1-5451-93d8-17195d2ca8b4 with identifier: VG07643
2026-03-28 12:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5b1e1282-05f1-5451-93d8-17195d2ca8b4 with identifier: VG07643 to the API
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_7292c548c9e7a511baba7363bd8dcaf8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 199,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.3L',
'engine_horse_power': 260,
'expiration_date': '2026-03-30T15:14:13Z',
'fuel_type': 'petrol',
'id': '5b1e1282-05f1-5451-93d8-17195d2ca8b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG07643',
'listing': 'auction',
'location': 'IT, Genova',
'make': 'Mazda',
'model': 'CX-7',
'odometer': 160561,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b1e1282-05f1-5451-93d8-17195d2ca8b4/5b1e1282-05f1-5451-93d8-17195d2ca8b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84782,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_775bcd3794bd28757a447c45b50c197b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b1e1282-05f1-5451-93d8-17195d2ca8b4/5b1e1282-05f1-5451-93d8-17195d2ca8b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_40585806d3c845c718e7a16db028027f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b1e1282-05f1-5451-93d8-17195d2ca8b4/5b1e1282-05f1-5451-93d8-17195d2ca8b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_7292c548c9e7a511baba7363bd8dcaf8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b1e1282-05f1-5451-93d8-17195d2ca8b4/5b1e1282-05f1-5451-93d8-17195d2ca8b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73246,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_5aee640c06e93225a95695606ee9eaa2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b1e1282-05f1-5451-93d8-17195d2ca8b4/5b1e1282-05f1-5451-93d8-17195d2ca8b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_6604600878dbbc9b598fc231f50b5bdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b1e1282-05f1-5451-93d8-17195d2ca8b4/5b1e1282-05f1-5451-93d8-17195d2ca8b4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img65/c3/65c367b33624734b620c77d49458a0eb/pa/VG07643_014d14e07076062989c6d4e1a2c9006f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-08-05',
'seats_number': 3,
'seller_name': None,
'title': 'Mazda CX-7 2.3 High-Line',
'transmission': 'manual',
'trim': 'High-Line',
'year': 2010}
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG07643%27 HTTP/1.1" 200 None
2026-03-28 12:02:14 [auto1.it] INFO: Saving data for VG07643: {'created_time': 1774699334.048594, 'last_price_update_time': 1774699334.048605, 'auction_closing_time': 1774883653.0}
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VG07643') HTTP/1.1" 204 0
2026-03-28 12:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0d6224d1-2a5b-5f43-a3e4-ff06578f698d with identifier: LR68259
2026-03-28 12:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0d6224d1-2a5b-5f43-a3e4-ff06578f698d with identifier: LR68259
2026-03-28 12:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0d6224d1-2a5b-5f43-a3e4-ff06578f698d with identifier: LR68259 to the API
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_7b758fea3a2a0e2f6ce34032d75279db.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 72,
'expiration_date': '2026-03-30T15:35:15Z',
'fuel_type': 'petrol',
'id': '0d6224d1-2a5b-5f43-a3e4-ff06578f698d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR68259',
'listing': 'auction',
'location': 'IT, Firenze',
'make': 'Toyota',
'model': 'Aygo X',
'odometer': 31275,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_523031ee1b7fb70beea74818887b27a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82552,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_8ec45243856c2516dab175892126b4c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81227,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_112d711e90c7e3ff00a2048226a0d973.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_7b758fea3a2a0e2f6ce34032d75279db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80076,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_bcd875a92198728227af70a3da2a964f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_e4fbad55a2f522f63c1915e1e647177b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_37d3ff74cc7ee5ad43e250150424e91e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87300,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_89a51aab0e0de5e54f7f053710d3986b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78558,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_c5e6501157e5ca54b3e9e63fc4b1e6c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76034,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_f6c3a4cb6e862654ad2ed9a8f7258a3f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-27',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota Aygo X 1.0 Trendy',
'transmission': 'automatic',
'trim': 'Trendy',
'year': 2022}
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR68259%27 HTTP/1.1" 200 None
2026-03-28 12:02:14 [auto1.it] INFO: Saving data for LR68259: {'created_time': 1774699334.515835, 'last_price_update_time': 1774699334.515847, 'auction_closing_time': 1774884915.0}
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LR68259') HTTP/1.1" 204 0
2026-03-28 12:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0 with identifier: JR85955
2026-03-28 12:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0 with identifier: JR85955
2026-03-28 12:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0 with identifier: JR85955 to the API
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_caaf365940c3a25d47cd6e30d914c981.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:52:44Z',
'fuel_type': 'diesel',
'id': 'c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR85955',
'listing': 'auction',
'location': 'IT, Modugno',
'make': 'Peugeot',
'model': '207',
'odometer': 154915,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0/c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_ef64f67049ff0b7d8745c715a0b89327.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0/c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73786,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_caaf365940c3a25d47cd6e30d914c981.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0/c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_b187e61c40954f102d75087b7abf6e9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0/c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_8322065f95c6bcb51b337837fae81995.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0/c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_1e338986092c590877153a308779bb8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0/c03b9ba6-29c3-5d98-bcb7-af7bb2755cf0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92260,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/c8/5ec8ed96d2cedcc8210232a7b142ccf2/pa/JR85955_4d138f41fab376dbdf349b8a8cdd67da.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-06-08',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 207 1.4 HDi X-Line',
'transmission': 'manual',
'trim': 'X-Line',
'year': 2006}
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR85955%27 HTTP/1.1" 200 None
2026-03-28 12:02:14 [auto1.it] INFO: Saving data for JR85955: {'created_time': 1774699334.965565, 'last_price_update_time': 1774699334.965575, 'auction_closing_time': 1774885964.0}
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JR85955') HTTP/1.1" 204 0
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_924110ea5f7e4f0b9fe051fadd7a9d04.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_924110ea5f7e4f0b9fe051fadd7a9d04.jpg not downloaded yet
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_d1a0b70049350f5a11b0368dc0a8049c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_d1a0b70049350f5a11b0368dc0a8049c.jpg not downloaded yet
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_31ddfeea7a618e18cabcf462395ce5db.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_31ddfeea7a618e18cabcf462395ce5db.jpg not downloaded yet
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_734ce33c8ceb734b658f2bd5cd396a35.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_734ce33c8ceb734b658f2bd5cd396a35.jpg not downloaded yet
2026-03-28 12:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_658be710b6af291a2add1b49d216a8b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_9fda09efe4fc65edd243e6c01782bdc1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_95be450e2671e40ac3c13c9dde47b96c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_d5e202ed434d7ad0fd0ddabd9e746fe0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH13960/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_2113e6e8cf0adc362fc2f89f9b2f1ccb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_2113e6e8cf0adc362fc2f89f9b2f1ccb.jpg not downloaded yet
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_074886da6bcf348f5798dc3452822d2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_074886da6bcf348f5798dc3452822d2d.jpg not downloaded yet
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_2928af46ffb9ad3c49b7486d96997037.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_2928af46ffb9ad3c49b7486d96997037.jpg not downloaded yet
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_a9ce83e064121e76cef4b0aeaeac2fe0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_a9ce83e064121e76cef4b0aeaeac2fe0.jpg not downloaded yet
2026-03-28 12:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7a41d0>
2026-03-28 12:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8/7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F4f%252F0c4f29a933f307c3bf8779abd6245d6b%252Fpa%252FDE59865_091993a9309877d3947d7b5d67b41a71.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_091993a9309877d3947d7b5d67b41a71.jpg saved to cache
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8
2026-03-28 12:02:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8, skipping ID generation
2026-03-28 12:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8 with scrape type 1
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8 sending to next pipeline
2026-03-28 12:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8, identifier: DE59865
2026-03-28 12:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7e9810>
2026-03-28 12:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99499219-33fa-5c59-ace4-570d5eeefad7/99499219-33fa-5c59-ace4-570d5eeefad7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8db3ec62c4ac46fc322071f363823e%252Fpa%252FEF37813_06ac722b5982abac49e57f7ffdc694da.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_06ac722b5982abac49e57f7ffdc694da.jpg saved to cache
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99499219-33fa-5c59-ace4-570d5eeefad7
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_395ce8fdb5f1ab775191e44bf8874436.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_395ce8fdb5f1ab775191e44bf8874436.jpg not downloaded yet
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_05c7e9fb12d15bcd5c490cd33d4a05f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_05c7e9fb12d15bcd5c490cd33d4a05f4.jpg not downloaded yet
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_5d9b2a1ad57c4ce4de57894e1db59b9b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_5d9b2a1ad57c4ce4de57894e1db59b9b.jpg not downloaded yet
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_0c7f10f39f38a5bafa6e93dea5ac383a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_0c7f10f39f38a5bafa6e93dea5ac383a.jpg not downloaded yet
2026-03-28 12:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8 with identifier: DE59865
2026-03-28 12:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8 with identifier: DE59865
2026-03-28 12:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8 with identifier: DE59865 to the API
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_091993a9309877d3947d7b5d67b41a71.jpg>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': 'Rental',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:39:32Z',
'fuel_type': 'diesel',
'id': '7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE59865',
'listing': 'auction',
'location': 'IT, Tradein',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 188483,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8/7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_6d63c88018de0029c55a8073eff42a3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8/7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68608,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_c49533d99af3a5db9497f94772decc90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8/7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64867,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_091993a9309877d3947d7b5d67b41a71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8/7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59466,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_d86ffec2757efe712a4c2336cb2ac163.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8/7d782d83-ce8c-58b9-b9de-b3ac9b3a28e8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/4f/0c4f29a933f307c3bf8779abd6245d6b/pa/DE59865_f8d3aa1166a7d85bdcd07adffc613751.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-03-30',
'seats_number': 7,
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2010}
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE59865%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [auto1.it] INFO: Saving data for DE59865: {'created_time': 1774699335.812863, 'last_price_update_time': 1774699335.812871, 'auction_closing_time': 1774885172.0}
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DE59865') HTTP/1.1" 204 0
2026-03-28 12:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_91c33dfdb584633d79dea2a44eeef5d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_e7228e5591c73e286334b78274bd0a4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_627e5fd97c2e29cc0018c6ed8d425ec6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_ded02fa83abda6c86e3ddc093aef56fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_4e1b23c2cb877d411fa959c9e960c0ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_4e1b23c2cb877d411fa959c9e960c0ec.jpg not downloaded yet
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_9c18db090cc85c7d314be82daf8ac09c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_9c18db090cc85c7d314be82daf8ac09c.jpg not downloaded yet
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_143f70d1010e3ffee9b4e2671605f687.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_143f70d1010e3ffee9b4e2671605f687.jpg not downloaded yet
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_9400d78d11432d9234429ea8f69b4f05.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_9400d78d11432d9234429ea8f69b4f05.jpg not downloaded yet
2026-03-28 12:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d48cb10>
2026-03-28 12:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_658be710b6af291a2add1b49d216a8b1.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_658be710b6af291a2add1b49d216a8b1.jpg saved to cache
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1fe96623-1551-5f21-968e-2c4fed2ce9e6
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d54c150>
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_9fda09efe4fc65edd243e6c01782bdc1.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_9fda09efe4fc65edd243e6c01782bdc1.jpg saved to cache
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4f3890>
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_95be450e2671e40ac3c13c9dde47b96c.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_95be450e2671e40ac3c13c9dde47b96c.jpg saved to cache
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61a402c8-c884-5d52-9613-8b1344bce439
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3caab7d0>
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec016fd-a92e-5957-bdef-45d1a6a8e0f2/4ec016fd-a92e-5957-bdef-45d1a6a8e0f2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F6d%252Fbb6d410f780090841c993966edcef59d%252Fpa%252FFL38609_d5e202ed434d7ad0fd0ddabd9e746fe0.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_d5e202ed434d7ad0fd0ddabd9e746fe0.jpg saved to cache
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ec016fd-a92e-5957-bdef-45d1a6a8e0f2
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_46e20d90c112fa90301ad4b3f128a7cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_46e20d90c112fa90301ad4b3f128a7cd.jpg not downloaded yet
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_325cde5b6af7ee4287d9ed5e348076dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_325cde5b6af7ee4287d9ed5e348076dd.jpg not downloaded yet
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_09400949942c36d70efa0cb0d5a9cf7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_09400949942c36d70efa0cb0d5a9cf7c.jpg not downloaded yet
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_436c63b4a8012d2f6625f6d27eb1d68b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_436c63b4a8012d2f6625f6d27eb1d68b.jpg not downloaded yet
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f971d50>
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_91c33dfdb584633d79dea2a44eeef5d8.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_91c33dfdb584633d79dea2a44eeef5d8.jpg saved to cache
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4ab110>
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_e7228e5591c73e286334b78274bd0a4c.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_e7228e5591c73e286334b78274bd0a4c.jpg saved to cache
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1fe96623-1551-5f21-968e-2c4fed2ce9e6
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d65e110>
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_627e5fd97c2e29cc0018c6ed8d425ec6.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_627e5fd97c2e29cc0018c6ed8d425ec6.jpg saved to cache
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61a402c8-c884-5d52-9613-8b1344bce439
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb44950>
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec016fd-a92e-5957-bdef-45d1a6a8e0f2/4ec016fd-a92e-5957-bdef-45d1a6a8e0f2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F6d%252Fbb6d410f780090841c993966edcef59d%252Fpa%252FFL38609_ded02fa83abda6c86e3ddc093aef56fe.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_ded02fa83abda6c86e3ddc093aef56fe.jpg saved to cache
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ec016fd-a92e-5957-bdef-45d1a6a8e0f2
2026-03-28 12:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_bbaf36d1f0af093488e86e00be5af573.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_a4c0658f6202ea94c8f4414009d7a9ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_8feeb0de60c585ef2855b937f4d93d1d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_81d1ad98178867b2f136136c36572713.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_ccb0f110fea56dcc5c78bf2ab0a27c69.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_a9df63db6dad767d6262aaee631d326a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_fc9448ab706e41114e51ae4b31d344b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f533650>
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_bbaf36d1f0af093488e86e00be5af573.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_bbaf36d1f0af093488e86e00be5af573.jpg saved to cache
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7965d0>
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_a4c0658f6202ea94c8f4414009d7a9ca.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_a4c0658f6202ea94c8f4414009d7a9ca.jpg saved to cache
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c
2026-03-28 12:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_878c21313b72ec762b9ffd29da4be4d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_0c7f10f39f38a5bafa6e93dea5ac383a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_734ce33c8ceb734b658f2bd5cd396a35.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb94cd0>
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_8feeb0de60c585ef2855b937f4d93d1d.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_8feeb0de60c585ef2855b937f4d93d1d.jpg saved to cache
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61a402c8-c884-5d52-9613-8b1344bce439
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c9d7090>
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_81d1ad98178867b2f136136c36572713.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_81d1ad98178867b2f136136c36572713.jpg saved to cache
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60455cbd-6315-5d7c-97d4-cc62aac19e39
2026-03-28 12:02:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbfbe50>
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fda%252Fffda9d5f174ecffe9a00220d2312d0f5%252Fpa%252FJH97185_ccb0f110fea56dcc5c78bf2ab0a27c69.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_ccb0f110fea56dcc5c78bf2ab0a27c69.jpg saved to cache
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-03-28 12:02:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: daaa3a0f-e46a-51da-a933-0dc6a86f8dd8, skipping ID generation
2026-03-28 12:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8 with scrape type 1
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8 sending to next pipeline
2026-03-28 12:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: daaa3a0f-e46a-51da-a933-0dc6a86f8dd8, identifier: JH97185
2026-03-28 12:02:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c982fd0>
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_a9df63db6dad767d6262aaee631d326a.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_a9df63db6dad767d6262aaee631d326a.jpg saved to cache
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c
2026-03-28 12:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca7dc10>
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_fc9448ab706e41114e51ae4b31d344b8.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_fc9448ab706e41114e51ae4b31d344b8.jpg saved to cache
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60455cbd-6315-5d7c-97d4-cc62aac19e39
2026-03-28 12:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: daaa3a0f-e46a-51da-a933-0dc6a86f8dd8 with identifier: JH97185
2026-03-28 12:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: daaa3a0f-e46a-51da-a933-0dc6a86f8dd8 with identifier: JH97185
2026-03-28 12:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: daaa3a0f-e46a-51da-a933-0dc6a86f8dd8 with identifier: JH97185 to the API
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_ccb0f110fea56dcc5c78bf2ab0a27c69.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:03:55Z',
'fuel_type': 'petrol',
'id': 'daaa3a0f-e46a-51da-a933-0dc6a86f8dd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH97185',
'listing': 'auction',
'location': 'IT, Livorno',
'make': 'Alfa Romeo',
'model': 'Tonale',
'odometer': 54133,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2328631,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_694d6dafa2baf25ad09ccf0e4ca72deb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2257442,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_ccb0f110fea56dcc5c78bf2ab0a27c69.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_ec0169198c9cbc44a1b5d661664fca48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_1d7047e2934fc693c809c2337e9f3ae8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2192718,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_bd6a537dfe16635ecddeaee96b5e1dc6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67623,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_146cd9fa7876dfe9b4535d2c69e617fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2389663,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_972945a1a35bd6d477c2569182469c9a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60542,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_2ea81aee3b233e4c7db67d19cf41a57d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_12dcfd0597cafab9cdc4313eef621a52.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56995,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_7debe2fa3a6bb2a8be58eb1b4c22e709.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Tonale 1.5 Mild-Hybrid Sprint',
'transmission': 'automatic',
'trim': 'Sprint',
'year': 2023}
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH97185%27 HTTP/1.1" 200 None
2026-03-28 12:02:17 [auto1.it] INFO: Saving data for JH97185: {'created_time': 1774699337.688348, 'last_price_update_time': 1774699337.688357, 'auction_closing_time': 1774883035.0}
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JH97185') HTTP/1.1" 204 0
2026-03-28 12:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_9749f3e1a79b52bde5075fe5c719e2f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_09400949942c36d70efa0cb0d5a9cf7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_436c63b4a8012d2f6625f6d27eb1d68b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_325cde5b6af7ee4287d9ed5e348076dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca20ad0>
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_878c21313b72ec762b9ffd29da4be4d6.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_878c21313b72ec762b9ffd29da4be4d6.jpg saved to cache
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1fe96623-1551-5f21-968e-2c4fed2ce9e6
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d59bbd0>
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_0c7f10f39f38a5bafa6e93dea5ac383a.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_0c7f10f39f38a5bafa6e93dea5ac383a.jpg saved to cache
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c9834d0>
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_734ce33c8ceb734b658f2bd5cd396a35.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_734ce33c8ceb734b658f2bd5cd396a35.jpg saved to cache
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c98a810>
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec016fd-a92e-5957-bdef-45d1a6a8e0f2/4ec016fd-a92e-5957-bdef-45d1a6a8e0f2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F6d%252Fbb6d410f780090841c993966edcef59d%252Fpa%252FFL38609_9749f3e1a79b52bde5075fe5c719e2f2.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_9749f3e1a79b52bde5075fe5c719e2f2.jpg saved to cache
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ec016fd-a92e-5957-bdef-45d1a6a8e0f2
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca4f590>
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_09400949942c36d70efa0cb0d5a9cf7c.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_09400949942c36d70efa0cb0d5a9cf7c.jpg saved to cache
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 61a402c8-c884-5d52-9613-8b1344bce439
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb20250>
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_436c63b4a8012d2f6625f6d27eb1d68b.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_436c63b4a8012d2f6625f6d27eb1d68b.jpg saved to cache
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6ab8d0>
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_325cde5b6af7ee4287d9ed5e348076dd.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_325cde5b6af7ee4287d9ed5e348076dd.jpg saved to cache
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1fe96623-1551-5f21-968e-2c4fed2ce9e6
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_46e20d90c112fa90301ad4b3f128a7cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_9400d78d11432d9234429ea8f69b4f05.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_112795b690ed6d72c2527e927aec9188.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_05c7e9fb12d15bcd5c490cd33d4a05f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_5d9b2a1ad57c4ce4de57894e1db59b9b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_395ce8fdb5f1ab775191e44bf8874436.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_143f70d1010e3ffee9b4e2671605f687.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_9c18db090cc85c7d314be82daf8ac09c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c9af850>
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_46e20d90c112fa90301ad4b3f128a7cd.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_46e20d90c112fa90301ad4b3f128a7cd.jpg saved to cache
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60455cbd-6315-5d7c-97d4-cc62aac19e39
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d538d10>
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_9400d78d11432d9234429ea8f69b4f05.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_9400d78d11432d9234429ea8f69b4f05.jpg saved to cache
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c
2026-03-28 12:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cc11a50>
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_112795b690ed6d72c2527e927aec9188.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_112795b690ed6d72c2527e927aec9188.jpg saved to cache
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61a402c8-c884-5d52-9613-8b1344bce439
2026-03-28 12:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c987e90>
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_05c7e9fb12d15bcd5c490cd33d4a05f4.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_05c7e9fb12d15bcd5c490cd33d4a05f4.jpg saved to cache
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1fe96623-1551-5f21-968e-2c4fed2ce9e6
2026-03-28 12:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cc10590>
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_5d9b2a1ad57c4ce4de57894e1db59b9b.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_5d9b2a1ad57c4ce4de57894e1db59b9b.jpg saved to cache
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 61a402c8-c884-5d52-9613-8b1344bce439
2026-03-28 12:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d507650>
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_395ce8fdb5f1ab775191e44bf8874436.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_395ce8fdb5f1ab775191e44bf8874436.jpg saved to cache
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60455cbd-6315-5d7c-97d4-cc62aac19e39
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cc10c90>
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_143f70d1010e3ffee9b4e2671605f687.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_143f70d1010e3ffee9b4e2671605f687.jpg saved to cache
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 61a402c8-c884-5d52-9613-8b1344bce439
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c987890>
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_9c18db090cc85c7d314be82daf8ac09c.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_9c18db090cc85c7d314be82daf8ac09c.jpg saved to cache
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1fe96623-1551-5f21-968e-2c4fed2ce9e6
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_a9ce83e064121e76cef4b0aeaeac2fe0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_4e1b23c2cb877d411fa959c9e960c0ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH13960> (referer: https://www.auto1.com/v1/car-details-view/KH13960/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR17462> (referer: https://www.auto1.com/v1/car-details-view/UR17462/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EV59116> (referer: https://www.auto1.com/v1/car-details-view/EV59116/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_2113e6e8cf0adc362fc2f89f9b2f1ccb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_074886da6bcf348f5798dc3452822d2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY41081> (referer: https://www.auto1.com/v1/car-details-view/UY41081/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL91397> (referer: https://www.auto1.com/v1/car-details-view/VL91397/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_d7cbdff11f2e802a95167b330e4cb46f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f880050>
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3a%252Ff63a82377c9d7f8146f606c52405415d%252Fpa%252FSD35651_a9ce83e064121e76cef4b0aeaeac2fe0.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_a9ce83e064121e76cef4b0aeaeac2fe0.jpg saved to cache
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c
2026-03-28 12:02:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c, skipping ID generation
2026-03-28 12:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c with scrape type 1
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c sending to next pipeline
2026-03-28 12:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c, identifier: SD35651
2026-03-28 12:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c with identifier: SD35651
2026-03-28 12:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c with identifier: SD35651
2026-03-28 12:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c with identifier: SD35651 to the API
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_a9ce83e064121e76cef4b0aeaeac2fe0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 167,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:56:04Z',
'fuel_type': 'diesel',
'id': 'a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD35651',
'listing': 'auction',
'location': 'IT, Genova',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 169805,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2581057,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_a9df63db6dad767d6262aaee631d326a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_9fda09efe4fc65edd243e6c01782bdc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63258,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_bbaf36d1f0af093488e86e00be5af573.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54327,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_91c33dfdb584633d79dea2a44eeef5d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_a4c0658f6202ea94c8f4414009d7a9ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_734ce33c8ceb734b658f2bd5cd396a35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51092,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_a9ce83e064121e76cef4b0aeaeac2fe0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_0c7f10f39f38a5bafa6e93dea5ac383a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63893,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_9400d78d11432d9234429ea8f69b4f05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c/a90f61a4-9a4d-5ad3-aaa7-bbb6b68e774c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/3a/f63a82377c9d7f8146f606c52405415d/pa/SD35651_436c63b4a8012d2f6625f6d27eb1d68b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-07-14',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
'transmission': 'automatic',
'trim': 'Sport & Style 4Motion',
'year': 2013}
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD35651%27 HTTP/1.1" 200 None
2026-03-28 12:02:19 [auto1.it] INFO: Saving data for SD35651: {'created_time': 1774699339.474092, 'last_price_update_time': 1774699339.474103, 'auction_closing_time': 1774886164.0}
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SD35651') HTTP/1.1" 204 0
2026-03-28 12:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_d1a0b70049350f5a11b0368dc0a8049c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_8e10e622d79f8a780ea575dfd6347448.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_924110ea5f7e4f0b9fe051fadd7a9d04.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_8b729c0da1bc3920cd75692275e6f162.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4dd850>
2026-03-28 12:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_4e1b23c2cb877d411fa959c9e960c0ec.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_4e1b23c2cb877d411fa959c9e960c0ec.jpg saved to cache
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60455cbd-6315-5d7c-97d4-cc62aac19e39
2026-03-28 12:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8c81491-fa63-5f3a-863f-9e97f3c64ae3 with identifier: KH13960
2026-03-28 12:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8c81491-fa63-5f3a-863f-9e97f3c64ae3 with scrape type 1
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a8c81491-fa63-5f3a-863f-9e97f3c64ae3
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fde%252F0bde6df7bde0626096e0c30873c52677%252Fpa%252FKH13960_a56c6f2775b49fab669bf369faeb98bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_a56c6f2775b49fab669bf369faeb98bb.jpg not downloaded yet
2026-03-28 12:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 731c32ee-a2d2-5cf9-979a-6508c2353c30 with identifier: UR17462
2026-03-28 12:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 731c32ee-a2d2-5cf9-979a-6508c2353c30 with scrape type 1
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 731c32ee-a2d2-5cf9-979a-6508c2353c30
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_4dd8c8bcb6e195c6eb8a6b8d8b55dc8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_4dd8c8bcb6e195c6eb8a6b8d8b55dc8b.jpg not downloaded yet
2026-03-28 12:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 727d9e13-3d17-57e6-a863-fb4c5c13ecc5 with identifier: EV59116
2026-03-28 12:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 727d9e13-3d17-57e6-a863-fb4c5c13ecc5 with scrape type 1
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 727d9e13-3d17-57e6-a863-fb4c5c13ecc5
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F94%252F8f94cac7e22b69f0de6acecc45589fb5%252Fpa%252FEV59116_022c7618e6412bd8f2c2789873b28a5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_022c7618e6412bd8f2c2789873b28a5a.jpg not downloaded yet
2026-03-28 12:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7994d0>
2026-03-28 12:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_2113e6e8cf0adc362fc2f89f9b2f1ccb.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_2113e6e8cf0adc362fc2f89f9b2f1ccb.jpg saved to cache
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60455cbd-6315-5d7c-97d4-cc62aac19e39
2026-03-28 12:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbc2490>
2026-03-28 12:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_074886da6bcf348f5798dc3452822d2d.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_074886da6bcf348f5798dc3452822d2d.jpg saved to cache
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1fe96623-1551-5f21-968e-2c4fed2ce9e6
2026-03-28 12:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31af8902-6ab9-5e91-99cf-27af1819c286 with identifier: UY41081
2026-03-28 12:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31af8902-6ab9-5e91-99cf-27af1819c286 with scrape type 1
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31af8902-6ab9-5e91-99cf-27af1819c286
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_c370f959f00d155934c46c29c04bf3af.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_c370f959f00d155934c46c29c04bf3af.jpg not downloaded yet
2026-03-28 12:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2438c3d8-067e-54db-a38b-4f1ea98b84b9 with identifier: VL91397
2026-03-28 12:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2438c3d8-067e-54db-a38b-4f1ea98b84b9 with scrape type 1
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2438c3d8-067e-54db-a38b-4f1ea98b84b9
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_02151ff5b48ee4d45fe824815f0520d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_02151ff5b48ee4d45fe824815f0520d4.jpg not downloaded yet
2026-03-28 12:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c942390>
2026-03-28 12:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec016fd-a92e-5957-bdef-45d1a6a8e0f2/4ec016fd-a92e-5957-bdef-45d1a6a8e0f2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F6d%252Fbb6d410f780090841c993966edcef59d%252Fpa%252FFL38609_d7cbdff11f2e802a95167b330e4cb46f.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_d7cbdff11f2e802a95167b330e4cb46f.jpg saved to cache
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ec016fd-a92e-5957-bdef-45d1a6a8e0f2
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fde%252F0bde6df7bde0626096e0c30873c52677%252Fpa%252FKH13960_80e5fe096e5b0e6763257df5d7a60684.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_80e5fe096e5b0e6763257df5d7a60684.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_b916745c1b7d3fa7db077de4057325f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_b916745c1b7d3fa7db077de4057325f0.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F94%252F8f94cac7e22b69f0de6acecc45589fb5%252Fpa%252FEV59116_6554596898eabff2465298172e885983.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_6554596898eabff2465298172e885983.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_16dfea1bc0ec4969d73fcba5602731f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_16dfea1bc0ec4969d73fcba5602731f1.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_b806be097d58035153fd0d1f5c796453.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_b806be097d58035153fd0d1f5c796453.jpg not downloaded yet
2026-03-28 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_246035588c5a17451220de45c4f532f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f577e90>
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_d1a0b70049350f5a11b0368dc0a8049c.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_d1a0b70049350f5a11b0368dc0a8049c.jpg saved to cache
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1fe96623-1551-5f21-968e-2c4fed2ce9e6
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4f7850>
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_8e10e622d79f8a780ea575dfd6347448.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_8e10e622d79f8a780ea575dfd6347448.jpg saved to cache
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60455cbd-6315-5d7c-97d4-cc62aac19e39
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6d7510>
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_924110ea5f7e4f0b9fe051fadd7a9d04.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_924110ea5f7e4f0b9fe051fadd7a9d04.jpg saved to cache
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60455cbd-6315-5d7c-97d4-cc62aac19e39
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb35510>
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_8b729c0da1bc3920cd75692275e6f162.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_8b729c0da1bc3920cd75692275e6f162.jpg saved to cache
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61a402c8-c884-5d52-9613-8b1344bce439
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fde%252F0bde6df7bde0626096e0c30873c52677%252Fpa%252FKH13960_ad1d3d2a6e2662696b0673e82e65f24b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_ad1d3d2a6e2662696b0673e82e65f24b.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_1f89f762711356277ab8f01c622277c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_1f89f762711356277ab8f01c622277c4.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F94%252F8f94cac7e22b69f0de6acecc45589fb5%252Fpa%252FEV59116_9cd6c3697028698cb5d40fab56016718.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_9cd6c3697028698cb5d40fab56016718.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_c8af1fb23729b3b8066ef65046df52e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_c8af1fb23729b3b8066ef65046df52e6.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_72e0ef6334494e77eaf0d17cdadac5e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_72e0ef6334494e77eaf0d17cdadac5e0.jpg not downloaded yet
2026-03-28 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_4d5149e5c9e466c9dd2ce010b7d9d4ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_30154354976f8385f96f2782d7eb4fb2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fde%252F0bde6df7bde0626096e0c30873c52677%252Fpa%252FKH13960_ceecdcd7407749960a1dd47491e568fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_ceecdcd7407749960a1dd47491e568fb.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_323e6340a92c78774577ef453e0ced83.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_323e6340a92c78774577ef453e0ced83.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F94%252F8f94cac7e22b69f0de6acecc45589fb5%252Fpa%252FEV59116_4dd56373c61ea703ce50ca488683896c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_4dd56373c61ea703ce50ca488683896c.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_a1ce9f43ee5b07402ca1d80921ab07ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_a1ce9f43ee5b07402ca1d80921ab07ca.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_39cb536609d6004d214c16ff0ef9db7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_39cb536609d6004d214c16ff0ef9db7f.jpg not downloaded yet
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbc7050>
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_246035588c5a17451220de45c4f532f1.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_246035588c5a17451220de45c4f532f1.jpg saved to cache
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fe96623-1551-5f21-968e-2c4fed2ce9e6
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fde%252F0bde6df7bde0626096e0c30873c52677%252Fpa%252FKH13960_5208de06823989c4a500f5f1b27d50e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_5208de06823989c4a500f5f1b27d50e6.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_5897060d1fc24f118e7c099c3f4a14df.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_5897060d1fc24f118e7c099c3f4a14df.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F94%252F8f94cac7e22b69f0de6acecc45589fb5%252Fpa%252FEV59116_3519a969af83f2070b7619932ceccad6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_3519a969af83f2070b7619932ceccad6.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_29c39dcff9d0299333f86019aa7fe137.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_29c39dcff9d0299333f86019aa7fe137.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_659571afe8f94ed46680eb7f9bf3d948.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_659571afe8f94ed46680eb7f9bf3d948.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_03eaaebdf25afc54e4ab034cb11ed35e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_03eaaebdf25afc54e4ab034cb11ed35e.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_3c265f933d21e6696086082ed6707cec.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_3c265f933d21e6696086082ed6707cec.jpg not downloaded yet
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_54408ddd57b709c056c51eb4c77d6bdd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_54408ddd57b709c056c51eb4c77d6bdd.jpg not downloaded yet
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d69b190>
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_4d5149e5c9e466c9dd2ce010b7d9d4ad.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_4d5149e5c9e466c9dd2ce010b7d9d4ad.jpg saved to cache
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60455cbd-6315-5d7c-97d4-cc62aac19e39
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4d4350>
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec016fd-a92e-5957-bdef-45d1a6a8e0f2/4ec016fd-a92e-5957-bdef-45d1a6a8e0f2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F6d%252Fbb6d410f780090841c993966edcef59d%252Fpa%252FFL38609_30154354976f8385f96f2782d7eb4fb2.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_30154354976f8385f96f2782d7eb4fb2.jpg saved to cache
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ec016fd-a92e-5957-bdef-45d1a6a8e0f2
2026-03-28 12:02:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ec016fd-a92e-5957-bdef-45d1a6a8e0f2, skipping ID generation
2026-03-28 12:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ec016fd-a92e-5957-bdef-45d1a6a8e0f2 with scrape type 1
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ec016fd-a92e-5957-bdef-45d1a6a8e0f2 sending to next pipeline
2026-03-28 12:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4ec016fd-a92e-5957-bdef-45d1a6a8e0f2, identifier: FL38609
2026-03-28 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_b806be097d58035153fd0d1f5c796453.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_16dfea1bc0ec4969d73fcba5602731f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_6554596898eabff2465298172e885983.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4ec016fd-a92e-5957-bdef-45d1a6a8e0f2 with identifier: FL38609
2026-03-28 12:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4ec016fd-a92e-5957-bdef-45d1a6a8e0f2 with identifier: FL38609
2026-03-28 12:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4ec016fd-a92e-5957-bdef-45d1a6a8e0f2 with identifier: FL38609 to the API
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_30154354976f8385f96f2782d7eb4fb2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:44:37Z',
'fuel_type': 'petrol',
'id': '4ec016fd-a92e-5957-bdef-45d1a6a8e0f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL38609',
'listing': 'auction',
'location': 'IT, Roma RM',
'make': 'Hyundai',
'model': 'ix20',
'odometer': 140347,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec016fd-a92e-5957-bdef-45d1a6a8e0f2/4ec016fd-a92e-5957-bdef-45d1a6a8e0f2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110902,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_30154354976f8385f96f2782d7eb4fb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec016fd-a92e-5957-bdef-45d1a6a8e0f2/4ec016fd-a92e-5957-bdef-45d1a6a8e0f2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118622,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_d5e202ed434d7ad0fd0ddabd9e746fe0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec016fd-a92e-5957-bdef-45d1a6a8e0f2/4ec016fd-a92e-5957-bdef-45d1a6a8e0f2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75375,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_d7cbdff11f2e802a95167b330e4cb46f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec016fd-a92e-5957-bdef-45d1a6a8e0f2/4ec016fd-a92e-5957-bdef-45d1a6a8e0f2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_ded02fa83abda6c86e3ddc093aef56fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec016fd-a92e-5957-bdef-45d1a6a8e0f2/4ec016fd-a92e-5957-bdef-45d1a6a8e0f2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61286,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/6d/bb6d410f780090841c993966edcef59d/pa/FL38609_9749f3e1a79b52bde5075fe5c719e2f2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai ix20 1.4 Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2012}
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL38609%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [auto1.it] INFO: Saving data for FL38609: {'created_time': 1774699341.392697, 'last_price_update_time': 1774699341.392707, 'auction_closing_time': 1774885477.0}
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FL38609') HTTP/1.1" 204 0
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_f29aa8c93db56fbf5fafd6608a5c565c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_f29aa8c93db56fbf5fafd6608a5c565c.jpg not downloaded yet
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_2020627636fa13d1005fe265cdce1cd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_2020627636fa13d1005fe265cdce1cd5.jpg not downloaded yet
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_6e7da211fbfaa7595ae57792028d9bdc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_6e7da211fbfaa7595ae57792028d9bdc.jpg not downloaded yet
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_7531c7822a954f258d0a8334059fa8b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_7531c7822a954f258d0a8334059fa8b5.jpg not downloaded yet
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_77e92b2fd411c2bdafeb723a443b43de.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_77e92b2fd411c2bdafeb723a443b43de.jpg not downloaded yet
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_375ce04b5d53db76656d7c3856d6a39a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_375ce04b5d53db76656d7c3856d6a39a.jpg not downloaded yet
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c95ad90>
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_b806be097d58035153fd0d1f5c796453.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_b806be097d58035153fd0d1f5c796453.jpg saved to cache
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2438c3d8-067e-54db-a38b-4f1ea98b84b9
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca64a50>
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_16dfea1bc0ec4969d73fcba5602731f1.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_16dfea1bc0ec4969d73fcba5602731f1.jpg saved to cache
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31af8902-6ab9-5e91-99cf-27af1819c286
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbc6150>
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_727d9e13-3d17-57e6-a863-fb4c5c13ecc5/727d9e13-3d17-57e6-a863-fb4c5c13ecc5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F94%252F8f94cac7e22b69f0de6acecc45589fb5%252Fpa%252FEV59116_6554596898eabff2465298172e885983.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_6554596898eabff2465298172e885983.jpg saved to cache
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 727d9e13-3d17-57e6-a863-fb4c5c13ecc5
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_3e73a1cb933b5ea28c9da0eff72478ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_3e73a1cb933b5ea28c9da0eff72478ac.jpg not downloaded yet
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_68e6389cec40e9159e890126a4623ad2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_68e6389cec40e9159e890126a4623ad2.jpg not downloaded yet
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_f1dfbe213de7c62f59b61ab8c76b1944.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_f1dfbe213de7c62f59b61ab8c76b1944.jpg not downloaded yet
2026-03-28 12:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_80e5fe096e5b0e6763257df5d7a60684.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_c370f959f00d155934c46c29c04bf3af.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_02151ff5b48ee4d45fe824815f0520d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_22035c777eb204116590fb68e4014040.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_22035c777eb204116590fb68e4014040.jpg not downloaded yet
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_d75ac7d430da7db2f0a771077299522e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_d75ac7d430da7db2f0a771077299522e.jpg not downloaded yet
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_bebd9ac35b4f03f67561184e959f89aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_bebd9ac35b4f03f67561184e959f89aa.jpg not downloaded yet
2026-03-28 12:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_f3f86d1ce01bdf81a56a35d75cf4b3ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_2928af46ffb9ad3c49b7486d96997037.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_c8b75aa8b1be4fffc9db4c7fc91b3eeb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_b916745c1b7d3fa7db077de4057325f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_022c7618e6412bd8f2c2789873b28a5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_31ddfeea7a618e18cabcf462395ce5db.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb54410>
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8c81491-fa63-5f3a-863f-9e97f3c64ae3/a8c81491-fa63-5f3a-863f-9e97f3c64ae3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fde%252F0bde6df7bde0626096e0c30873c52677%252Fpa%252FKH13960_80e5fe096e5b0e6763257df5d7a60684.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_80e5fe096e5b0e6763257df5d7a60684.jpg saved to cache
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8c81491-fa63-5f3a-863f-9e97f3c64ae3
2026-03-28 12:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_a56c6f2775b49fab669bf369faeb98bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_54408ddd57b709c056c51eb4c77d6bdd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4d4810>
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_c370f959f00d155934c46c29c04bf3af.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_c370f959f00d155934c46c29c04bf3af.jpg saved to cache
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31af8902-6ab9-5e91-99cf-27af1819c286
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6fb2d0>
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_02151ff5b48ee4d45fe824815f0520d4.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_02151ff5b48ee4d45fe824815f0520d4.jpg saved to cache
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2438c3d8-067e-54db-a38b-4f1ea98b84b9
2026-03-28 12:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_3e73a1cb933b5ea28c9da0eff72478ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6ba3d0>
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F310667a43fb1105ade15c559640e6ece%252Fpa%252FLL57465_f3f86d1ce01bdf81a56a35d75cf4b3ae.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_f3f86d1ce01bdf81a56a35d75cf4b3ae.jpg saved to cache
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1fe96623-1551-5f21-968e-2c4fed2ce9e6
2026-03-28 12:02:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fe96623-1551-5f21-968e-2c4fed2ce9e6, skipping ID generation
2026-03-28 12:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe96623-1551-5f21-968e-2c4fed2ce9e6 with scrape type 1
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fe96623-1551-5f21-968e-2c4fed2ce9e6 sending to next pipeline
2026-03-28 12:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1fe96623-1551-5f21-968e-2c4fed2ce9e6, identifier: LL57465
2026-03-28 12:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5d42d0>
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_2928af46ffb9ad3c49b7486d96997037.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_2928af46ffb9ad3c49b7486d96997037.jpg saved to cache
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 61a402c8-c884-5d52-9613-8b1344bce439
2026-03-28 12:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbc5d50>
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F36%252F353685efb7ea4f673bde4bc988bcc0e0%252Fpa%252FKG93031_c8b75aa8b1be4fffc9db4c7fc91b3eeb.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_c8b75aa8b1be4fffc9db4c7fc91b3eeb.jpg saved to cache
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60455cbd-6315-5d7c-97d4-cc62aac19e39
2026-03-28 12:02:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60455cbd-6315-5d7c-97d4-cc62aac19e39, skipping ID generation
2026-03-28 12:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60455cbd-6315-5d7c-97d4-cc62aac19e39 with scrape type 1
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60455cbd-6315-5d7c-97d4-cc62aac19e39 sending to next pipeline
2026-03-28 12:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 60455cbd-6315-5d7c-97d4-cc62aac19e39, identifier: KG93031
2026-03-28 12:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbde7d0>
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_b916745c1b7d3fa7db077de4057325f0.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_b916745c1b7d3fa7db077de4057325f0.jpg saved to cache
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 731c32ee-a2d2-5cf9-979a-6508c2353c30
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7dc150>
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_727d9e13-3d17-57e6-a863-fb4c5c13ecc5/727d9e13-3d17-57e6-a863-fb4c5c13ecc5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F94%252F8f94cac7e22b69f0de6acecc45589fb5%252Fpa%252FEV59116_022c7618e6412bd8f2c2789873b28a5a.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_022c7618e6412bd8f2c2789873b28a5a.jpg saved to cache
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 727d9e13-3d17-57e6-a863-fb4c5c13ecc5
2026-03-28 12:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cacf250>
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F61%252Fb4611e12f7c5784110de0ba330403fdf%252Fpa%252FMT10040_31ddfeea7a618e18cabcf462395ce5db.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_31ddfeea7a618e18cabcf462395ce5db.jpg saved to cache
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61a402c8-c884-5d52-9613-8b1344bce439
2026-03-28 12:02:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61a402c8-c884-5d52-9613-8b1344bce439, skipping ID generation
2026-03-28 12:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61a402c8-c884-5d52-9613-8b1344bce439 with scrape type 1
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61a402c8-c884-5d52-9613-8b1344bce439 sending to next pipeline
2026-03-28 12:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 61a402c8-c884-5d52-9613-8b1344bce439, identifier: MT10040
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbdde10>
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8c81491-fa63-5f3a-863f-9e97f3c64ae3/a8c81491-fa63-5f3a-863f-9e97f3c64ae3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fde%252F0bde6df7bde0626096e0c30873c52677%252Fpa%252FKH13960_a56c6f2775b49fab669bf369faeb98bb.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_a56c6f2775b49fab669bf369faeb98bb.jpg saved to cache
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8c81491-fa63-5f3a-863f-9e97f3c64ae3
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca22510>
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_54408ddd57b709c056c51eb4c77d6bdd.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_54408ddd57b709c056c51eb4c77d6bdd.jpg saved to cache
2026-03-28 12:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2438c3d8-067e-54db-a38b-4f1ea98b84b9
2026-03-28 12:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_f1dfbe213de7c62f59b61ab8c76b1944.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1fe96623-1551-5f21-968e-2c4fed2ce9e6 with identifier: LL57465
2026-03-28 12:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1fe96623-1551-5f21-968e-2c4fed2ce9e6 with identifier: LL57465
2026-03-28 12:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1fe96623-1551-5f21-968e-2c4fed2ce9e6 with identifier: LL57465 to the API
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_f3f86d1ce01bdf81a56a35d75cf4b3ae.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:19:40Z',
'fuel_type': 'petrol',
'id': '1fe96623-1551-5f21-968e-2c4fed2ce9e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL57465',
'listing': 'auction',
'location': 'IT, Verona',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 34769,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_246035588c5a17451220de45c4f532f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_658be710b6af291a2add1b49d216a8b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2397248,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_f3f86d1ce01bdf81a56a35d75cf4b3ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58602,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_e7228e5591c73e286334b78274bd0a4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_878c21313b72ec762b9ffd29da4be4d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_d1a0b70049350f5a11b0368dc0a8049c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2337406,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_074886da6bcf348f5798dc3452822d2d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2555614,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_05c7e9fb12d15bcd5c490cd33d4a05f4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_9c18db090cc85c7d314be82daf8ac09c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe96623-1551-5f21-968e-2c4fed2ce9e6/1fe96623-1551-5f21-968e-2c4fed2ce9e6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/06/310667a43fb1105ade15c559640e6ece/pa/LL57465_325cde5b6af7ee4287d9ed5e348076dd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-12-12',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 1.5 TSI ACT e-TEC Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2023}
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL57465%27 HTTP/1.1" 200 None
2026-03-28 12:02:23 [auto1.it] INFO: Saving data for LL57465: {'created_time': 1774699343.440074, 'last_price_update_time': 1774699343.44009, 'auction_closing_time': 1774883980.0}
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LL57465') HTTP/1.1" 204 0
2026-03-28 12:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 60455cbd-6315-5d7c-97d4-cc62aac19e39 with identifier: KG93031
2026-03-28 12:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 60455cbd-6315-5d7c-97d4-cc62aac19e39 with identifier: KG93031
2026-03-28 12:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 60455cbd-6315-5d7c-97d4-cc62aac19e39 with identifier: KG93031 to the API
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_c8b75aa8b1be4fffc9db4c7fc91b3eeb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:20:20Z',
'fuel_type': 'hybrid',
'id': '60455cbd-6315-5d7c-97d4-cc62aac19e39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG93031',
'listing': 'auction',
'location': 'IT, Roma RM',
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 61478,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118344,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_4d5149e5c9e466c9dd2ce010b7d9d4ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2842362,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_fc9448ab706e41114e51ae4b31d344b8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2819360,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_c8b75aa8b1be4fffc9db4c7fc91b3eeb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_81d1ad98178867b2f136136c36572713.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91231,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_8e10e622d79f8a780ea575dfd6347448.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_924110ea5f7e4f0b9fe051fadd7a9d04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2622692,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_2113e6e8cf0adc362fc2f89f9b2f1ccb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2906254,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_395ce8fdb5f1ab775191e44bf8874436.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103675,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_4e1b23c2cb877d411fa959c9e960c0ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60455cbd-6315-5d7c-97d4-cc62aac19e39/60455cbd-6315-5d7c-97d4-cc62aac19e39_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/36/353685efb7ea4f673bde4bc988bcc0e0/pa/KG93031_46e20d90c112fa90301ad4b3f128a7cd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Trend',
'transmission': 'automatic',
'trim': '2WD Trend',
'year': 2022}
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG93031%27 HTTP/1.1" 200 None
2026-03-28 12:02:23 [auto1.it] INFO: Saving data for KG93031: {'created_time': 1774699343.873551, 'last_price_update_time': 1774699343.873562, 'auction_closing_time': 1774884020.0}
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KG93031') HTTP/1.1" 204 0
2026-03-28 12:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 61a402c8-c884-5d52-9613-8b1344bce439 with identifier: MT10040
2026-03-28 12:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 61a402c8-c884-5d52-9613-8b1344bce439 with identifier: MT10040
2026-03-28 12:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 61a402c8-c884-5d52-9613-8b1344bce439 with identifier: MT10040 to the API
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_31ddfeea7a618e18cabcf462395ce5db.jpg>
{'auction_title': '',
'c_o_2_emission_value': 89,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:57:32Z',
'fuel_type': 'diesel',
'id': '61a402c8-c884-5d52-9613-8b1344bce439',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT10040',
'listing': 'auction',
'location': 'IT, Roma RM',
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 144541,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3976254,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_112795b690ed6d72c2527e927aec9188.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115937,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_95be450e2671e40ac3c13c9dde47b96c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_8b729c0da1bc3920cd75692275e6f162.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_627e5fd97c2e29cc0018c6ed8d425ec6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_8feeb0de60c585ef2855b937f4d93d1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3747327,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_31ddfeea7a618e18cabcf462395ce5db.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2912890,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_2928af46ffb9ad3c49b7486d96997037.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2958313,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_5d9b2a1ad57c4ce4de57894e1db59b9b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109398,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_143f70d1010e3ffee9b4e2671605f687.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61a402c8-c884-5d52-9613-8b1344bce439/61a402c8-c884-5d52-9613-8b1344bce439_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52124,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/61/b4611e12f7c5784110de0ba330403fdf/pa/MT10040_09400949942c36d70efa0cb0d5a9cf7c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Cactus 1.6 Blue-HDi Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2014}
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT10040%27 HTTP/1.1" 200 None
2026-03-28 12:02:24 [auto1.it] INFO: Saving data for MT10040: {'created_time': 1774699344.279577, 'last_price_update_time': 1774699344.279587, 'auction_closing_time': 1774886252.0}
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MT10040') HTTP/1.1" 204 0
2026-03-28 12:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_bebd9ac35b4f03f67561184e959f89aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_68e6389cec40e9159e890126a4623ad2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB09244> (referer: https://www.auto1.com/v1/car-details-view/NB09244/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d53a810>
2026-03-28 12:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_3e73a1cb933b5ea28c9da0eff72478ac.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_3e73a1cb933b5ea28c9da0eff72478ac.jpg saved to cache
2026-03-28 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 731c32ee-a2d2-5cf9-979a-6508c2353c30
2026-03-28 12:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c835110>
2026-03-28 12:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_f1dfbe213de7c62f59b61ab8c76b1944.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_f1dfbe213de7c62f59b61ab8c76b1944.jpg saved to cache
2026-03-28 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2438c3d8-067e-54db-a38b-4f1ea98b84b9
2026-03-28 12:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d46d0d0>
2026-03-28 12:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_bebd9ac35b4f03f67561184e959f89aa.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_bebd9ac35b4f03f67561184e959f89aa.jpg saved to cache
2026-03-28 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2438c3d8-067e-54db-a38b-4f1ea98b84b9
2026-03-28 12:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb6cd10>
2026-03-28 12:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_68e6389cec40e9159e890126a4623ad2.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_68e6389cec40e9159e890126a4623ad2.jpg saved to cache
2026-03-28 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31af8902-6ab9-5e91-99cf-27af1819c286
2026-03-28 12:02:24 [auto1.it] INFO: Channel: 24h | Page: 14 | totalHits: 3673 | hits on page: 40
2026-03-28 12:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48bac360-dc15-575a-bd12-dcf27bc8f82e with identifier: NB09244
2026-03-28 12:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48bac360-dc15-575a-bd12-dcf27bc8f82e with scrape type 1
2026-03-28 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 48bac360-dc15-575a-bd12-dcf27bc8f82e
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_ca2b8f9d87baf458fec4ae4124989983.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_ca2b8f9d87baf458fec4ae4124989983.jpg not downloaded yet
2026-03-28 12:02:24 [auto1.it] INFO: Found listing with ID: YF31693
2026-03-28 12:02:24 [auto1.it] INFO: Found listing with ID: ZR65304
2026-03-28 12:02:24 [auto1.it] INFO: Found listing with ID: AA46193
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA46193%27 HTTP/1.1" 200 None
2026-03-28 12:02:24 [auto1.it] INFO: Scrape type for AA46193: 0
2026-03-28 12:02:24 [auto1.it] INFO: Found listing with ID: XC79515
2026-03-28 12:02:24 [auto1.it] INFO: Found listing with ID: SH22107
2026-03-28 12:02:24 [auto1.it] INFO: Found listing with ID: WD83298
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD83298%27 HTTP/1.1" 200 None
2026-03-28 12:02:24 [auto1.it] INFO: Scrape type for WD83298: 0
2026-03-28 12:02:24 [auto1.it] INFO: Found listing with ID: XH35372
2026-03-28 12:02:24 [auto1.it] INFO: Found listing with ID: GK72900
2026-03-28 12:02:24 [auto1.it] INFO: Found listing with ID: YT99583
2026-03-28 12:02:24 [auto1.it] INFO: Found listing with ID: DP98700
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP98700%27 HTTP/1.1" 200 None
2026-03-28 12:02:24 [auto1.it] INFO: Scrape type for DP98700: 0
2026-03-28 12:02:24 [auto1.it] INFO: Found listing with ID: LZ50355
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ50355%27 HTTP/1.1" 200 None
2026-03-28 12:02:24 [auto1.it] INFO: Scrape type for LZ50355: 0
2026-03-28 12:02:24 [auto1.it] INFO: Found listing with ID: JP72281
2026-03-28 12:02:24 [auto1.it] INFO: Found listing with ID: AS43039
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS43039%27 HTTP/1.1" 200 None
2026-03-28 12:02:24 [auto1.it] INFO: Scrape type for AS43039: 2
2026-03-28 12:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2f73dc1-e4a1-5d04-b8f7-a092f1a5e4bd with identifier: AS43039
2026-03-28 12:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2f73dc1-e4a1-5d04-b8f7-a092f1a5e4bd with scrape type 2
2026-03-28 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2f73dc1-e4a1-5d04-b8f7-a092f1a5e4bd with scrape type 2
2026-03-28 12:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d2f73dc1-e4a1-5d04-b8f7-a092f1a5e4bd, identifier: AS43039
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_ab1f4a9839c7f333bc96be0553f9e4be.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_ab1f4a9839c7f333bc96be0553f9e4be.jpg not downloaded yet
2026-03-28 12:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d2f73dc1-e4a1-5d04-b8f7-a092f1a5e4bd with identifier: AS43039
2026-03-28 12:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d2f73dc1-e4a1-5d04-b8f7-a092f1a5e4bd with identifier: AS43039
2026-03-28 12:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d2f73dc1-e4a1-5d04-b8f7-a092f1a5e4bd with identifier: AS43039 to the API
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:30:04Z',
'fuel_type': 'petrol',
'id': 'd2f73dc1-e4a1-5d04-b8f7-a092f1a5e4bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS43039',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 50795,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-29',
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Max',
'transmission': 'automatic',
'trim': 'Max',
'year': 2024}
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS43039%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.it] INFO: Saving data for AS43039: {'auction_closing_time': 1774715404.0, 'created_time': 1774515663.124133, 'last_price_update_time': 1774699345.113109}
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AS43039') HTTP/1.1" 204 0
2026-03-28 12:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_375ce04b5d53db76656d7c3856d6a39a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: MH72386
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: KX04923
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX04923%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.it] INFO: Scrape type for KX04923: 0
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: XW72958
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: WL97433
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL97433%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.it] INFO: Scrape type for WL97433: 0
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: HH27298
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: JP60910
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP60910%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.it] INFO: Scrape type for JP60910: 0
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: MS15959
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS15959%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.it] INFO: Scrape type for MS15959: 0
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: UB22158
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB22158%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.it] INFO: Scrape type for UB22158: 0
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: VT21354
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT21354%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.it] INFO: Scrape type for VT21354: 0
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: JZ95441
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: HV53293
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV53293%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.it] INFO: Scrape type for HV53293: 0
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: WZ40427
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ40427%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.it] INFO: Scrape type for WZ40427: 0
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: DR60838
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: BF36974
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF36974%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.it] INFO: Scrape type for BF36974: 0
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: JP22966
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP22966%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.it] INFO: Scrape type for JP22966: 0
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: LG94393
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: HP74394
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: ME64112
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: TP47880
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP47880%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.it] INFO: Scrape type for TP47880: 2
2026-03-28 12:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01484e9d-ccda-5d56-a527-7da01988bae1 with identifier: TP47880
2026-03-28 12:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01484e9d-ccda-5d56-a527-7da01988bae1 with scrape type 2
2026-03-28 12:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01484e9d-ccda-5d56-a527-7da01988bae1 with scrape type 2
2026-03-28 12:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 01484e9d-ccda-5d56-a527-7da01988bae1, identifier: TP47880
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_45fd9d8b5fb5f01b7e5f4a9b6a416433.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_45fd9d8b5fb5f01b7e5f4a9b6a416433.jpg not downloaded yet
2026-03-28 12:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_7531c7822a954f258d0a8334059fa8b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_77e92b2fd411c2bdafeb723a443b43de.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 01484e9d-ccda-5d56-a527-7da01988bae1 with identifier: TP47880
2026-03-28 12:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 01484e9d-ccda-5d56-a527-7da01988bae1 with identifier: TP47880
2026-03-28 12:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 01484e9d-ccda-5d56-a527-7da01988bae1 with identifier: TP47880 to the API
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:42:43Z',
'fuel_type': 'diesel',
'id': '01484e9d-ccda-5d56-a527-7da01988bae1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP47880',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 52917,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-28',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 250 CDI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2010}
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP47880%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.it] INFO: Saving data for TP47880: {'auction_closing_time': 1774716163.0, 'created_time': 1774515633.461503, 'last_price_update_time': 1774699345.851741}
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TP47880') HTTP/1.1" 204 0
2026-03-28 12:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: YJ46375
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ46375%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.it] INFO: Scrape type for YJ46375: 0
2026-03-28 12:02:25 [auto1.it] INFO: Found listing with ID: PF40120
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF40120%27 HTTP/1.1" 200 None
2026-03-28 12:02:26 [auto1.it] INFO: Scrape type for PF40120: 0
2026-03-28 12:02:26 [auto1.it] INFO: Found listing with ID: HX55945
2026-03-28 12:02:26 [auto1.it] INFO: Found listing with ID: HT98795
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT98795%27 HTTP/1.1" 200 None
2026-03-28 12:02:26 [auto1.it] INFO: Scrape type for HT98795: 0
2026-03-28 12:02:26 [auto1.it] INFO: Found listing with ID: PH46734
2026-03-28 12:02:26 [auto1.it] INFO: Found listing with ID: EE49908
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE49908%27 HTTP/1.1" 200 None
2026-03-28 12:02:26 [auto1.it] INFO: Scrape type for EE49908: 0
2026-03-28 12:02:26 [auto1.it] INFO: Found listing with ID: VC73391
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC73391%27 HTTP/1.1" 200 None
2026-03-28 12:02:26 [auto1.it] INFO: Scrape type for VC73391: 0
2026-03-28 12:02:26 [auto1.it] INFO: Found listing with ID: SP57651
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP57651%27 HTTP/1.1" 200 None
2026-03-28 12:02:26 [auto1.it] INFO: Scrape type for SP57651: 0
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_2579f7a25d2e622662ec9eea64314e5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_2579f7a25d2e622662ec9eea64314e5a.jpg not downloaded yet
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_aa01bc8a4e308bf447e02d579174baab.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_aa01bc8a4e308bf447e02d579174baab.jpg not downloaded yet
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cabd410>
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_375ce04b5d53db76656d7c3856d6a39a.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_375ce04b5d53db76656d7c3856d6a39a.jpg saved to cache
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2438c3d8-067e-54db-a38b-4f1ea98b84b9
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d442f90>
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_7531c7822a954f258d0a8334059fa8b5.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_7531c7822a954f258d0a8334059fa8b5.jpg saved to cache
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 731c32ee-a2d2-5cf9-979a-6508c2353c30
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca22c90>
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_77e92b2fd411c2bdafeb723a443b43de.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_77e92b2fd411c2bdafeb723a443b43de.jpg saved to cache
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31af8902-6ab9-5e91-99cf-27af1819c286
2026-03-28 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_f29aa8c93db56fbf5fafd6608a5c565c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_6e7da211fbfaa7595ae57792028d9bdc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_7621205bdb3f26ce65f519bb8a24c539.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_7621205bdb3f26ce65f519bb8a24c539.jpg not downloaded yet
2026-03-28 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_2020627636fa13d1005fe265cdce1cd5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_30edca0a0b13bf9fb274753528b5b96b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_30edca0a0b13bf9fb274753528b5b96b.jpg not downloaded yet
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_050caffa5c2b24a1d9e6b5dc4d6a5430.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_050caffa5c2b24a1d9e6b5dc4d6a5430.jpg not downloaded yet
2026-03-28 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_4dd8c8bcb6e195c6eb8a6b8d8b55dc8b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_03eaaebdf25afc54e4ab034cb11ed35e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_fac35981fcbd9b9d02fe7173e2f169b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_fac35981fcbd9b9d02fe7173e2f169b2.jpg not downloaded yet
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_24d9662d47dfcc9a2e7a9d0ae1f7761f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_24d9662d47dfcc9a2e7a9d0ae1f7761f.jpg not downloaded yet
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c958c50>
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_f29aa8c93db56fbf5fafd6608a5c565c.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_f29aa8c93db56fbf5fafd6608a5c565c.jpg saved to cache
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 731c32ee-a2d2-5cf9-979a-6508c2353c30
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c983b50>
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_6e7da211fbfaa7595ae57792028d9bdc.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_6e7da211fbfaa7595ae57792028d9bdc.jpg saved to cache
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2438c3d8-067e-54db-a38b-4f1ea98b84b9
2026-03-28 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_659571afe8f94ed46680eb7f9bf3d948.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_3519a969af83f2070b7619932ceccad6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_5208de06823989c4a500f5f1b27d50e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d452ed0>
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_2020627636fa13d1005fe265cdce1cd5.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_2020627636fa13d1005fe265cdce1cd5.jpg saved to cache
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31af8902-6ab9-5e91-99cf-27af1819c286
2026-03-28 12:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d6e0390>
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_4dd8c8bcb6e195c6eb8a6b8d8b55dc8b.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_4dd8c8bcb6e195c6eb8a6b8d8b55dc8b.jpg saved to cache
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 731c32ee-a2d2-5cf9-979a-6508c2353c30
2026-03-28 12:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d443b10>
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_03eaaebdf25afc54e4ab034cb11ed35e.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_03eaaebdf25afc54e4ab034cb11ed35e.jpg saved to cache
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 731c32ee-a2d2-5cf9-979a-6508c2353c30
2026-03-28 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_5897060d1fc24f118e7c099c3f4a14df.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_ab1f4a9839c7f333bc96be0553f9e4be.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_29c39dcff9d0299333f86019aa7fe137.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_ca2b8f9d87baf458fec4ae4124989983.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d49e290>
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_659571afe8f94ed46680eb7f9bf3d948.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_659571afe8f94ed46680eb7f9bf3d948.jpg saved to cache
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2438c3d8-067e-54db-a38b-4f1ea98b84b9
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3caed8d0>
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_727d9e13-3d17-57e6-a863-fb4c5c13ecc5/727d9e13-3d17-57e6-a863-fb4c5c13ecc5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F94%252F8f94cac7e22b69f0de6acecc45589fb5%252Fpa%252FEV59116_3519a969af83f2070b7619932ceccad6.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_3519a969af83f2070b7619932ceccad6.jpg saved to cache
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 727d9e13-3d17-57e6-a863-fb4c5c13ecc5
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4a0390>
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8c81491-fa63-5f3a-863f-9e97f3c64ae3/a8c81491-fa63-5f3a-863f-9e97f3c64ae3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fde%252F0bde6df7bde0626096e0c30873c52677%252Fpa%252FKH13960_5208de06823989c4a500f5f1b27d50e6.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_5208de06823989c4a500f5f1b27d50e6.jpg saved to cache
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8c81491-fa63-5f3a-863f-9e97f3c64ae3
2026-03-28 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_3c265f933d21e6696086082ed6707cec.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_aa01bc8a4e308bf447e02d579174baab.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_45fd9d8b5fb5f01b7e5f4a9b6a416433.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_2579f7a25d2e622662ec9eea64314e5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb345d0>
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_5897060d1fc24f118e7c099c3f4a14df.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_5897060d1fc24f118e7c099c3f4a14df.jpg saved to cache
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 731c32ee-a2d2-5cf9-979a-6508c2353c30
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cabe7d0>
2026-03-28 12:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_ab1f4a9839c7f333bc96be0553f9e4be.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_ab1f4a9839c7f333bc96be0553f9e4be.jpg saved to cache
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 48bac360-dc15-575a-bd12-dcf27bc8f82e
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4d5810>
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_29c39dcff9d0299333f86019aa7fe137.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_29c39dcff9d0299333f86019aa7fe137.jpg saved to cache
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31af8902-6ab9-5e91-99cf-27af1819c286
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca4e390>
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_ca2b8f9d87baf458fec4ae4124989983.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_ca2b8f9d87baf458fec4ae4124989983.jpg saved to cache
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48bac360-dc15-575a-bd12-dcf27bc8f82e
2026-03-28 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_24d9662d47dfcc9a2e7a9d0ae1f7761f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_30edca0a0b13bf9fb274753528b5b96b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_050caffa5c2b24a1d9e6b5dc4d6a5430.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_22035c777eb204116590fb68e4014040.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d44be50>
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_3c265f933d21e6696086082ed6707cec.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_3c265f933d21e6696086082ed6707cec.jpg saved to cache
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31af8902-6ab9-5e91-99cf-27af1819c286
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cae2090>
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_aa01bc8a4e308bf447e02d579174baab.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_aa01bc8a4e308bf447e02d579174baab.jpg saved to cache
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 48bac360-dc15-575a-bd12-dcf27bc8f82e
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbd4590>
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_45fd9d8b5fb5f01b7e5f4a9b6a416433.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_45fd9d8b5fb5f01b7e5f4a9b6a416433.jpg saved to cache
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 48bac360-dc15-575a-bd12-dcf27bc8f82e
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7f6510>
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_2579f7a25d2e622662ec9eea64314e5a.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_2579f7a25d2e622662ec9eea64314e5a.jpg saved to cache
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 48bac360-dc15-575a-bd12-dcf27bc8f82e
2026-03-28 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_fac35981fcbd9b9d02fe7173e2f169b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_39cb536609d6004d214c16ff0ef9db7f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_7621205bdb3f26ce65f519bb8a24c539.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_4dd56373c61ea703ce50ca488683896c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_323e6340a92c78774577ef453e0ced83.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_d75ac7d430da7db2f0a771077299522e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb71910>
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_24d9662d47dfcc9a2e7a9d0ae1f7761f.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_24d9662d47dfcc9a2e7a9d0ae1f7761f.jpg saved to cache
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 48bac360-dc15-575a-bd12-dcf27bc8f82e
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4cf910>
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_30edca0a0b13bf9fb274753528b5b96b.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_30edca0a0b13bf9fb274753528b5b96b.jpg saved to cache
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 48bac360-dc15-575a-bd12-dcf27bc8f82e
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7ac810>
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_050caffa5c2b24a1d9e6b5dc4d6a5430.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_050caffa5c2b24a1d9e6b5dc4d6a5430.jpg saved to cache
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 48bac360-dc15-575a-bd12-dcf27bc8f82e
2026-03-28 12:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d65e3d0>
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_22035c777eb204116590fb68e4014040.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_22035c777eb204116590fb68e4014040.jpg saved to cache
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 731c32ee-a2d2-5cf9-979a-6508c2353c30
2026-03-28 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_72e0ef6334494e77eaf0d17cdadac5e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_9cd6c3697028698cb5d40fab56016718.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_1f89f762711356277ab8f01c622277c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_ceecdcd7407749960a1dd47491e568fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_c8af1fb23729b3b8066ef65046df52e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_ad1d3d2a6e2662696b0673e82e65f24b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4cab10>
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_fac35981fcbd9b9d02fe7173e2f169b2.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_fac35981fcbd9b9d02fe7173e2f169b2.jpg saved to cache
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 48bac360-dc15-575a-bd12-dcf27bc8f82e
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca6e010>
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_39cb536609d6004d214c16ff0ef9db7f.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_39cb536609d6004d214c16ff0ef9db7f.jpg saved to cache
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2438c3d8-067e-54db-a38b-4f1ea98b84b9
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbb47d0>
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fd2%252F04d29f054f4481009b20f362fd177288%252Fpa%252FNB09244_7621205bdb3f26ce65f519bb8a24c539.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_7621205bdb3f26ce65f519bb8a24c539.jpg saved to cache
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 48bac360-dc15-575a-bd12-dcf27bc8f82e
2026-03-28 12:02:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48bac360-dc15-575a-bd12-dcf27bc8f82e, skipping ID generation
2026-03-28 12:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48bac360-dc15-575a-bd12-dcf27bc8f82e with scrape type 1
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48bac360-dc15-575a-bd12-dcf27bc8f82e sending to next pipeline
2026-03-28 12:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 48bac360-dc15-575a-bd12-dcf27bc8f82e, identifier: NB09244
2026-03-28 12:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7ab290>
2026-03-28 12:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_727d9e13-3d17-57e6-a863-fb4c5c13ecc5/727d9e13-3d17-57e6-a863-fb4c5c13ecc5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F94%252F8f94cac7e22b69f0de6acecc45589fb5%252Fpa%252FEV59116_4dd56373c61ea703ce50ca488683896c.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_4dd56373c61ea703ce50ca488683896c.jpg saved to cache
2026-03-28 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 727d9e13-3d17-57e6-a863-fb4c5c13ecc5
2026-03-28 12:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb6f250>
2026-03-28 12:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_323e6340a92c78774577ef453e0ced83.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_323e6340a92c78774577ef453e0ced83.jpg saved to cache
2026-03-28 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 731c32ee-a2d2-5cf9-979a-6508c2353c30
2026-03-28 12:02:28 [auto1.it] INFO: Channel: 24h | Page: 15 | totalHits: 3673 | hits on page: 40
2026-03-28 12:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c834ad0>
2026-03-28 12:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_d75ac7d430da7db2f0a771077299522e.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_d75ac7d430da7db2f0a771077299522e.jpg saved to cache
2026-03-28 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31af8902-6ab9-5e91-99cf-27af1819c286
2026-03-28 12:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 48bac360-dc15-575a-bd12-dcf27bc8f82e with identifier: NB09244
2026-03-28 12:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 48bac360-dc15-575a-bd12-dcf27bc8f82e with identifier: NB09244
2026-03-28 12:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 48bac360-dc15-575a-bd12-dcf27bc8f82e with identifier: NB09244 to the API
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_7621205bdb3f26ce65f519bb8a24c539.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.1L',
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:27:40Z',
'fuel_type': 'diesel',
'id': '48bac360-dc15-575a-bd12-dcf27bc8f82e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB09244',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 262236,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65360,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_ca2b8f9d87baf458fec4ae4124989983.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_ab1f4a9839c7f333bc96be0553f9e4be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54161,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_45fd9d8b5fb5f01b7e5f4a9b6a416433.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_2579f7a25d2e622662ec9eea64314e5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48358,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_aa01bc8a4e308bf447e02d579174baab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_7621205bdb3f26ce65f519bb8a24c539.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44655,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_30edca0a0b13bf9fb274753528b5b96b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59985,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_050caffa5c2b24a1d9e6b5dc4d6a5430.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62413,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_fac35981fcbd9b9d02fe7173e2f169b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48bac360-dc15-575a-bd12-dcf27bc8f82e/48bac360-dc15-575a-bd12-dcf27bc8f82e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48588,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/d2/04d29f054f4481009b20f362fd177288/pa/NB09244_24d9662d47dfcc9a2e7a9d0ae1f7761f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Shooting Brake 4Matic Premium',
'transmission': 'automatic',
'trim': '4Matic Premium',
'year': 2017}
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB09244%27 HTTP/1.1" 200 None
2026-03-28 12:02:28 [auto1.it] INFO: Saving data for NB09244: {'created_time': 1774699348.540076, 'last_price_update_time': 1774699348.540092, 'auction_closing_time': 1774884460.0}
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NB09244') HTTP/1.1" 204 0
2026-03-28 12:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_2e2a94c820710db3fba9ecea2b804a05.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_898e7571d38ee27c85538c19d986aaa4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:28 [auto1.it] INFO: Found listing with ID: TP78592
2026-03-28 12:02:28 [auto1.it] INFO: Found listing with ID: AJ45475
2026-03-28 12:02:28 [auto1.it] INFO: Found listing with ID: EN15125
2026-03-28 12:02:28 [auto1.it] INFO: Found listing with ID: GU66352
2026-03-28 12:02:28 [auto1.it] INFO: Found listing with ID: KN87461
2026-03-28 12:02:28 [auto1.it] INFO: Found listing with ID: DY04825
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY04825%27 HTTP/1.1" 200 None
2026-03-28 12:02:28 [auto1.it] INFO: Scrape type for DY04825: 0
2026-03-28 12:02:28 [auto1.it] INFO: Found listing with ID: NE32372
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE32372%27 HTTP/1.1" 200 None
2026-03-28 12:02:28 [auto1.it] INFO: Scrape type for NE32372: 0
2026-03-28 12:02:28 [auto1.it] INFO: Found listing with ID: XR49803
2026-03-28 12:02:28 [auto1.it] INFO: Found listing with ID: WM63577
2026-03-28 12:02:28 [auto1.it] INFO: Found listing with ID: GV52121
2026-03-28 12:02:28 [auto1.it] INFO: Found listing with ID: JP45376
2026-03-28 12:02:28 [auto1.it] INFO: Found listing with ID: US40525
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US40525%27 HTTP/1.1" 200 None
2026-03-28 12:02:28 [auto1.it] INFO: Scrape type for US40525: 2
2026-03-28 12:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9708b0a1-93b7-57a6-aedd-33f98dae64d5 with identifier: US40525
2026-03-28 12:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9708b0a1-93b7-57a6-aedd-33f98dae64d5 with scrape type 2
2026-03-28 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9708b0a1-93b7-57a6-aedd-33f98dae64d5 with scrape type 2
2026-03-28 12:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9708b0a1-93b7-57a6-aedd-33f98dae64d5, identifier: US40525
2026-03-28 12:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_8246c970d3bac28540a7dd9d8818ae0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_0f2a26da1a2911896a14b4015e6b60b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9708b0a1-93b7-57a6-aedd-33f98dae64d5 with identifier: US40525
2026-03-28 12:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9708b0a1-93b7-57a6-aedd-33f98dae64d5 with identifier: US40525
2026-03-28 12:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9708b0a1-93b7-57a6-aedd-33f98dae64d5 with identifier: US40525 to the API
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:32:25Z',
'fuel_type': 'diesel',
'id': '9708b0a1-93b7-57a6-aedd-33f98dae64d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US40525',
'listing': 'auction',
'make': 'Honda',
'model': 'CR-V',
'odometer': 249412,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-19',
'seller_name': None,
'title': 'Honda CR-V 1.6 DTEC Elegance 2WD',
'transmission': 'manual',
'trim': 'Elegance 2WD',
'year': 2013}
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US40525%27 HTTP/1.1" 200 None
2026-03-28 12:02:29 [auto1.it] INFO: Saving data for US40525: {'auction_closing_time': 1774715545.0, 'created_time': 1774515628.780989, 'last_price_update_time': 1774699349.066559}
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='US40525') HTTP/1.1" 204 0
2026-03-28 12:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_ab1703bd9a7d3f478ae8706374b1a593.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_477a071263c315d2011c59f32b88368e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_970e4517deada8b02d0bf0d914b78f7a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: MJ86480
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: ZJ84308
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: FE03475
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE03475%27 HTTP/1.1" 200 None
2026-03-28 12:02:29 [auto1.it] INFO: Scrape type for FE03475: 0
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: MW97099
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW97099%27 HTTP/1.1" 200 None
2026-03-28 12:02:29 [auto1.it] INFO: Scrape type for MW97099: 0
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: EU82988
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: BE00286
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: MC12015
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: AW62695
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: SK48941
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK48941%27 HTTP/1.1" 200 None
2026-03-28 12:02:29 [auto1.it] INFO: Scrape type for SK48941: 0
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: CM36340
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: CZ82762
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: SB02789
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: NA90799
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA90799%27 HTTP/1.1" 200 None
2026-03-28 12:02:29 [auto1.it] INFO: Scrape type for NA90799: 0
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: YN65512
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN65512%27 HTTP/1.1" 200 None
2026-03-28 12:02:29 [auto1.it] INFO: Scrape type for YN65512: 0
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: GG10303
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG10303%27 HTTP/1.1" 200 None
2026-03-28 12:02:29 [auto1.it] INFO: Scrape type for GG10303: 0
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: WR41361
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: SE28120
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: MG07654
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG07654%27 HTTP/1.1" 200 None
2026-03-28 12:02:29 [auto1.it] INFO: Scrape type for MG07654: 0
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: TP85930
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: MM75159
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: NK94790
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK94790%27 HTTP/1.1" 200 None
2026-03-28 12:02:29 [auto1.it] INFO: Scrape type for NK94790: 0
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: TG60202
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: MF09411
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MF09411%27 HTTP/1.1" 200 None
2026-03-28 12:02:29 [auto1.it] INFO: Scrape type for MF09411: 0
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: ZR48768
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR48768%27 HTTP/1.1" 200 None
2026-03-28 12:02:29 [auto1.it] INFO: Scrape type for ZR48768: 0
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: VA22015
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: RJ99533
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ99533%27 HTTP/1.1" 200 None
2026-03-28 12:02:29 [auto1.it] INFO: Scrape type for RJ99533: 0
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: MW88015
2026-03-28 12:02:29 [auto1.it] INFO: Found listing with ID: BZ76072
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbb5a90>
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fd1%252Ff5d1eac6d6897f15100aca1bb4624e0a%252Fpa%252FVL91397_72e0ef6334494e77eaf0d17cdadac5e0.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_72e0ef6334494e77eaf0d17cdadac5e0.jpg saved to cache
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2438c3d8-067e-54db-a38b-4f1ea98b84b9
2026-03-28 12:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2438c3d8-067e-54db-a38b-4f1ea98b84b9, skipping ID generation
2026-03-28 12:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2438c3d8-067e-54db-a38b-4f1ea98b84b9 with scrape type 1
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2438c3d8-067e-54db-a38b-4f1ea98b84b9 sending to next pipeline
2026-03-28 12:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2438c3d8-067e-54db-a38b-4f1ea98b84b9, identifier: VL91397
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca65490>
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_727d9e13-3d17-57e6-a863-fb4c5c13ecc5/727d9e13-3d17-57e6-a863-fb4c5c13ecc5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F94%252F8f94cac7e22b69f0de6acecc45589fb5%252Fpa%252FEV59116_9cd6c3697028698cb5d40fab56016718.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_9cd6c3697028698cb5d40fab56016718.jpg saved to cache
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 727d9e13-3d17-57e6-a863-fb4c5c13ecc5
2026-03-28 12:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 727d9e13-3d17-57e6-a863-fb4c5c13ecc5, skipping ID generation
2026-03-28 12:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 727d9e13-3d17-57e6-a863-fb4c5c13ecc5 with scrape type 1
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 727d9e13-3d17-57e6-a863-fb4c5c13ecc5 sending to next pipeline
2026-03-28 12:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 727d9e13-3d17-57e6-a863-fb4c5c13ecc5, identifier: EV59116
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca4fc50>
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F30%252Fa9309c807174d5f201dd5522046795d7%252Fpa%252FUR17462_1f89f762711356277ab8f01c622277c4.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_1f89f762711356277ab8f01c622277c4.jpg saved to cache
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 731c32ee-a2d2-5cf9-979a-6508c2353c30
2026-03-28 12:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 731c32ee-a2d2-5cf9-979a-6508c2353c30, skipping ID generation
2026-03-28 12:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 731c32ee-a2d2-5cf9-979a-6508c2353c30 with scrape type 1
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 731c32ee-a2d2-5cf9-979a-6508c2353c30 sending to next pipeline
2026-03-28 12:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 731c32ee-a2d2-5cf9-979a-6508c2353c30, identifier: UR17462
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4eed90>
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8c81491-fa63-5f3a-863f-9e97f3c64ae3/a8c81491-fa63-5f3a-863f-9e97f3c64ae3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fde%252F0bde6df7bde0626096e0c30873c52677%252Fpa%252FKH13960_ceecdcd7407749960a1dd47491e568fb.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_ceecdcd7407749960a1dd47491e568fb.jpg saved to cache
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8c81491-fa63-5f3a-863f-9e97f3c64ae3
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb45b90>
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_c8af1fb23729b3b8066ef65046df52e6.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_c8af1fb23729b3b8066ef65046df52e6.jpg saved to cache
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31af8902-6ab9-5e91-99cf-27af1819c286
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4cf550>
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8c81491-fa63-5f3a-863f-9e97f3c64ae3/a8c81491-fa63-5f3a-863f-9e97f3c64ae3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fde%252F0bde6df7bde0626096e0c30873c52677%252Fpa%252FKH13960_ad1d3d2a6e2662696b0673e82e65f24b.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_ad1d3d2a6e2662696b0673e82e65f24b.jpg saved to cache
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8c81491-fa63-5f3a-863f-9e97f3c64ae3
2026-03-28 12:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8c81491-fa63-5f3a-863f-9e97f3c64ae3, skipping ID generation
2026-03-28 12:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8c81491-fa63-5f3a-863f-9e97f3c64ae3 with scrape type 1
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8c81491-fa63-5f3a-863f-9e97f3c64ae3 sending to next pipeline
2026-03-28 12:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a8c81491-fa63-5f3a-863f-9e97f3c64ae3, identifier: KH13960
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c962950>
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99499219-33fa-5c59-ace4-570d5eeefad7/99499219-33fa-5c59-ace4-570d5eeefad7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8db3ec62c4ac46fc322071f363823e%252Fpa%252FEF37813_2e2a94c820710db3fba9ecea2b804a05.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_2e2a94c820710db3fba9ecea2b804a05.jpg saved to cache
2026-03-28 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99499219-33fa-5c59-ace4-570d5eeefad7
2026-03-28 12:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d452390>
2026-03-28 12:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19c65d6-2f92-5910-97de-dff7a3ffa16a/e19c65d6-2f92-5910-97de-dff7a3ffa16a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F84%252F2c84af9f4b4d0fe77df23dfe89d25e61%252Fpa%252FNR40821_898e7571d38ee27c85538c19d986aaa4.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_898e7571d38ee27c85538c19d986aaa4.jpg saved to cache
2026-03-28 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e19c65d6-2f92-5910-97de-dff7a3ffa16a
2026-03-28 12:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_8270c2966cfc5b040958dcd4236155a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_ae6b17e01cbcda2df2512b34ca0c2f45.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2438c3d8-067e-54db-a38b-4f1ea98b84b9 with identifier: VL91397
2026-03-28 12:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2438c3d8-067e-54db-a38b-4f1ea98b84b9 with identifier: VL91397
2026-03-28 12:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2438c3d8-067e-54db-a38b-4f1ea98b84b9 with identifier: VL91397 to the API
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_72e0ef6334494e77eaf0d17cdadac5e0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.9L',
'engine_horse_power': 194,
'expiration_date': '2026-03-30T15:43:29Z',
'fuel_type': 'diesel',
'id': '2438c3d8-067e-54db-a38b-4f1ea98b84b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL91397',
'listing': 'auction',
'location': 'IT, Bologna',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 92548,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_02151ff5b48ee4d45fe824815f0520d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66019,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_b806be097d58035153fd0d1f5c796453.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57264,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_72e0ef6334494e77eaf0d17cdadac5e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50141,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_39cb536609d6004d214c16ff0ef9db7f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55363,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_659571afe8f94ed46680eb7f9bf3d948.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60263,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_54408ddd57b709c056c51eb4c77d6bdd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_6e7da211fbfaa7595ae57792028d9bdc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64873,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_375ce04b5d53db76656d7c3856d6a39a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74398,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_f1dfbe213de7c62f59b61ab8c76b1944.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2438c3d8-067e-54db-a38b-4f1ea98b84b9/2438c3d8-067e-54db-a38b-4f1ea98b84b9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50782,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d1/f5d1eac6d6897f15100aca1bb4624e0a/pa/VL91397_bebd9ac35b4f03f67561184e959f89aa.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-02',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d Sport Plus',
'transmission': 'automatic',
'trim': 'Sport Plus',
'year': 2020}
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL91397%27 HTTP/1.1" 200 None
2026-03-28 12:02:30 [auto1.it] INFO: Saving data for VL91397: {'created_time': 1774699350.428686, 'last_price_update_time': 1774699350.428697, 'auction_closing_time': 1774885409.0}
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VL91397') HTTP/1.1" 204 0
2026-03-28 12:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 727d9e13-3d17-57e6-a863-fb4c5c13ecc5 with identifier: EV59116
2026-03-28 12:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 727d9e13-3d17-57e6-a863-fb4c5c13ecc5 with identifier: EV59116
2026-03-28 12:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 727d9e13-3d17-57e6-a863-fb4c5c13ecc5 with identifier: EV59116 to the API
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_9cd6c3697028698cb5d40fab56016718.jpg>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 3',
'engine': '1.9L',
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:07:01Z',
'fuel_type': 'diesel',
'id': '727d9e13-3d17-57e6-a863-fb4c5c13ecc5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV59116',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Volvo',
'model': 'V40',
'odometer': 151916,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_727d9e13-3d17-57e6-a863-fb4c5c13ecc5/727d9e13-3d17-57e6-a863-fb4c5c13ecc5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_022c7618e6412bd8f2c2789873b28a5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_727d9e13-3d17-57e6-a863-fb4c5c13ecc5/727d9e13-3d17-57e6-a863-fb4c5c13ecc5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67198,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_6554596898eabff2465298172e885983.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_727d9e13-3d17-57e6-a863-fb4c5c13ecc5/727d9e13-3d17-57e6-a863-fb4c5c13ecc5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_9cd6c3697028698cb5d40fab56016718.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_727d9e13-3d17-57e6-a863-fb4c5c13ecc5/727d9e13-3d17-57e6-a863-fb4c5c13ecc5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53162,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_4dd56373c61ea703ce50ca488683896c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_727d9e13-3d17-57e6-a863-fb4c5c13ecc5/727d9e13-3d17-57e6-a863-fb4c5c13ecc5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/94/8f94cac7e22b69f0de6acecc45589fb5/pa/EV59116_3519a969af83f2070b7619932ceccad6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2001-09-19',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V40 1.9 D',
'transmission': 'manual',
'trim': '',
'year': 2001}
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV59116%27 HTTP/1.1" 200 None
2026-03-28 12:02:30 [auto1.it] INFO: Saving data for EV59116: {'created_time': 1774699350.896354, 'last_price_update_time': 1774699350.896365, 'auction_closing_time': 1774883221.0}
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EV59116') HTTP/1.1" 204 0
2026-03-28 12:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 731c32ee-a2d2-5cf9-979a-6508c2353c30 with identifier: UR17462
2026-03-28 12:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 731c32ee-a2d2-5cf9-979a-6508c2353c30 with identifier: UR17462
2026-03-28 12:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 731c32ee-a2d2-5cf9-979a-6508c2353c30 with identifier: UR17462 to the API
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_1f89f762711356277ab8f01c622277c4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 94,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6B',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:48:05Z',
'fuel_type': 'petrol',
'id': '731c32ee-a2d2-5cf9-979a-6508c2353c30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR17462',
'listing': 'auction',
'location': 'IT, Roma RM',
'make': 'Smart',
'model': 'fortwo',
'odometer': 133641,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2256700,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_4dd8c8bcb6e195c6eb8a6b8d8b55dc8b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2224145,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_b916745c1b7d3fa7db077de4057325f0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63888,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_1f89f762711356277ab8f01c622277c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_323e6340a92c78774577ef453e0ced83.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50057,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_5897060d1fc24f118e7c099c3f4a14df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2052134,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_03eaaebdf25afc54e4ab034cb11ed35e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_f29aa8c93db56fbf5fafd6608a5c565c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65429,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_7531c7822a954f258d0a8334059fa8b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_3e73a1cb933b5ea28c9da0eff72478ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731c32ee-a2d2-5cf9-979a-6508c2353c30/731c32ee-a2d2-5cf9-979a-6508c2353c30_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2456144,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga9/30/a9309c807174d5f201dd5522046795d7/pa/UR17462_22035c777eb204116590fb68e4014040.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-04-28',
'seats_number': 2,
'seller_name': None,
'title': 'Smart fortwo 1.0 Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2015}
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR17462%27 HTTP/1.1" 200 None
2026-03-28 12:02:31 [auto1.it] INFO: Saving data for UR17462: {'created_time': 1774699351.418143, 'last_price_update_time': 1774699351.418154, 'auction_closing_time': 1774885685.0}
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UR17462') HTTP/1.1" 204 0
2026-03-28 12:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a8c81491-fa63-5f3a-863f-9e97f3c64ae3 with identifier: KH13960
2026-03-28 12:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a8c81491-fa63-5f3a-863f-9e97f3c64ae3 with identifier: KH13960
2026-03-28 12:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a8c81491-fa63-5f3a-863f-9e97f3c64ae3 with identifier: KH13960 to the API
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_ad1d3d2a6e2662696b0673e82e65f24b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:26:46Z',
'fuel_type': 'petrol',
'id': 'a8c81491-fa63-5f3a-863f-9e97f3c64ae3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH13960',
'listing': 'auction',
'location': 'IT, Lallio BG',
'make': 'Opel',
'model': 'Corsa',
'odometer': 137554,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8c81491-fa63-5f3a-863f-9e97f3c64ae3/a8c81491-fa63-5f3a-863f-9e97f3c64ae3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_a56c6f2775b49fab669bf369faeb98bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8c81491-fa63-5f3a-863f-9e97f3c64ae3/a8c81491-fa63-5f3a-863f-9e97f3c64ae3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64039,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_80e5fe096e5b0e6763257df5d7a60684.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8c81491-fa63-5f3a-863f-9e97f3c64ae3/a8c81491-fa63-5f3a-863f-9e97f3c64ae3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76597,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_ad1d3d2a6e2662696b0673e82e65f24b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8c81491-fa63-5f3a-863f-9e97f3c64ae3/a8c81491-fa63-5f3a-863f-9e97f3c64ae3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76092,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_ceecdcd7407749960a1dd47491e568fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8c81491-fa63-5f3a-863f-9e97f3c64ae3/a8c81491-fa63-5f3a-863f-9e97f3c64ae3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75258,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/de/0bde6df7bde0626096e0c30873c52677/pa/KH13960_5208de06823989c4a500f5f1b27d50e6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 Elective',
'transmission': 'manual',
'trim': 'Elective',
'year': 2011}
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH13960%27 HTTP/1.1" 200 None
2026-03-28 12:02:31 [auto1.it] INFO: Saving data for KH13960: {'created_time': 1774699351.817765, 'last_price_update_time': 1774699351.817776, 'auction_closing_time': 1774884406.0}
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KH13960') HTTP/1.1" 204 0
2026-03-28 12:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_c77f37faff04b6d6345d896e0c2b2f5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_8265d311aa95966bec823772346e08e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4ef610>
2026-03-28 12:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99499219-33fa-5c59-ace4-570d5eeefad7/99499219-33fa-5c59-ace4-570d5eeefad7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8db3ec62c4ac46fc322071f363823e%252Fpa%252FEF37813_8246c970d3bac28540a7dd9d8818ae0d.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_8246c970d3bac28540a7dd9d8818ae0d.jpg saved to cache
2026-03-28 12:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99499219-33fa-5c59-ace4-570d5eeefad7
2026-03-28 12:02:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99499219-33fa-5c59-ace4-570d5eeefad7, skipping ID generation
2026-03-28 12:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99499219-33fa-5c59-ace4-570d5eeefad7 with scrape type 1
2026-03-28 12:02:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99499219-33fa-5c59-ace4-570d5eeefad7 sending to next pipeline
2026-03-28 12:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 99499219-33fa-5c59-ace4-570d5eeefad7, identifier: EF37813
2026-03-28 12:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb95410>
2026-03-28 12:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1f7ff3-70a1-5783-b754-315a4f954457/6b1f7ff3-70a1-5783-b754-315a4f954457_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F26%252Fde266645155c607b63ae52b5b0a1d394%252Fpa%252FCN51839_0f2a26da1a2911896a14b4015e6b60b4.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_0f2a26da1a2911896a14b4015e6b60b4.jpg saved to cache
2026-03-28 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b1f7ff3-70a1-5783-b754-315a4f954457
2026-03-28 12:02:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b1f7ff3-70a1-5783-b754-315a4f954457, skipping ID generation
2026-03-28 12:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b1f7ff3-70a1-5783-b754-315a4f954457 with scrape type 1
2026-03-28 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b1f7ff3-70a1-5783-b754-315a4f954457 sending to next pipeline
2026-03-28 12:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6b1f7ff3-70a1-5783-b754-315a4f954457, identifier: CN51839
2026-03-28 12:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3fa469d0>
2026-03-28 12:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd6a59b-6876-5796-9172-f57fbc177e0c/dcd6a59b-6876-5796-9172-f57fbc177e0c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F91%252Fd791be708e3eade407e5d423d79dd578%252Fpa%252FWN91380_ab1703bd9a7d3f478ae8706374b1a593.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_ab1703bd9a7d3f478ae8706374b1a593.jpg saved to cache
2026-03-28 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dcd6a59b-6876-5796-9172-f57fbc177e0c
2026-03-28 12:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7d9750>
2026-03-28 12:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd6a59b-6876-5796-9172-f57fbc177e0c/dcd6a59b-6876-5796-9172-f57fbc177e0c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F91%252Fd791be708e3eade407e5d423d79dd578%252Fpa%252FWN91380_477a071263c315d2011c59f32b88368e.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_477a071263c315d2011c59f32b88368e.jpg saved to cache
2026-03-28 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dcd6a59b-6876-5796-9172-f57fbc177e0c
2026-03-28 12:02:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dcd6a59b-6876-5796-9172-f57fbc177e0c, skipping ID generation
2026-03-28 12:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcd6a59b-6876-5796-9172-f57fbc177e0c with scrape type 1
2026-03-28 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dcd6a59b-6876-5796-9172-f57fbc177e0c sending to next pipeline
2026-03-28 12:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dcd6a59b-6876-5796-9172-f57fbc177e0c, identifier: WN91380
2026-03-28 12:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d4a9390>
2026-03-28 12:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19c65d6-2f92-5910-97de-dff7a3ffa16a/e19c65d6-2f92-5910-97de-dff7a3ffa16a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F84%252F2c84af9f4b4d0fe77df23dfe89d25e61%252Fpa%252FNR40821_970e4517deada8b02d0bf0d914b78f7a.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_970e4517deada8b02d0bf0d914b78f7a.jpg saved to cache
2026-03-28 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e19c65d6-2f92-5910-97de-dff7a3ffa16a
2026-03-28 12:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 99499219-33fa-5c59-ace4-570d5eeefad7 with identifier: EF37813
2026-03-28 12:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 99499219-33fa-5c59-ace4-570d5eeefad7 with identifier: EF37813
2026-03-28 12:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 99499219-33fa-5c59-ace4-570d5eeefad7 with identifier: EF37813 to the API
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_8246c970d3bac28540a7dd9d8818ae0d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 117,
'expiration_date': '2026-03-30T15:33:57Z',
'fuel_type': 'petrol',
'id': '99499219-33fa-5c59-ace4-570d5eeefad7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF37813',
'listing': 'auction',
'location': 'IT, Mariano Comense',
'make': 'Ford',
'model': 'Focus',
'odometer': 142147,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99499219-33fa-5c59-ace4-570d5eeefad7/99499219-33fa-5c59-ace4-570d5eeefad7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_8246c970d3bac28540a7dd9d8818ae0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99499219-33fa-5c59-ace4-570d5eeefad7/99499219-33fa-5c59-ace4-570d5eeefad7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_da42ef4e89084b0cadec6cf4149ac875.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99499219-33fa-5c59-ace4-570d5eeefad7/99499219-33fa-5c59-ace4-570d5eeefad7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_2e2a94c820710db3fba9ecea2b804a05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99499219-33fa-5c59-ace4-570d5eeefad7/99499219-33fa-5c59-ace4-570d5eeefad7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64299,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_06ac722b5982abac49e57f7ffdc694da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99499219-33fa-5c59-ace4-570d5eeefad7/99499219-33fa-5c59-ace4-570d5eeefad7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/8d/ec8db3ec62c4ac46fc322071f363823e/pa/EF37813_e473e8ed73a813e696ea44d259751d3e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.6',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF37813%27 HTTP/1.1" 200 None
2026-03-28 12:02:32 [auto1.it] INFO: Saving data for EF37813: {'created_time': 1774699352.732951, 'last_price_update_time': 1774699352.732966, 'auction_closing_time': 1774884837.0}
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EF37813') HTTP/1.1" 204 0
2026-03-28 12:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6b1f7ff3-70a1-5783-b754-315a4f954457 with identifier: CN51839
2026-03-28 12:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6b1f7ff3-70a1-5783-b754-315a4f954457 with identifier: CN51839
2026-03-28 12:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6b1f7ff3-70a1-5783-b754-315a4f954457 with identifier: CN51839 to the API
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_0f2a26da1a2911896a14b4015e6b60b4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 77,
'expiration_date': '2026-03-30T15:53:40Z',
'fuel_type': 'petrol',
'id': '6b1f7ff3-70a1-5783-b754-315a4f954457',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN51839',
'listing': 'auction',
'location': 'IT, Piacenza',
'make': 'Fiat',
'model': 'Idea',
'odometer': 157353,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1f7ff3-70a1-5783-b754-315a4f954457/6b1f7ff3-70a1-5783-b754-315a4f954457_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_0f2a26da1a2911896a14b4015e6b60b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1f7ff3-70a1-5783-b754-315a4f954457/6b1f7ff3-70a1-5783-b754-315a4f954457_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76192,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_c4520e8b6c455e5e45db7ca925422131.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1f7ff3-70a1-5783-b754-315a4f954457/6b1f7ff3-70a1-5783-b754-315a4f954457_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89665,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_d3f4e28abc8944b1e5ae41491acc9705.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1f7ff3-70a1-5783-b754-315a4f954457/6b1f7ff3-70a1-5783-b754-315a4f954457_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89347,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_49a1d5227524713f4f62ef760a460765.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1f7ff3-70a1-5783-b754-315a4f954457/6b1f7ff3-70a1-5783-b754-315a4f954457_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/26/de266645155c607b63ae52b5b0a1d394/pa/CN51839_fa50a9f81e0e4df1bc430a309d665a38.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-05-24',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Idea 1.4 Active GPL',
'transmission': 'manual',
'trim': 'Active GPL',
'year': 2010}
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN51839%27 HTTP/1.1" 200 None
2026-03-28 12:02:33 [auto1.it] INFO: Saving data for CN51839: {'created_time': 1774699353.157417, 'last_price_update_time': 1774699353.157425, 'auction_closing_time': 1774886020.0}
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CN51839') HTTP/1.1" 204 0
2026-03-28 12:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dcd6a59b-6876-5796-9172-f57fbc177e0c with identifier: WN91380
2026-03-28 12:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dcd6a59b-6876-5796-9172-f57fbc177e0c with identifier: WN91380
2026-03-28 12:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dcd6a59b-6876-5796-9172-f57fbc177e0c with identifier: WN91380 to the API
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_477a071263c315d2011c59f32b88368e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': 'Rental',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:47:49Z',
'fuel_type': 'diesel',
'id': 'dcd6a59b-6876-5796-9172-f57fbc177e0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN91380',
'listing': 'auction',
'location': 'IT, Creazzo VI',
'make': 'Renault',
'model': 'Megane',
'odometer': 239137,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd6a59b-6876-5796-9172-f57fbc177e0c/dcd6a59b-6876-5796-9172-f57fbc177e0c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_ab1703bd9a7d3f478ae8706374b1a593.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd6a59b-6876-5796-9172-f57fbc177e0c/dcd6a59b-6876-5796-9172-f57fbc177e0c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72463,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_477a071263c315d2011c59f32b88368e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd6a59b-6876-5796-9172-f57fbc177e0c/dcd6a59b-6876-5796-9172-f57fbc177e0c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_bf3df18c671b5cc794a6d60d6c8cc6d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd6a59b-6876-5796-9172-f57fbc177e0c/dcd6a59b-6876-5796-9172-f57fbc177e0c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65910,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_70961fee834e01732df41fd3059fb886.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd6a59b-6876-5796-9172-f57fbc177e0c/dcd6a59b-6876-5796-9172-f57fbc177e0c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70899,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/91/d791be708e3eade407e5d423d79dd578/pa/WN91380_d570ecb386d20b5806d8d2181d77ee93.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Wave',
'transmission': 'manual',
'trim': 'Wave',
'year': 2013}
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN91380%27 HTTP/1.1" 200 None
2026-03-28 12:02:33 [auto1.it] INFO: Saving data for WN91380: {'created_time': 1774699353.560922, 'last_price_update_time': 1774699353.560933, 'auction_closing_time': 1774885669.0}
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WN91380') HTTP/1.1" 204 0
2026-03-28 12:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3f531d50>
2026-03-28 12:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19c65d6-2f92-5910-97de-dff7a3ffa16a/e19c65d6-2f92-5910-97de-dff7a3ffa16a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F84%252F2c84af9f4b4d0fe77df23dfe89d25e61%252Fpa%252FNR40821_8270c2966cfc5b040958dcd4236155a2.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_8270c2966cfc5b040958dcd4236155a2.jpg saved to cache
2026-03-28 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e19c65d6-2f92-5910-97de-dff7a3ffa16a
2026-03-28 12:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5ce7d0>
2026-03-28 12:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19c65d6-2f92-5910-97de-dff7a3ffa16a/e19c65d6-2f92-5910-97de-dff7a3ffa16a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F84%252F2c84af9f4b4d0fe77df23dfe89d25e61%252Fpa%252FNR40821_ae6b17e01cbcda2df2512b34ca0c2f45.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_ae6b17e01cbcda2df2512b34ca0c2f45.jpg saved to cache
2026-03-28 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e19c65d6-2f92-5910-97de-dff7a3ffa16a
2026-03-28 12:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca71950>
2026-03-28 12:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19c65d6-2f92-5910-97de-dff7a3ffa16a/e19c65d6-2f92-5910-97de-dff7a3ffa16a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F84%252F2c84af9f4b4d0fe77df23dfe89d25e61%252Fpa%252FNR40821_c77f37faff04b6d6345d896e0c2b2f5a.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_c77f37faff04b6d6345d896e0c2b2f5a.jpg saved to cache
2026-03-28 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e19c65d6-2f92-5910-97de-dff7a3ffa16a
2026-03-28 12:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5cc0d0>
2026-03-28 12:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19c65d6-2f92-5910-97de-dff7a3ffa16a/e19c65d6-2f92-5910-97de-dff7a3ffa16a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F84%252F2c84af9f4b4d0fe77df23dfe89d25e61%252Fpa%252FNR40821_8265d311aa95966bec823772346e08e2.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_8265d311aa95966bec823772346e08e2.jpg saved to cache
2026-03-28 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e19c65d6-2f92-5910-97de-dff7a3ffa16a
2026-03-28 12:02:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e19c65d6-2f92-5910-97de-dff7a3ffa16a, skipping ID generation
2026-03-28 12:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e19c65d6-2f92-5910-97de-dff7a3ffa16a with scrape type 1
2026-03-28 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e19c65d6-2f92-5910-97de-dff7a3ffa16a sending to next pipeline
2026-03-28 12:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e19c65d6-2f92-5910-97de-dff7a3ffa16a, identifier: NR40821
2026-03-28 12:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e19c65d6-2f92-5910-97de-dff7a3ffa16a with identifier: NR40821
2026-03-28 12:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e19c65d6-2f92-5910-97de-dff7a3ffa16a with identifier: NR40821
2026-03-28 12:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e19c65d6-2f92-5910-97de-dff7a3ffa16a with identifier: NR40821 to the API
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_8265d311aa95966bec823772346e08e2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:12:45Z',
'fuel_type': 'diesel',
'id': 'e19c65d6-2f92-5910-97de-dff7a3ffa16a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR40821',
'listing': 'auction',
'location': 'IT, Palermo',
'make': 'Fiat',
'model': '500C',
'odometer': 149179,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19c65d6-2f92-5910-97de-dff7a3ffa16a/e19c65d6-2f92-5910-97de-dff7a3ffa16a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_c77f37faff04b6d6345d896e0c2b2f5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19c65d6-2f92-5910-97de-dff7a3ffa16a/e19c65d6-2f92-5910-97de-dff7a3ffa16a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_8265d311aa95966bec823772346e08e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19c65d6-2f92-5910-97de-dff7a3ffa16a/e19c65d6-2f92-5910-97de-dff7a3ffa16a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_ae6b17e01cbcda2df2512b34ca0c2f45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19c65d6-2f92-5910-97de-dff7a3ffa16a/e19c65d6-2f92-5910-97de-dff7a3ffa16a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70358,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_8270c2966cfc5b040958dcd4236155a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19c65d6-2f92-5910-97de-dff7a3ffa16a/e19c65d6-2f92-5910-97de-dff7a3ffa16a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92976,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_970e4517deada8b02d0bf0d914b78f7a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19c65d6-2f92-5910-97de-dff7a3ffa16a/e19c65d6-2f92-5910-97de-dff7a3ffa16a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/84/2c84af9f4b4d0fe77df23dfe89d25e61/pa/NR40821_898e7571d38ee27c85538c19d986aaa4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-08-31',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500C 1.3 M-Jet ByDiesel',
'transmission': 'manual',
'trim': 'ByDiesel',
'year': 2010}
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR40821%27 HTTP/1.1" 200 None
2026-03-28 12:02:34 [auto1.it] INFO: Saving data for NR40821: {'created_time': 1774699354.242876, 'last_price_update_time': 1774699354.24289, 'auction_closing_time': 1774883565.0}
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR40821') HTTP/1.1" 204 0
2026-03-28 12:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_a1ce9f43ee5b07402ca1d80921ab07ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d772dd0>
2026-03-28 12:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F06%252Fa7068282129cd6079643b63bd4531c57%252Fpa%252FUY41081_a1ce9f43ee5b07402ca1d80921ab07ca.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_a1ce9f43ee5b07402ca1d80921ab07ca.jpg saved to cache
2026-03-28 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31af8902-6ab9-5e91-99cf-27af1819c286
2026-03-28 12:02:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31af8902-6ab9-5e91-99cf-27af1819c286, skipping ID generation
2026-03-28 12:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31af8902-6ab9-5e91-99cf-27af1819c286 with scrape type 1
2026-03-28 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31af8902-6ab9-5e91-99cf-27af1819c286 sending to next pipeline
2026-03-28 12:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 31af8902-6ab9-5e91-99cf-27af1819c286, identifier: UY41081
2026-03-28 12:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 31af8902-6ab9-5e91-99cf-27af1819c286 with identifier: UY41081
2026-03-28 12:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 31af8902-6ab9-5e91-99cf-27af1819c286 with identifier: UY41081
2026-03-28 12:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 31af8902-6ab9-5e91-99cf-27af1819c286 with identifier: UY41081 to the API
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_a1ce9f43ee5b07402ca1d80921ab07ca.jpg>
{'auction_title': '',
'c_o_2_emission_value': 41,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 360,
'expiration_date': '2026-03-30T15:24:36Z',
'fuel_type': 'hybrid',
'id': '31af8902-6ab9-5e91-99cf-27af1819c286',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY41081',
'listing': 'auction',
'location': 'IT, Roma RM',
'make': 'DS Automobiles',
'model': 'DS9',
'odometer': 26040,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_c370f959f00d155934c46c29c04bf3af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 127174,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_16dfea1bc0ec4969d73fcba5602731f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_c8af1fb23729b3b8066ef65046df52e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3463892,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_a1ce9f43ee5b07402ca1d80921ab07ca.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114258,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_29c39dcff9d0299333f86019aa7fe137.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3035147,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_3c265f933d21e6696086082ed6707cec.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102588,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_2020627636fa13d1005fe265cdce1cd5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122072,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_77e92b2fd411c2bdafeb723a443b43de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_68e6389cec40e9159e890126a4623ad2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31af8902-6ab9-5e91-99cf-27af1819c286/31af8902-6ab9-5e91-99cf-27af1819c286_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2809212,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga7/06/a7068282129cd6079643b63bd4531c57/pa/UY41081_d75ac7d430da7db2f0a771077299522e.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS9 1.6 E-Tense Hybrid 4x4 Rivoli +',
'transmission': 'automatic',
'trim': '4x4 Rivoli +',
'year': 2022}
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY41081%27 HTTP/1.1" 200 None
2026-03-28 12:02:35 [auto1.it] INFO: Saving data for UY41081: {'created_time': 1774699355.004392, 'last_price_update_time': 1774699355.004405, 'auction_closing_time': 1774884276.0}
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UY41081') HTTP/1.1" 204 0
2026-03-28 12:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KM72059> (referer: https://www.auto1.com/v1/car-details-view/KM72059/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:35 [auto1.it] INFO: Channel: 24h | Page: 16 | totalHits: 3673 | hits on page: 40
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: MY09959
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: YD29186
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD29186%27 HTTP/1.1" 200 None
2026-03-28 12:02:35 [auto1.it] INFO: Scrape type for YD29186: 0
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: TJ75665
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ75665%27 HTTP/1.1" 200 None
2026-03-28 12:02:35 [auto1.it] INFO: Scrape type for TJ75665: 0
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: MC88266
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC88266%27 HTTP/1.1" 200 None
2026-03-28 12:02:35 [auto1.it] INFO: Scrape type for MC88266: 0
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: NY04443
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY04443%27 HTTP/1.1" 200 None
2026-03-28 12:02:35 [auto1.it] INFO: Scrape type for NY04443: 0
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: AR32020
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR32020%27 HTTP/1.1" 200 None
2026-03-28 12:02:35 [auto1.it] INFO: Scrape type for AR32020: 0
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: XU30878
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: AZ02575
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ02575%27 HTTP/1.1" 200 None
2026-03-28 12:02:35 [auto1.it] INFO: Scrape type for AZ02575: 0
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: WB02861
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: XT03089
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: XT75480
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: TL73413
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL73413%27 HTTP/1.1" 200 None
2026-03-28 12:02:35 [auto1.it] INFO: Scrape type for TL73413: 2
2026-03-28 12:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94f34a0a-3942-5840-b193-5eb05995167f with identifier: TL73413
2026-03-28 12:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94f34a0a-3942-5840-b193-5eb05995167f with scrape type 2
2026-03-28 12:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94f34a0a-3942-5840-b193-5eb05995167f with scrape type 2
2026-03-28 12:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 94f34a0a-3942-5840-b193-5eb05995167f, identifier: TL73413
2026-03-28 12:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 94f34a0a-3942-5840-b193-5eb05995167f with identifier: TL73413
2026-03-28 12:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 94f34a0a-3942-5840-b193-5eb05995167f with identifier: TL73413
2026-03-28 12:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 94f34a0a-3942-5840-b193-5eb05995167f with identifier: TL73413 to the API
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:14:41Z',
'fuel_type': 'diesel',
'id': '94f34a0a-3942-5840-b193-5eb05995167f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL73413',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 118655,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-16',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi 320 L1 Tourneo Titanium X',
'transmission': 'automatic',
'trim': '320 L1 Tourneo Titanium X',
'year': 2020}
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL73413%27 HTTP/1.1" 200 None
2026-03-28 12:02:35 [auto1.it] INFO: Saving data for TL73413: {'auction_closing_time': 1774714481.0, 'created_time': 1772223597.519158, 'last_price_update_time': 1774699355.661059}
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TL73413') HTTP/1.1" 204 0
2026-03-28 12:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: BZ22923
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: MA55202
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: EA99389
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: AB06670
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB06670%27 HTTP/1.1" 200 None
2026-03-28 12:02:35 [auto1.it] INFO: Scrape type for AB06670: 0
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: HD69020
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD69020%27 HTTP/1.1" 200 None
2026-03-28 12:02:35 [auto1.it] INFO: Scrape type for HD69020: 0
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: DD62614
2026-03-28 12:02:35 [auto1.it] INFO: Found listing with ID: YR53882
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR53882%27 HTTP/1.1" 200 None
2026-03-28 12:02:35 [auto1.it] INFO: Scrape type for YR53882: 2
2026-03-28 12:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70f6d67e-5750-580a-8e1f-043fa06f8a37 with identifier: YR53882
2026-03-28 12:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70f6d67e-5750-580a-8e1f-043fa06f8a37 with scrape type 2
2026-03-28 12:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70f6d67e-5750-580a-8e1f-043fa06f8a37 with scrape type 2
2026-03-28 12:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 70f6d67e-5750-580a-8e1f-043fa06f8a37, identifier: YR53882
2026-03-28 12:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 70f6d67e-5750-580a-8e1f-043fa06f8a37 with identifier: YR53882
2026-03-28 12:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 70f6d67e-5750-580a-8e1f-043fa06f8a37 with identifier: YR53882
2026-03-28 12:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 70f6d67e-5750-580a-8e1f-043fa06f8a37 with identifier: YR53882 to the API
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-28T16:40:40Z',
'fuel_type': 'petrol',
'id': '70f6d67e-5750-580a-8e1f-043fa06f8a37',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR53882',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 227811,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-30',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2011}
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR53882%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.it] INFO: Saving data for YR53882: {'auction_closing_time': 1774716040.0, 'created_time': 1774008083.509588, 'last_price_update_time': 1774699356.321214}
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YR53882') HTTP/1.1" 204 0
2026-03-28 12:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1792e23a-b06c-5aa1-90f7-161b3b28a600 with identifier: KM72059
2026-03-28 12:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1792e23a-b06c-5aa1-90f7-161b3b28a600 with scrape type 1
2026-03-28 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1792e23a-b06c-5aa1-90f7-161b3b28a600
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_846c444eba9a97818da2605337071e5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_846c444eba9a97818da2605337071e5c.jpg not downloaded yet
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: ML25161
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: BY85548
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY85548%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.it] INFO: Scrape type for BY85548: 0
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: AH40154
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: TZ90103
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ90103%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.it] INFO: Scrape type for TZ90103: 0
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: KL07491
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL07491%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.it] INFO: Scrape type for KL07491: 0
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: HH04548
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: VY96828
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: GS67606
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: PV06948
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: ZY29551
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY29551%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.it] INFO: Scrape type for ZY29551: 0
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: RU45122
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU45122%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.it] INFO: Scrape type for RU45122: 0
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: SD07666
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD07666%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.it] INFO: Scrape type for SD07666: 0
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: CM02924
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM02924%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.it] INFO: Scrape type for CM02924: 0
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: DA61571
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: HY12574
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: AR31382
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR31382%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.it] INFO: Scrape type for AR31382: 0
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: BT73754
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT73754%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.it] INFO: Scrape type for BT73754: 0
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: GY59997
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY59997%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.it] INFO: Scrape type for GY59997: 0
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: BR84654
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR84654%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.it] INFO: Scrape type for BR84654: 0
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: JG32335
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG32335%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.it] INFO: Scrape type for JG32335: 0
2026-03-28 12:02:36 [auto1.it] INFO: Found listing with ID: HA49893
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA49893%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.it] INFO: Scrape type for HA49893: 0
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_f5467cf134a9b6db7d517e057a93406d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_f5467cf134a9b6db7d517e057a93406d.jpg not downloaded yet
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_86862d8b0db76915166f4d3aba594747.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_86862d8b0db76915166f4d3aba594747.jpg not downloaded yet
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_eccf99a58606b7458a257e0464ebd79b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_eccf99a58606b7458a257e0464ebd79b.jpg not downloaded yet
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_23cc631f0f2385eff51e8b6c7ce482c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_23cc631f0f2385eff51e8b6c7ce482c5.jpg not downloaded yet
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_c6f59ea96d1e08b715407f7d574b43df.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_c6f59ea96d1e08b715407f7d574b43df.jpg not downloaded yet
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_db0b02b22134d04afaa37400b9ec9ce5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_db0b02b22134d04afaa37400b9ec9ce5.jpg not downloaded yet
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_90ae06daa7e79f4b8cd023a4fd544d67.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_90ae06daa7e79f4b8cd023a4fd544d67.jpg not downloaded yet
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_bf15c0b5b3d099a36ebc9c4efb2234b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_bf15c0b5b3d099a36ebc9c4efb2234b5.jpg not downloaded yet
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_b4490588287f643b8abccc3d47e4370f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_b4490588287f643b8abccc3d47e4370f.jpg not downloaded yet
2026-03-28 12:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_846c444eba9a97818da2605337071e5c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_eccf99a58606b7458a257e0464ebd79b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_b4490588287f643b8abccc3d47e4370f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_86862d8b0db76915166f4d3aba594747.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_db0b02b22134d04afaa37400b9ec9ce5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d5ced10>
2026-03-28 12:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_846c444eba9a97818da2605337071e5c.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_846c444eba9a97818da2605337071e5c.jpg saved to cache
2026-03-28 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1792e23a-b06c-5aa1-90f7-161b3b28a600
2026-03-28 12:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_23cc631f0f2385eff51e8b6c7ce482c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_c6f59ea96d1e08b715407f7d574b43df.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d51c150>
2026-03-28 12:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_eccf99a58606b7458a257e0464ebd79b.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_eccf99a58606b7458a257e0464ebd79b.jpg saved to cache
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1792e23a-b06c-5aa1-90f7-161b3b28a600
2026-03-28 12:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_bf15c0b5b3d099a36ebc9c4efb2234b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cb2b050>
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_b4490588287f643b8abccc3d47e4370f.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_b4490588287f643b8abccc3d47e4370f.jpg saved to cache
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1792e23a-b06c-5aa1-90f7-161b3b28a600
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbdf210>
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_86862d8b0db76915166f4d3aba594747.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_86862d8b0db76915166f4d3aba594747.jpg saved to cache
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1792e23a-b06c-5aa1-90f7-161b3b28a600
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d7bfe10>
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_db0b02b22134d04afaa37400b9ec9ce5.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_db0b02b22134d04afaa37400b9ec9ce5.jpg saved to cache
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1792e23a-b06c-5aa1-90f7-161b3b28a600
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d55ebd0>
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_23cc631f0f2385eff51e8b6c7ce482c5.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_23cc631f0f2385eff51e8b6c7ce482c5.jpg saved to cache
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1792e23a-b06c-5aa1-90f7-161b3b28a600
2026-03-28 12:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3cbec910>
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_c6f59ea96d1e08b715407f7d574b43df.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_c6f59ea96d1e08b715407f7d574b43df.jpg saved to cache
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1792e23a-b06c-5aa1-90f7-161b3b28a600
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3ca388d0>
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_bf15c0b5b3d099a36ebc9c4efb2234b5.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_bf15c0b5b3d099a36ebc9c4efb2234b5.jpg saved to cache
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1792e23a-b06c-5aa1-90f7-161b3b28a600
2026-03-28 12:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_90ae06daa7e79f4b8cd023a4fd544d67.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_f5467cf134a9b6db7d517e057a93406d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3d79ac10>
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_90ae06daa7e79f4b8cd023a4fd544d67.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_90ae06daa7e79f4b8cd023a4fd544d67.jpg saved to cache
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1792e23a-b06c-5aa1-90f7-161b3b28a600
2026-03-28 12:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e3c9f2690>
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fa0%252F9ba04920578c6f55f823b69a70f7cadb%252Fpa%252FKM72059_f5467cf134a9b6db7d517e057a93406d.jpg') HTTP/1.1" 204 0
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_f5467cf134a9b6db7d517e057a93406d.jpg saved to cache
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1792e23a-b06c-5aa1-90f7-161b3b28a600
2026-03-28 12:02:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1792e23a-b06c-5aa1-90f7-161b3b28a600, skipping ID generation
2026-03-28 12:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1792e23a-b06c-5aa1-90f7-161b3b28a600 with scrape type 1
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1792e23a-b06c-5aa1-90f7-161b3b28a600 sending to next pipeline
2026-03-28 12:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1792e23a-b06c-5aa1-90f7-161b3b28a600, identifier: KM72059
2026-03-28 12:02:37 [auto1.it] INFO: Channel: 24h | Page: 17 | totalHits: 3673 | hits on page: 40
2026-03-28 12:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1792e23a-b06c-5aa1-90f7-161b3b28a600 with identifier: KM72059
2026-03-28 12:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1792e23a-b06c-5aa1-90f7-161b3b28a600 with identifier: KM72059
2026-03-28 12:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1792e23a-b06c-5aa1-90f7-161b3b28a600 with identifier: KM72059 to the API
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_f5467cf134a9b6db7d517e057a93406d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': 'Rental',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:47:05Z',
'fuel_type': 'diesel',
'id': '1792e23a-b06c-5aa1-90f7-161b3b28a600',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM72059',
'listing': 'auction',
'location': 'IT, Firenze',
'make': 'Fiat',
'model': '500X',
'odometer': 162825,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78392,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_846c444eba9a97818da2605337071e5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2481672,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_f5467cf134a9b6db7d517e057a93406d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82830,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_86862d8b0db76915166f4d3aba594747.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2469542,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_eccf99a58606b7458a257e0464ebd79b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_23cc631f0f2385eff51e8b6c7ce482c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2430641,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_c6f59ea96d1e08b715407f7d574b43df.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_db0b02b22134d04afaa37400b9ec9ce5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2233752,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_90ae06daa7e79f4b8cd023a4fd544d67.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_bf15c0b5b3d099a36ebc9c4efb2234b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1792e23a-b06c-5aa1-90f7-161b3b28a600/1792e23a-b06c-5aa1-90f7-161b3b28a600_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2348678,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/a0/9ba04920578c6f55f823b69a70f7cadb/pa/KM72059_b4490588287f643b8abccc3d47e4370f.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.6 JTDM Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2015}
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM72059%27 HTTP/1.1" 200 None
2026-03-28 12:02:38 [auto1.it] INFO: Saving data for KM72059: {'created_time': 1774699358.35258, 'last_price_update_time': 1774699358.35259, 'auction_closing_time': 1774885625.0}
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KM72059') HTTP/1.1" 204 0
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: UE49682
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE49682%27 HTTP/1.1" 200 None
2026-03-28 12:02:38 [auto1.it] INFO: Scrape type for UE49682: 0
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: HZ21842
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: VF12324
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF12324%27 HTTP/1.1" 200 None
2026-03-28 12:02:38 [auto1.it] INFO: Scrape type for VF12324: 0
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: RF17009
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF17009%27 HTTP/1.1" 200 None
2026-03-28 12:02:38 [auto1.it] INFO: Scrape type for RF17009: 0
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: GR59213
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR59213%27 HTTP/1.1" 200 None
2026-03-28 12:02:38 [auto1.it] INFO: Scrape type for GR59213: 0
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: SF89201
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: PG27955
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG27955%27 HTTP/1.1" 200 None
2026-03-28 12:02:38 [auto1.it] INFO: Scrape type for PG27955: 0
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: KD33461
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: XY30462
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: RF52556
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF52556%27 HTTP/1.1" 200 None
2026-03-28 12:02:38 [auto1.it] INFO: Scrape type for RF52556: 0
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: UV07226
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: WC70760
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC70760%27 HTTP/1.1" 200 None
2026-03-28 12:02:38 [auto1.it] INFO: Scrape type for WC70760: 0
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: ZH02661
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH02661%27 HTTP/1.1" 200 None
2026-03-28 12:02:38 [auto1.it] INFO: Scrape type for ZH02661: 0
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: MP98273
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP98273%27 HTTP/1.1" 200 None
2026-03-28 12:02:38 [auto1.it] INFO: Scrape type for MP98273: 0
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: HK97988
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK97988%27 HTTP/1.1" 200 None
2026-03-28 12:02:38 [auto1.it] INFO: Scrape type for HK97988: 0
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: SJ75121
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: UU73428
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: MM82110
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: JA21524
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA21524%27 HTTP/1.1" 200 None
2026-03-28 12:02:38 [auto1.it] INFO: Scrape type for JA21524: 0
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: KE50843
2026-03-28 12:02:38 [auto1.it] INFO: Found listing with ID: MN43509
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN43509%27 HTTP/1.1" 200 None
2026-03-28 12:02:38 [auto1.it] INFO: Scrape type for MN43509: 2
2026-03-28 12:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3145013-fe95-5d71-bb36-6549372d2f70 with identifier: MN43509
2026-03-28 12:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3145013-fe95-5d71-bb36-6549372d2f70 with scrape type 2
2026-03-28 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3145013-fe95-5d71-bb36-6549372d2f70 with scrape type 2
2026-03-28 12:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a3145013-fe95-5d71-bb36-6549372d2f70, identifier: MN43509
2026-03-28 12:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a3145013-fe95-5d71-bb36-6549372d2f70 with identifier: MN43509
2026-03-28 12:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a3145013-fe95-5d71-bb36-6549372d2f70 with identifier: MN43509
2026-03-28 12:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a3145013-fe95-5d71-bb36-6549372d2f70 with identifier: MN43509 to the API
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:09:35Z',
'fuel_type': 'petrol',
'id': 'a3145013-fe95-5d71-bb36-6549372d2f70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN43509',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 197336,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-28',
'seller_name': None,
'title': 'Nissan Qashqai 2.0 Acenta 4x4',
'transmission': 'automatic',
'trim': 'Acenta 4x4',
'year': 2010}
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN43509%27 HTTP/1.1" 200 None
2026-03-28 12:02:39 [auto1.it] INFO: Saving data for MN43509: {'auction_closing_time': 1774714175.0, 'created_time': 1774515659.446217, 'last_price_update_time': 1774699359.165263}
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MN43509') HTTP/1.1" 204 0
2026-03-28 12:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: WU65183
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU65183%27 HTTP/1.1" 200 None
2026-03-28 12:02:39 [auto1.it] INFO: Scrape type for WU65183: 0
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: FV31205
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV31205%27 HTTP/1.1" 200 None
2026-03-28 12:02:39 [auto1.it] INFO: Scrape type for FV31205: 0
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: LY31332
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY31332%27 HTTP/1.1" 200 None
2026-03-28 12:02:39 [auto1.it] INFO: Scrape type for LY31332: 0
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: ZS50484
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: JM76846
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: CV87912
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: XG74352
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: RH02265
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH02265%27 HTTP/1.1" 200 None
2026-03-28 12:02:39 [auto1.it] INFO: Scrape type for RH02265: 0
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: PF24041
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: AT64434
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: PC87796
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: YS50306
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS50306%27 HTTP/1.1" 200 None
2026-03-28 12:02:39 [auto1.it] INFO: Scrape type for YS50306: 0
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: UF44040
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: JD40027
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: ZS91054
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS91054%27 HTTP/1.1" 200 None
2026-03-28 12:02:39 [auto1.it] INFO: Scrape type for ZS91054: 0
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: TK51874
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK51874%27 HTTP/1.1" 200 None
2026-03-28 12:02:39 [auto1.it] INFO: Scrape type for TK51874: 0
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: LZ51776
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: CK12538
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK12538%27 HTTP/1.1" 200 None
2026-03-28 12:02:39 [auto1.it] INFO: Scrape type for CK12538: 0
2026-03-28 12:02:39 [auto1.it] INFO: Found listing with ID: GM25035
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM25035%27 HTTP/1.1" 200 None
2026-03-28 12:02:39 [auto1.it] INFO: Scrape type for GM25035: 0
2026-03-28 12:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:40 [auto1.it] INFO: Channel: 24h | Page: 18 | totalHits: 3673 | hits on page: 40
2026-03-28 12:02:40 [auto1.it] INFO: Found listing with ID: DA21297
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA21297%27 HTTP/1.1" 200 None
2026-03-28 12:02:40 [auto1.it] INFO: Scrape type for DA21297: 2
2026-03-28 12:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd89628b-94ab-5a0e-b25b-ac4e03788838 with identifier: DA21297
2026-03-28 12:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd89628b-94ab-5a0e-b25b-ac4e03788838 with scrape type 2
2026-03-28 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd89628b-94ab-5a0e-b25b-ac4e03788838 with scrape type 2
2026-03-28 12:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd89628b-94ab-5a0e-b25b-ac4e03788838, identifier: DA21297
2026-03-28 12:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd89628b-94ab-5a0e-b25b-ac4e03788838 with identifier: DA21297
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 12:02:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd89628b-94ab-5a0e-b25b-ac4e03788838 with identifier: DA21297
2026-03-28 12:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd89628b-94ab-5a0e-b25b-ac4e03788838 with identifier: DA21297 to the API
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:51:17Z',
'fuel_type': 'gas',
'id': 'dd89628b-94ab-5a0e-b25b-ac4e03788838',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA21297',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 304349,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-04',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 BIFuel Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2011}
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA21297%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Saving data for DA21297: {'auction_closing_time': 1774716677.0, 'created_time': 1774515709.096638, 'last_price_update_time': 1774699361.117383}
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DA21297') HTTP/1.1" 204 0
2026-03-28 12:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: XH90607
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: RZ71540
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ71540%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Scrape type for RZ71540: 0
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: AE71384
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE71384%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Scrape type for AE71384: 0
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: GV81081
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: RL11893
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: TT68141
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT68141%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Scrape type for TT68141: 0
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: WW70884
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: KT78402
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: HE90318
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE90318%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Scrape type for HE90318: 2
2026-03-28 12:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 946c5685-a034-52d7-9fc1-ead46d6c81c5 with identifier: HE90318
2026-03-28 12:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 946c5685-a034-52d7-9fc1-ead46d6c81c5 with scrape type 2
2026-03-28 12:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 946c5685-a034-52d7-9fc1-ead46d6c81c5 with scrape type 2
2026-03-28 12:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 946c5685-a034-52d7-9fc1-ead46d6c81c5, identifier: HE90318
2026-03-28 12:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 946c5685-a034-52d7-9fc1-ead46d6c81c5 with identifier: HE90318
2026-03-28 12:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 946c5685-a034-52d7-9fc1-ead46d6c81c5 with identifier: HE90318
2026-03-28 12:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 946c5685-a034-52d7-9fc1-ead46d6c81c5 with identifier: HE90318 to the API
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:25:53Z',
'fuel_type': 'diesel',
'id': '946c5685-a034-52d7-9fc1-ead46d6c81c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE90318',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 107729,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-26',
'seller_name': None,
'title': 'Peugeot 308 1.5 Blue-HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2019}
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE90318%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Saving data for HE90318: {'auction_closing_time': 1774715153.0, 'created_time': 1774515712.648645, 'last_price_update_time': 1774699361.699324}
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HE90318') HTTP/1.1" 204 0
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: KY18822
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: LR80545
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: VK83291
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK83291%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Scrape type for VK83291: 0
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: KC76044
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC76044%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Scrape type for KC76044: 0
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: EJ70164
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ70164%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Scrape type for EJ70164: 0
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: FB75949
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: JZ08604
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ08604%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Scrape type for JZ08604: 0
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: CX77034
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: AL33371
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL33371%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Scrape type for AL33371: 0
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: SG14661
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG14661%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Scrape type for SG14661: 0
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: ZE89719
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE89719%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Scrape type for ZE89719: 0
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: VP48054
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: FX33898
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX33898%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Scrape type for FX33898: 0
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: SD16810
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD16810%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Scrape type for SD16810: 0
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: CV59379
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: EK65593
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK65593%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Scrape type for EK65593: 0
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: JS42398
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS42398%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Scrape type for JS42398: 0
2026-03-28 12:02:41 [auto1.it] INFO: Found listing with ID: SF23261
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF23261%27 HTTP/1.1" 200 None
2026-03-28 12:02:41 [auto1.it] INFO: Scrape type for SF23261: 2
2026-03-28 12:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99c0f5b4-b783-5a83-a739-55eb6f3f0d1b with identifier: SF23261
2026-03-28 12:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99c0f5b4-b783-5a83-a739-55eb6f3f0d1b with scrape type 2
2026-03-28 12:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99c0f5b4-b783-5a83-a739-55eb6f3f0d1b with scrape type 2
2026-03-28 12:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 99c0f5b4-b783-5a83-a739-55eb6f3f0d1b, identifier: SF23261
2026-03-28 12:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 99c0f5b4-b783-5a83-a739-55eb6f3f0d1b with identifier: SF23261
2026-03-28 12:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 99c0f5b4-b783-5a83-a739-55eb6f3f0d1b with identifier: SF23261
2026-03-28 12:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 99c0f5b4-b783-5a83-a739-55eb6f3f0d1b with identifier: SF23261 to the API
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:38:17Z',
'fuel_type': 'diesel',
'id': '99c0f5b4-b783-5a83-a739-55eb6f3f0d1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF23261',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 352088,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-31',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2009}
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF23261%27 HTTP/1.1" 200 None
2026-03-28 12:02:42 [auto1.it] INFO: Saving data for SF23261: {'auction_closing_time': 1774715897.0, 'created_time': 1774101743.573161, 'last_price_update_time': 1774699362.42912}
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SF23261') HTTP/1.1" 204 0
2026-03-28 12:02:42 [auto1.it] INFO: Found listing with ID: AA72149
2026-03-28 12:02:42 [auto1.it] INFO: Found listing with ID: PR97766
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR97766%27 HTTP/1.1" 200 None
2026-03-28 12:02:42 [auto1.it] INFO: Scrape type for PR97766: 0
2026-03-28 12:02:42 [auto1.it] INFO: Found listing with ID: NT87512
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT87512%27 HTTP/1.1" 200 None
2026-03-28 12:02:42 [auto1.it] INFO: Scrape type for NT87512: 0
2026-03-28 12:02:42 [auto1.it] INFO: Found listing with ID: TT47186
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT47186%27 HTTP/1.1" 200 None
2026-03-28 12:02:42 [auto1.it] INFO: Scrape type for TT47186: 0
2026-03-28 12:02:42 [auto1.it] INFO: Found listing with ID: RL69129
2026-03-28 12:02:42 [auto1.it] INFO: Found listing with ID: AN76341
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN76341%27 HTTP/1.1" 200 None
2026-03-28 12:02:42 [auto1.it] INFO: Scrape type for AN76341: 0
2026-03-28 12:02:42 [auto1.it] INFO: Found listing with ID: VW08659
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW08659%27 HTTP/1.1" 200 None
2026-03-28 12:02:42 [auto1.it] INFO: Scrape type for VW08659: 0
2026-03-28 12:02:42 [auto1.it] INFO: Found listing with ID: BE85602
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE85602%27 HTTP/1.1" 200 None
2026-03-28 12:02:42 [auto1.it] INFO: Scrape type for BE85602: 0
2026-03-28 12:02:42 [auto1.it] INFO: Found listing with ID: AL22636
2026-03-28 12:02:42 [auto1.it] INFO: Found listing with ID: WA74830
2026-03-28 12:02:42 [auto1.it] INFO: Found listing with ID: YM41293
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM41293%27 HTTP/1.1" 200 None
2026-03-28 12:02:42 [auto1.it] INFO: Scrape type for YM41293: 0
2026-03-28 12:02:42 [auto1.it] INFO: Found listing with ID: UH24894
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH24894%27 HTTP/1.1" 200 None
2026-03-28 12:02:42 [auto1.it] INFO: Scrape type for UH24894: 2
2026-03-28 12:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1759a575-0768-5978-8a39-cbc50de955f1 with identifier: UH24894
2026-03-28 12:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1759a575-0768-5978-8a39-cbc50de955f1 with scrape type 2
2026-03-28 12:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1759a575-0768-5978-8a39-cbc50de955f1 with scrape type 2
2026-03-28 12:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1759a575-0768-5978-8a39-cbc50de955f1, identifier: UH24894
2026-03-28 12:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1759a575-0768-5978-8a39-cbc50de955f1 with identifier: UH24894
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 12:02:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1759a575-0768-5978-8a39-cbc50de955f1 with identifier: UH24894
2026-03-28 12:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1759a575-0768-5978-8a39-cbc50de955f1 with identifier: UH24894 to the API
2026-03-28 12:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:06:28Z',
'fuel_type': 'diesel',
'id': '1759a575-0768-5978-8a39-cbc50de955f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH24894',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 200101,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-31',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 CDI Avantgarde',
'transmission': 'manual',
'trim': 'Avantgarde',
'year': 2010}
2026-03-28 12:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH24894%27 HTTP/1.1" 200 None
2026-03-28 12:02:43 [auto1.it] INFO: Saving data for UH24894: {'auction_closing_time': 1774713988.0, 'created_time': 1774515670.090223, 'last_price_update_time': 1774699363.293474}
2026-03-28 12:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UH24894') HTTP/1.1" 204 0
2026-03-28 12:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:44 [auto1.it] INFO: Channel: 24h | Page: 19 | totalHits: 3673 | hits on page: 40
2026-03-28 12:02:44 [auto1.it] INFO: Found listing with ID: JK70012
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK70012%27 HTTP/1.1" 200 None
2026-03-28 12:02:44 [auto1.it] INFO: Scrape type for JK70012: 2
2026-03-28 12:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1704a127-b105-5a71-83aa-424f72463dae with identifier: JK70012
2026-03-28 12:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1704a127-b105-5a71-83aa-424f72463dae with scrape type 2
2026-03-28 12:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1704a127-b105-5a71-83aa-424f72463dae with scrape type 2
2026-03-28 12:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1704a127-b105-5a71-83aa-424f72463dae, identifier: JK70012
2026-03-28 12:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1704a127-b105-5a71-83aa-424f72463dae with identifier: JK70012
2026-03-28 12:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1704a127-b105-5a71-83aa-424f72463dae with identifier: JK70012
2026-03-28 12:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1704a127-b105-5a71-83aa-424f72463dae with identifier: JK70012 to the API
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-28T16:59:27Z',
'fuel_type': 'diesel',
'id': '1704a127-b105-5a71-83aa-424f72463dae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK70012',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 144810,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-29',
'seller_name': None,
'title': 'BMW X1 sDrive 18d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK70012%27 HTTP/1.1" 200 None
2026-03-28 12:02:44 [auto1.it] INFO: Saving data for JK70012: {'auction_closing_time': 1774717167.0, 'created_time': 1774515733.660633, 'last_price_update_time': 1774699364.636948}
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JK70012') HTTP/1.1" 204 0
2026-03-28 12:02:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:44 [auto1.it] INFO: Found listing with ID: FF54674
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF54674%27 HTTP/1.1" 200 None
2026-03-28 12:02:44 [auto1.it] INFO: Scrape type for FF54674: 0
2026-03-28 12:02:44 [auto1.it] INFO: Found listing with ID: FV08764
2026-03-28 12:02:44 [auto1.it] INFO: Found listing with ID: RF58149
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF58149%27 HTTP/1.1" 200 None
2026-03-28 12:02:44 [auto1.it] INFO: Scrape type for RF58149: 0
2026-03-28 12:02:44 [auto1.it] INFO: Found listing with ID: MY00561
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY00561%27 HTTP/1.1" 200 None
2026-03-28 12:02:44 [auto1.it] INFO: Scrape type for MY00561: 0
2026-03-28 12:02:44 [auto1.it] INFO: Found listing with ID: KM79113
2026-03-28 12:02:44 [auto1.it] INFO: Found listing with ID: RA21109
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA21109%27 HTTP/1.1" 200 None
2026-03-28 12:02:44 [auto1.it] INFO: Scrape type for RA21109: 0
2026-03-28 12:02:44 [auto1.it] INFO: Found listing with ID: SC24235
2026-03-28 12:02:44 [auto1.it] INFO: Found listing with ID: PC98849
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC98849%27 HTTP/1.1" 200 None
2026-03-28 12:02:44 [auto1.it] INFO: Scrape type for PC98849: 0
2026-03-28 12:02:44 [auto1.it] INFO: Found listing with ID: UT67830
2026-03-28 12:02:44 [auto1.it] INFO: Found listing with ID: KS82343
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS82343%27 HTTP/1.1" 200 None
2026-03-28 12:02:44 [auto1.it] INFO: Scrape type for KS82343: 0
2026-03-28 12:02:44 [auto1.it] INFO: Found listing with ID: DX23883
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX23883%27 HTTP/1.1" 200 None
2026-03-28 12:02:44 [auto1.it] INFO: Scrape type for DX23883: 2
2026-03-28 12:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 229aae3b-28a4-5568-abe7-f093c25792a6 with identifier: DX23883
2026-03-28 12:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 229aae3b-28a4-5568-abe7-f093c25792a6 with scrape type 2
2026-03-28 12:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 229aae3b-28a4-5568-abe7-f093c25792a6 with scrape type 2
2026-03-28 12:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 229aae3b-28a4-5568-abe7-f093c25792a6, identifier: DX23883
2026-03-28 12:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 229aae3b-28a4-5568-abe7-f093c25792a6 with identifier: DX23883
2026-03-28 12:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 229aae3b-28a4-5568-abe7-f093c25792a6 with identifier: DX23883
2026-03-28 12:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 229aae3b-28a4-5568-abe7-f093c25792a6 with identifier: DX23883 to the API
2026-03-28 12:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-28T16:33:35Z',
'fuel_type': 'petrol',
'id': '229aae3b-28a4-5568-abe7-f093c25792a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX23883',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 209646,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-31',
'seller_name': None,
'title': 'Citroen C3 1.1 Perfect',
'transmission': 'manual',
'trim': 'Perfect',
'year': 2010}
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX23883%27 HTTP/1.1" 200 None
2026-03-28 12:02:45 [auto1.it] INFO: Saving data for DX23883: {'auction_closing_time': 1774715615.0, 'created_time': 1774515687.815531, 'last_price_update_time': 1774699365.193457}
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DX23883') HTTP/1.1" 204 0
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: YB28185
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB28185%27 HTTP/1.1" 200 None
2026-03-28 12:02:45 [auto1.it] INFO: Scrape type for YB28185: 0
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: UJ22740
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: JV82162
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV82162%27 HTTP/1.1" 200 None
2026-03-28 12:02:45 [auto1.it] INFO: Scrape type for JV82162: 0
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: DE25222
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE25222%27 HTTP/1.1" 200 None
2026-03-28 12:02:45 [auto1.it] INFO: Scrape type for DE25222: 0
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: UX20076
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX20076%27 HTTP/1.1" 200 None
2026-03-28 12:02:45 [auto1.it] INFO: Scrape type for UX20076: 0
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: SN27991
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: MD06085
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: SS79463
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: MC91027
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: ZT24838
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: JK02005
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK02005%27 HTTP/1.1" 200 None
2026-03-28 12:02:45 [auto1.it] INFO: Scrape type for JK02005: 0
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: RB72441
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB72441%27 HTTP/1.1" 200 None
2026-03-28 12:02:45 [auto1.it] INFO: Scrape type for RB72441: 0
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: EC66438
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: VK05865
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: WR22265
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR22265%27 HTTP/1.1" 200 None
2026-03-28 12:02:45 [auto1.it] INFO: Scrape type for WR22265: 0
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: UN16063
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: YA33323
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: EM46556
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: ZP43872
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP43872%27 HTTP/1.1" 200 None
2026-03-28 12:02:45 [auto1.it] INFO: Scrape type for ZP43872: 0
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: CP55584
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: VT45573
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: MU13564
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: YY01932
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY01932%27 HTTP/1.1" 200 None
2026-03-28 12:02:45 [auto1.it] INFO: Scrape type for YY01932: 0
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: UD16121
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD16121%27 HTTP/1.1" 200 None
2026-03-28 12:02:45 [auto1.it] INFO: Scrape type for UD16121: 0
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: EC11217
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC11217%27 HTTP/1.1" 200 None
2026-03-28 12:02:45 [auto1.it] INFO: Scrape type for EC11217: 0
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: XV48493
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: MD24560
2026-03-28 12:02:45 [auto1.it] INFO: Found listing with ID: XT99009
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT99009%27 HTTP/1.1" 200 None
2026-03-28 12:02:45 [auto1.it] INFO: Scrape type for XT99009: 0
2026-03-28 12:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:46 [auto1.it] INFO: Channel: 24h | Page: 20 | totalHits: 3673 | hits on page: 40
2026-03-28 12:02:46 [auto1.it] INFO: Found listing with ID: LC07756
2026-03-28 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC07756%27 HTTP/1.1" 200 None
2026-03-28 12:02:46 [auto1.it] INFO: Scrape type for LC07756: 2
2026-03-28 12:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08a622d2-2ce7-50d7-8951-06fd4daa15d3 with identifier: LC07756
2026-03-28 12:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08a622d2-2ce7-50d7-8951-06fd4daa15d3 with scrape type 2
2026-03-28 12:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08a622d2-2ce7-50d7-8951-06fd4daa15d3 with scrape type 2
2026-03-28 12:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 08a622d2-2ce7-50d7-8951-06fd4daa15d3, identifier: LC07756
2026-03-28 12:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 08a622d2-2ce7-50d7-8951-06fd4daa15d3 with identifier: LC07756
2026-03-28 12:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 08a622d2-2ce7-50d7-8951-06fd4daa15d3 with identifier: LC07756
2026-03-28 12:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 08a622d2-2ce7-50d7-8951-06fd4daa15d3 with identifier: LC07756 to the API
2026-03-28 12:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:33:57Z',
'fuel_type': 'diesel',
'id': '08a622d2-2ce7-50d7-8951-06fd4daa15d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC07756',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 279522,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-10-07',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.9 TDI CrossGolf',
'transmission': 'manual',
'trim': 'CrossGolf',
'year': 2007}
2026-03-28 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC07756%27 HTTP/1.1" 200 None
2026-03-28 12:02:46 [auto1.it] INFO: Saving data for LC07756: {'auction_closing_time': 1774715637.0, 'created_time': 1774515653.160478, 'last_price_update_time': 1774699366.733371}
2026-03-28 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LC07756') HTTP/1.1" 204 0
2026-03-28 12:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:46 [auto1.it] INFO: Found listing with ID: EV86886
2026-03-28 12:02:46 [auto1.it] INFO: Found listing with ID: SK38422
2026-03-28 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK38422%27 HTTP/1.1" 200 None
2026-03-28 12:02:46 [auto1.it] INFO: Scrape type for SK38422: 2
2026-03-28 12:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69ec5aa7-d2bd-532f-8875-ef8b7cca20cf with identifier: SK38422
2026-03-28 12:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69ec5aa7-d2bd-532f-8875-ef8b7cca20cf with scrape type 2
2026-03-28 12:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69ec5aa7-d2bd-532f-8875-ef8b7cca20cf with scrape type 2
2026-03-28 12:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 69ec5aa7-d2bd-532f-8875-ef8b7cca20cf, identifier: SK38422
2026-03-28 12:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 69ec5aa7-d2bd-532f-8875-ef8b7cca20cf with identifier: SK38422
2026-03-28 12:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 69ec5aa7-d2bd-532f-8875-ef8b7cca20cf with identifier: SK38422
2026-03-28 12:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 69ec5aa7-d2bd-532f-8875-ef8b7cca20cf with identifier: SK38422 to the API
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:19:07Z',
'fuel_type': 'diesel',
'id': '69ec5aa7-d2bd-532f-8875-ef8b7cca20cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK38422',
'listing': 'auction',
'make': 'Jeep',
'model': 'Compass',
'odometer': 126879,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-29',
'seller_name': None,
'title': 'Jeep Compass 2.0 M-Jet Opening Edition 4WD',
'transmission': 'automatic',
'trim': 'Opening Edition 4WD',
'year': 2017}
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK38422%27 HTTP/1.1" 200 None
2026-03-28 12:02:47 [auto1.it] INFO: Saving data for SK38422: {'auction_closing_time': 1774714747.0, 'created_time': 1774126857.328093, 'last_price_update_time': 1774699367.278573}
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SK38422') HTTP/1.1" 204 0
2026-03-28 12:02:47 [auto1.it] INFO: Found listing with ID: UR82213
2026-03-28 12:02:47 [auto1.it] INFO: Found listing with ID: TP47209
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP47209%27 HTTP/1.1" 200 None
2026-03-28 12:02:47 [auto1.it] INFO: Scrape type for TP47209: 0
2026-03-28 12:02:47 [auto1.it] INFO: Found listing with ID: ZA41096
2026-03-28 12:02:47 [auto1.it] INFO: Found listing with ID: HS75117
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS75117%27 HTTP/1.1" 200 None
2026-03-28 12:02:47 [auto1.it] INFO: Scrape type for HS75117: 2
2026-03-28 12:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18967639-bbf0-5534-ac95-52969309cd06 with identifier: HS75117
2026-03-28 12:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18967639-bbf0-5534-ac95-52969309cd06 with scrape type 2
2026-03-28 12:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18967639-bbf0-5534-ac95-52969309cd06 with scrape type 2
2026-03-28 12:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 18967639-bbf0-5534-ac95-52969309cd06, identifier: HS75117
2026-03-28 12:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 18967639-bbf0-5534-ac95-52969309cd06 with identifier: HS75117
2026-03-28 12:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 18967639-bbf0-5534-ac95-52969309cd06 with identifier: HS75117
2026-03-28 12:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 18967639-bbf0-5534-ac95-52969309cd06 with identifier: HS75117 to the API
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:40:06Z',
'fuel_type': 'petrol',
'id': '18967639-bbf0-5534-ac95-52969309cd06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS75117',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 63983,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-06',
'seller_name': None,
'title': 'Fiat Panda 1.2 Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2014}
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS75117%27 HTTP/1.1" 200 None
2026-03-28 12:02:47 [auto1.it] INFO: Saving data for HS75117: {'auction_closing_time': 1774716006.0, 'created_time': 1774515719.742988, 'last_price_update_time': 1774699367.718351}
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HS75117') HTTP/1.1" 204 0
2026-03-28 12:02:47 [auto1.it] INFO: Found listing with ID: US82962
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US82962%27 HTTP/1.1" 200 None
2026-03-28 12:02:47 [auto1.it] INFO: Scrape type for US82962: 0
2026-03-28 12:02:47 [auto1.it] INFO: Found listing with ID: NU85167
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU85167%27 HTTP/1.1" 200 None
2026-03-28 12:02:47 [auto1.it] INFO: Scrape type for NU85167: 0
2026-03-28 12:02:47 [auto1.it] INFO: Found listing with ID: ZY01206
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY01206%27 HTTP/1.1" 200 None
2026-03-28 12:02:47 [auto1.it] INFO: Scrape type for ZY01206: 0
2026-03-28 12:02:47 [auto1.it] INFO: Found listing with ID: NL99769
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL99769%27 HTTP/1.1" 200 None
2026-03-28 12:02:47 [auto1.it] INFO: Scrape type for NL99769: 2
2026-03-28 12:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 897335d8-7f35-5a71-9558-d411cf77a211 with identifier: NL99769
2026-03-28 12:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 897335d8-7f35-5a71-9558-d411cf77a211 with scrape type 2
2026-03-28 12:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 897335d8-7f35-5a71-9558-d411cf77a211 with scrape type 2
2026-03-28 12:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 897335d8-7f35-5a71-9558-d411cf77a211, identifier: NL99769
2026-03-28 12:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 897335d8-7f35-5a71-9558-d411cf77a211 with identifier: NL99769
2026-03-28 12:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 897335d8-7f35-5a71-9558-d411cf77a211 with identifier: NL99769
2026-03-28 12:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 897335d8-7f35-5a71-9558-d411cf77a211 with identifier: NL99769 to the API
2026-03-28 12:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 240,
'expiration_date': '2026-03-28T16:35:43Z',
'fuel_type': 'diesel',
'id': '897335d8-7f35-5a71-9558-d411cf77a211',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL99769',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 304766,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-03',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI quattro',
'transmission': 'manual',
'trim': 'quattro',
'year': 2010}
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL99769%27 HTTP/1.1" 200 None
2026-03-28 12:02:48 [auto1.it] INFO: Saving data for NL99769: {'auction_closing_time': 1774715743.0, 'created_time': 1774515716.963369, 'last_price_update_time': 1774699368.204271}
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NL99769') HTTP/1.1" 204 0
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: MS47082
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS47082%27 HTTP/1.1" 200 None
2026-03-28 12:02:48 [auto1.it] INFO: Scrape type for MS47082: 0
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: UB37048
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: CF64613
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: RE73183
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE73183%27 HTTP/1.1" 200 None
2026-03-28 12:02:48 [auto1.it] INFO: Scrape type for RE73183: 2
2026-03-28 12:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c73b8e76-5643-59f7-87a6-02ed37f65511 with identifier: RE73183
2026-03-28 12:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c73b8e76-5643-59f7-87a6-02ed37f65511 with scrape type 2
2026-03-28 12:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c73b8e76-5643-59f7-87a6-02ed37f65511 with scrape type 2
2026-03-28 12:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c73b8e76-5643-59f7-87a6-02ed37f65511, identifier: RE73183
2026-03-28 12:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c73b8e76-5643-59f7-87a6-02ed37f65511 with identifier: RE73183
2026-03-28 12:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c73b8e76-5643-59f7-87a6-02ed37f65511 with identifier: RE73183
2026-03-28 12:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c73b8e76-5643-59f7-87a6-02ed37f65511 with identifier: RE73183 to the API
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:02:08Z',
'fuel_type': 'diesel',
'id': 'c73b8e76-5643-59f7-87a6-02ed37f65511',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE73183',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 143806,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-26',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Shooting Brake Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE73183%27 HTTP/1.1" 200 None
2026-03-28 12:02:48 [auto1.it] INFO: Saving data for RE73183: {'auction_closing_time': 1774713728.0, 'created_time': 1774515641.980149, 'last_price_update_time': 1774699368.657212}
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RE73183') HTTP/1.1" 204 0
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: TY88258
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY88258%27 HTTP/1.1" 200 None
2026-03-28 12:02:48 [auto1.it] INFO: Scrape type for TY88258: 0
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: YJ50893
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ50893%27 HTTP/1.1" 200 None
2026-03-28 12:02:48 [auto1.it] INFO: Scrape type for YJ50893: 0
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: FE47038
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: KS22077
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS22077%27 HTTP/1.1" 200 None
2026-03-28 12:02:48 [auto1.it] INFO: Scrape type for KS22077: 0
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: DF42312
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF42312%27 HTTP/1.1" 200 None
2026-03-28 12:02:48 [auto1.it] INFO: Scrape type for DF42312: 0
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: EX36920
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX36920%27 HTTP/1.1" 200 None
2026-03-28 12:02:48 [auto1.it] INFO: Scrape type for EX36920: 0
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: XZ56129
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: WD53289
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD53289%27 HTTP/1.1" 200 None
2026-03-28 12:02:48 [auto1.it] INFO: Scrape type for WD53289: 0
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: EU76954
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU76954%27 HTTP/1.1" 200 None
2026-03-28 12:02:48 [auto1.it] INFO: Scrape type for EU76954: 0
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: YU54798
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU54798%27 HTTP/1.1" 200 None
2026-03-28 12:02:48 [auto1.it] INFO: Scrape type for YU54798: 0
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: RK45899
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK45899%27 HTTP/1.1" 200 None
2026-03-28 12:02:48 [auto1.it] INFO: Scrape type for RK45899: 0
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: KM82179
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: WA14030
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: FJ36281
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: SC05830
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: DX52921
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: TG05681
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG05681%27 HTTP/1.1" 200 None
2026-03-28 12:02:48 [auto1.it] INFO: Scrape type for TG05681: 0
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: ZJ11157
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: FG85862
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: SH24960
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: WR20789
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR20789%27 HTTP/1.1" 200 None
2026-03-28 12:02:48 [auto1.it] INFO: Scrape type for WR20789: 0
2026-03-28 12:02:48 [auto1.it] INFO: Found listing with ID: XY73038
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY73038%27 HTTP/1.1" 200 None
2026-03-28 12:02:49 [auto1.it] INFO: Scrape type for XY73038: 2
2026-03-28 12:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92a5d966-21c2-5df1-bf81-95e290e097b2 with identifier: XY73038
2026-03-28 12:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92a5d966-21c2-5df1-bf81-95e290e097b2 with scrape type 2
2026-03-28 12:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92a5d966-21c2-5df1-bf81-95e290e097b2 with scrape type 2
2026-03-28 12:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 92a5d966-21c2-5df1-bf81-95e290e097b2, identifier: XY73038
2026-03-28 12:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 92a5d966-21c2-5df1-bf81-95e290e097b2 with identifier: XY73038
2026-03-28 12:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 92a5d966-21c2-5df1-bf81-95e290e097b2 with identifier: XY73038
2026-03-28 12:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 92a5d966-21c2-5df1-bf81-95e290e097b2 with identifier: XY73038 to the API
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:17:55Z',
'fuel_type': 'diesel',
'id': '92a5d966-21c2-5df1-bf81-95e290e097b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY73038',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 142787,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-24',
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY73038%27 HTTP/1.1" 200 None
2026-03-28 12:02:49 [auto1.it] INFO: Saving data for XY73038: {'auction_closing_time': 1774714675.0, 'created_time': 1774515624.522315, 'last_price_update_time': 1774699369.532653}
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XY73038') HTTP/1.1" 204 0
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: TK53428
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK53428%27 HTTP/1.1" 200 None
2026-03-28 12:02:49 [auto1.it] INFO: Scrape type for TK53428: 0
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: NT25208
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT25208%27 HTTP/1.1" 200 None
2026-03-28 12:02:49 [auto1.it] INFO: Scrape type for NT25208: 0
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: ZM39630
2026-03-28 12:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:49 [auto1.it] INFO: Channel: 24h | Page: 21 | totalHits: 3673 | hits on page: 40
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: SK44334
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK44334%27 HTTP/1.1" 200 None
2026-03-28 12:02:49 [auto1.it] INFO: Scrape type for SK44334: 0
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: DP62662
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP62662%27 HTTP/1.1" 200 None
2026-03-28 12:02:49 [auto1.it] INFO: Scrape type for DP62662: 0
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: XD24823
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: NB02021
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB02021%27 HTTP/1.1" 200 None
2026-03-28 12:02:49 [auto1.it] INFO: Scrape type for NB02021: 0
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: VC74933
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC74933%27 HTTP/1.1" 200 None
2026-03-28 12:02:49 [auto1.it] INFO: Scrape type for VC74933: 0
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: UT52795
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: MX71384
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: EB41992
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB41992%27 HTTP/1.1" 200 None
2026-03-28 12:02:49 [auto1.it] INFO: Scrape type for EB41992: 0
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: ZF01479
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: CT94493
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: TZ83635
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ83635%27 HTTP/1.1" 200 None
2026-03-28 12:02:49 [auto1.it] INFO: Scrape type for TZ83635: 0
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: BS51992
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: WJ94048
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ94048%27 HTTP/1.1" 200 None
2026-03-28 12:02:49 [auto1.it] INFO: Scrape type for WJ94048: 0
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: ZU06634
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU06634%27 HTTP/1.1" 200 None
2026-03-28 12:02:49 [auto1.it] INFO: Scrape type for ZU06634: 0
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: WE26685
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: NU40150
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: TL80990
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: YL27459
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: AG12486
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG12486%27 HTTP/1.1" 200 None
2026-03-28 12:02:49 [auto1.it] INFO: Scrape type for AG12486: 0
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: VS63609
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS63609%27 HTTP/1.1" 200 None
2026-03-28 12:02:49 [auto1.it] INFO: Scrape type for VS63609: 0
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: UH61240
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH61240%27 HTTP/1.1" 200 None
2026-03-28 12:02:49 [auto1.it] INFO: Scrape type for UH61240: 0
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: DM21687
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM21687%27 HTTP/1.1" 200 None
2026-03-28 12:02:49 [auto1.it] INFO: Scrape type for DM21687: 0
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: ZL42866
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: YA38395
2026-03-28 12:02:49 [auto1.it] INFO: Found listing with ID: TC50511
2026-03-28 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC50511%27 HTTP/1.1" 200 None
2026-03-28 12:02:50 [auto1.it] INFO: Scrape type for TC50511: 0
2026-03-28 12:02:50 [auto1.it] INFO: Found listing with ID: TK21240
2026-03-28 12:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK21240%27 HTTP/1.1" 200 None
2026-03-28 12:02:50 [auto1.it] INFO: Scrape type for TK21240: 0
2026-03-28 12:02:50 [auto1.it] INFO: Found listing with ID: VP75887
2026-03-28 12:02:50 [auto1.it] INFO: Found listing with ID: RC55633
2026-03-28 12:02:50 [auto1.it] INFO: Found listing with ID: DB38288
2026-03-28 12:02:50 [auto1.it] INFO: Found listing with ID: ZF04289
2026-03-28 12:02:50 [auto1.it] INFO: Found listing with ID: NP33035
2026-03-28 12:02:50 [auto1.it] INFO: Found listing with ID: PA22608
2026-03-28 12:02:50 [auto1.it] INFO: Found listing with ID: FH02566
2026-03-28 12:02:50 [auto1.it] INFO: Found listing with ID: XZ64969
2026-03-28 12:02:50 [auto1.it] INFO: Found listing with ID: LJ35523
2026-03-28 12:02:50 [auto1.it] INFO: Found listing with ID: HH64433
2026-03-28 12:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH64433%27 HTTP/1.1" 200 None
2026-03-28 12:02:50 [auto1.it] INFO: Scrape type for HH64433: 0
2026-03-28 12:02:50 [auto1.it] INFO: Found listing with ID: GT36426
2026-03-28 12:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT36426%27 HTTP/1.1" 200 None
2026-03-28 12:02:50 [auto1.it] INFO: Scrape type for GT36426: 0
2026-03-28 12:02:50 [auto1.it] INFO: Found listing with ID: GB77184
2026-03-28 12:02:50 [auto1.it] INFO: Found listing with ID: FC91970
2026-03-28 12:02:50 [auto1.it] INFO: Found listing with ID: RK33520
2026-03-28 12:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:51 [auto1.it] INFO: Channel: 24h | Page: 22 | totalHits: 3673 | hits on page: 40
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: RU39980
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU39980%27 HTTP/1.1" 200 None
2026-03-28 12:02:51 [auto1.it] INFO: Scrape type for RU39980: 0
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: NG82914
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: JD30560
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: LC51604
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: VV63992
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: BP08183
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: DZ95846
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ95846%27 HTTP/1.1" 200 None
2026-03-28 12:02:51 [auto1.it] INFO: Scrape type for DZ95846: 0
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: ZT44032
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: UF05417
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF05417%27 HTTP/1.1" 200 None
2026-03-28 12:02:51 [auto1.it] INFO: Scrape type for UF05417: 0
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: DX27899
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX27899%27 HTTP/1.1" 200 None
2026-03-28 12:02:51 [auto1.it] INFO: Scrape type for DX27899: 0
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: ZT61879
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: YV19719
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: GV78973
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV78973%27 HTTP/1.1" 200 None
2026-03-28 12:02:51 [auto1.it] INFO: Scrape type for GV78973: 0
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: DK34642
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: AB97936
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB97936%27 HTTP/1.1" 200 None
2026-03-28 12:02:51 [auto1.it] INFO: Scrape type for AB97936: 2
2026-03-28 12:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3beea30a-8b3f-59d5-9bae-f3d1f46e4944 with identifier: AB97936
2026-03-28 12:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3beea30a-8b3f-59d5-9bae-f3d1f46e4944 with scrape type 2
2026-03-28 12:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3beea30a-8b3f-59d5-9bae-f3d1f46e4944 with scrape type 2
2026-03-28 12:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3beea30a-8b3f-59d5-9bae-f3d1f46e4944, identifier: AB97936
2026-03-28 12:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3beea30a-8b3f-59d5-9bae-f3d1f46e4944 with identifier: AB97936
2026-03-28 12:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3beea30a-8b3f-59d5-9bae-f3d1f46e4944 with identifier: AB97936
2026-03-28 12:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3beea30a-8b3f-59d5-9bae-f3d1f46e4944 with identifier: AB97936 to the API
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:20:44Z',
'fuel_type': 'diesel',
'id': '3beea30a-8b3f-59d5-9bae-f3d1f46e4944',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB97936',
'listing': 'auction',
'make': 'Fiat',
'model': 'Idea',
'odometer': 273915,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-20',
'seller_name': None,
'title': 'Fiat Idea 1.3 JTD Multijet Dynamic',
'transmission': 'manual',
'trim': 'Multijet Dynamic',
'year': 2006}
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB97936%27 HTTP/1.1" 200 None
2026-03-28 12:02:51 [auto1.it] INFO: Saving data for AB97936: {'auction_closing_time': 1774714844.0, 'created_time': 1774002224.703182, 'last_price_update_time': 1774699371.619735}
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AB97936') HTTP/1.1" 204 0
2026-03-28 12:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: UJ97267
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: GT90987
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: UM32234
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM32234%27 HTTP/1.1" 200 None
2026-03-28 12:02:51 [auto1.it] INFO: Scrape type for UM32234: 0
2026-03-28 12:02:51 [auto1.it] INFO: Found listing with ID: HT07247
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT07247%27 HTTP/1.1" 200 None
2026-03-28 12:02:51 [auto1.it] INFO: Scrape type for HT07247: 2
2026-03-28 12:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80008e0a-c183-5ecc-8819-f2551f0e2e7c with identifier: HT07247
2026-03-28 12:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80008e0a-c183-5ecc-8819-f2551f0e2e7c with scrape type 2
2026-03-28 12:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80008e0a-c183-5ecc-8819-f2551f0e2e7c with scrape type 2
2026-03-28 12:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 80008e0a-c183-5ecc-8819-f2551f0e2e7c, identifier: HT07247
2026-03-28 12:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 80008e0a-c183-5ecc-8819-f2551f0e2e7c with identifier: HT07247
2026-03-28 12:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 80008e0a-c183-5ecc-8819-f2551f0e2e7c with identifier: HT07247
2026-03-28 12:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 80008e0a-c183-5ecc-8819-f2551f0e2e7c with identifier: HT07247 to the API
2026-03-28 12:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:12:03Z',
'fuel_type': 'petrol',
'id': '80008e0a-c183-5ecc-8819-f2551f0e2e7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT07247',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Picasso',
'odometer': 204156,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-13',
'seller_name': None,
'title': 'Citroen C3 Picasso 1.4 VTi Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2011}
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT07247%27 HTTP/1.1" 200 None
2026-03-28 12:02:52 [auto1.it] INFO: Saving data for HT07247: {'auction_closing_time': 1774714323.0, 'created_time': 1774040472.644404, 'last_price_update_time': 1774699372.183568}
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HT07247') HTTP/1.1" 204 0
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: AF88379
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF88379%27 HTTP/1.1" 200 None
2026-03-28 12:02:52 [auto1.it] INFO: Scrape type for AF88379: 0
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: MT61619
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT61619%27 HTTP/1.1" 200 None
2026-03-28 12:02:52 [auto1.it] INFO: Scrape type for MT61619: 0
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: GS31423
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: EH64041
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: FX46616
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: PG69305
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: BJ50784
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: CC86207
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: YK89440
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK89440%27 HTTP/1.1" 200 None
2026-03-28 12:02:52 [auto1.it] INFO: Scrape type for YK89440: 0
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: SW20348
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW20348%27 HTTP/1.1" 200 None
2026-03-28 12:02:52 [auto1.it] INFO: Scrape type for SW20348: 0
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: PZ47386
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ47386%27 HTTP/1.1" 200 None
2026-03-28 12:02:52 [auto1.it] INFO: Scrape type for PZ47386: 0
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: SD88431
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: DP81604
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: ZU90701
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU90701%27 HTTP/1.1" 200 None
2026-03-28 12:02:52 [auto1.it] INFO: Scrape type for ZU90701: 0
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: LD73585
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: MU03817
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU03817%27 HTTP/1.1" 200 None
2026-03-28 12:02:52 [auto1.it] INFO: Scrape type for MU03817: 0
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: LP02443
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP02443%27 HTTP/1.1" 200 None
2026-03-28 12:02:52 [auto1.it] INFO: Scrape type for LP02443: 0
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: FB11512
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB11512%27 HTTP/1.1" 200 None
2026-03-28 12:02:52 [auto1.it] INFO: Scrape type for FB11512: 0
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: NR94524
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR94524%27 HTTP/1.1" 200 None
2026-03-28 12:02:52 [auto1.it] INFO: Scrape type for NR94524: 0
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: KB15233
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB15233%27 HTTP/1.1" 200 None
2026-03-28 12:02:52 [auto1.it] INFO: Scrape type for KB15233: 0
2026-03-28 12:02:52 [auto1.it] INFO: Found listing with ID: AC52318
2026-03-28 12:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:53 [auto1.it] INFO: Channel: 24h | Page: 23 | totalHits: 3673 | hits on page: 40
2026-03-28 12:02:53 [auto1.it] INFO: Found listing with ID: NR89039
2026-03-28 12:02:53 [auto1.it] INFO: Found listing with ID: UY23152
2026-03-28 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY23152%27 HTTP/1.1" 200 None
2026-03-28 12:02:53 [auto1.it] INFO: Scrape type for UY23152: 0
2026-03-28 12:02:53 [auto1.it] INFO: Found listing with ID: BC74314
2026-03-28 12:02:53 [auto1.it] INFO: Found listing with ID: HU90356
2026-03-28 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU90356%27 HTTP/1.1" 200 None
2026-03-28 12:02:53 [auto1.it] INFO: Scrape type for HU90356: 0
2026-03-28 12:02:53 [auto1.it] INFO: Found listing with ID: AU61443
2026-03-28 12:02:53 [auto1.it] INFO: Found listing with ID: LS03457
2026-03-28 12:02:53 [auto1.it] INFO: Found listing with ID: SU12582
2026-03-28 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU12582%27 HTTP/1.1" 200 None
2026-03-28 12:02:53 [auto1.it] INFO: Scrape type for SU12582: 0
2026-03-28 12:02:53 [auto1.it] INFO: Found listing with ID: CH03473
2026-03-28 12:02:53 [auto1.it] INFO: Found listing with ID: BF84159
2026-03-28 12:02:53 [auto1.it] INFO: Found listing with ID: PE07911
2026-03-28 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE07911%27 HTTP/1.1" 200 None
2026-03-28 12:02:53 [auto1.it] INFO: Scrape type for PE07911: 2
2026-03-28 12:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3958c421-fdf5-5533-bed7-3dc006ee1e68 with identifier: PE07911
2026-03-28 12:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3958c421-fdf5-5533-bed7-3dc006ee1e68 with scrape type 2
2026-03-28 12:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3958c421-fdf5-5533-bed7-3dc006ee1e68 with scrape type 2
2026-03-28 12:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3958c421-fdf5-5533-bed7-3dc006ee1e68, identifier: PE07911
2026-03-28 12:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3958c421-fdf5-5533-bed7-3dc006ee1e68 with identifier: PE07911
2026-03-28 12:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3958c421-fdf5-5533-bed7-3dc006ee1e68 with identifier: PE07911
2026-03-28 12:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3958c421-fdf5-5533-bed7-3dc006ee1e68 with identifier: PE07911 to the API
2026-03-28 12:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:44:25Z',
'fuel_type': 'diesel',
'id': '3958c421-fdf5-5533-bed7-3dc006ee1e68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE07911',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 308680,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-02-28',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 270 CDI Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2005}
2026-03-28 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE07911%27 HTTP/1.1" 200 None
2026-03-28 12:02:53 [auto1.it] INFO: Saving data for PE07911: {'auction_closing_time': 1774716265.0, 'created_time': 1774015480.282595, 'last_price_update_time': 1774699373.925976}
2026-03-28 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PE07911') HTTP/1.1" 204 0
2026-03-28 12:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: LP76273
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: WD39478
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD39478%27 HTTP/1.1" 200 None
2026-03-28 12:02:54 [auto1.it] INFO: Scrape type for WD39478: 0
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: AB43384
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB43384%27 HTTP/1.1" 200 None
2026-03-28 12:02:54 [auto1.it] INFO: Scrape type for AB43384: 2
2026-03-28 12:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f68de3e9-3d00-5508-bb14-6d7afd83eae1 with identifier: AB43384
2026-03-28 12:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f68de3e9-3d00-5508-bb14-6d7afd83eae1 with scrape type 2
2026-03-28 12:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f68de3e9-3d00-5508-bb14-6d7afd83eae1 with scrape type 2
2026-03-28 12:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f68de3e9-3d00-5508-bb14-6d7afd83eae1, identifier: AB43384
2026-03-28 12:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f68de3e9-3d00-5508-bb14-6d7afd83eae1 with identifier: AB43384
2026-03-28 12:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f68de3e9-3d00-5508-bb14-6d7afd83eae1 with identifier: AB43384
2026-03-28 12:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f68de3e9-3d00-5508-bb14-6d7afd83eae1 with identifier: AB43384 to the API
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-28T16:59:53Z',
'fuel_type': 'petrol',
'id': 'f68de3e9-3d00-5508-bb14-6d7afd83eae1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB43384',
'listing': 'auction',
'make': 'Citroen',
'model': 'C1',
'odometer': 174706,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-19',
'seller_name': None,
'title': 'Citroen C1 1.0 Seduction',
'transmission': 'manual',
'trim': 'Seduction',
'year': 2013}
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB43384%27 HTTP/1.1" 200 None
2026-03-28 12:02:54 [auto1.it] INFO: Saving data for AB43384: {'auction_closing_time': 1774717193.0, 'created_time': 1773132583.030874, 'last_price_update_time': 1774699374.479338}
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AB43384') HTTP/1.1" 204 0
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: CS05902
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: LY95127
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: NN95348
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN95348%27 HTTP/1.1" 200 None
2026-03-28 12:02:54 [auto1.it] INFO: Scrape type for NN95348: 0
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: RR71637
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: YT62048
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: HN00760
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: TA79833
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA79833%27 HTTP/1.1" 200 None
2026-03-28 12:02:54 [auto1.it] INFO: Scrape type for TA79833: 0
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: VH62552
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH62552%27 HTTP/1.1" 200 None
2026-03-28 12:02:54 [auto1.it] INFO: Scrape type for VH62552: 0
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: JV70876
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: NY67397
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY67397%27 HTTP/1.1" 200 None
2026-03-28 12:02:54 [auto1.it] INFO: Scrape type for NY67397: 0
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: GG13380
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG13380%27 HTTP/1.1" 200 None
2026-03-28 12:02:54 [auto1.it] INFO: Scrape type for GG13380: 0
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: EF94220
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF94220%27 HTTP/1.1" 200 None
2026-03-28 12:02:54 [auto1.it] INFO: Scrape type for EF94220: 0
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: SP82579
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP82579%27 HTTP/1.1" 200 None
2026-03-28 12:02:54 [auto1.it] INFO: Scrape type for SP82579: 0
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: LJ38222
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ38222%27 HTTP/1.1" 200 None
2026-03-28 12:02:54 [auto1.it] INFO: Scrape type for LJ38222: 0
2026-03-28 12:02:54 [auto1.it] INFO: Found listing with ID: EZ15489
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ15489%27 HTTP/1.1" 200 None
2026-03-28 12:02:54 [auto1.it] INFO: Scrape type for EZ15489: 2
2026-03-28 12:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a9278b1-3b53-588b-b7d6-9d79f743be35 with identifier: EZ15489
2026-03-28 12:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a9278b1-3b53-588b-b7d6-9d79f743be35 with scrape type 2
2026-03-28 12:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a9278b1-3b53-588b-b7d6-9d79f743be35 with scrape type 2
2026-03-28 12:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7a9278b1-3b53-588b-b7d6-9d79f743be35, identifier: EZ15489
2026-03-28 12:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7a9278b1-3b53-588b-b7d6-9d79f743be35 with identifier: EZ15489
2026-03-28 12:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7a9278b1-3b53-588b-b7d6-9d79f743be35 with identifier: EZ15489
2026-03-28 12:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7a9278b1-3b53-588b-b7d6-9d79f743be35 with identifier: EZ15489 to the API
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:33:42Z',
'fuel_type': 'petrol',
'id': '7a9278b1-3b53-588b-b7d6-9d79f743be35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ15489',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 129852,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-31',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2009}
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ15489%27 HTTP/1.1" 200 None
2026-03-28 12:02:55 [auto1.it] INFO: Saving data for EZ15489: {'auction_closing_time': 1774715622.0, 'created_time': 1774515716.511489, 'last_price_update_time': 1774699375.093271}
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EZ15489') HTTP/1.1" 204 0
2026-03-28 12:02:55 [auto1.it] INFO: Found listing with ID: HY22945
2026-03-28 12:02:55 [auto1.it] INFO: Found listing with ID: PY49742
2026-03-28 12:02:55 [auto1.it] INFO: Found listing with ID: VX37353
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX37353%27 HTTP/1.1" 200 None
2026-03-28 12:02:55 [auto1.it] INFO: Scrape type for VX37353: 0
2026-03-28 12:02:55 [auto1.it] INFO: Found listing with ID: ZP51405
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP51405%27 HTTP/1.1" 200 None
2026-03-28 12:02:55 [auto1.it] INFO: Scrape type for ZP51405: 0
2026-03-28 12:02:55 [auto1.it] INFO: Found listing with ID: EG41470
2026-03-28 12:02:55 [auto1.it] INFO: Found listing with ID: UD85899
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD85899%27 HTTP/1.1" 200 None
2026-03-28 12:02:55 [auto1.it] INFO: Scrape type for UD85899: 0
2026-03-28 12:02:55 [auto1.it] INFO: Found listing with ID: JZ67202
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ67202%27 HTTP/1.1" 200 None
2026-03-28 12:02:55 [auto1.it] INFO: Scrape type for JZ67202: 0
2026-03-28 12:02:55 [auto1.it] INFO: Found listing with ID: ZM49441
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM49441%27 HTTP/1.1" 200 None
2026-03-28 12:02:55 [auto1.it] INFO: Scrape type for ZM49441: 0
2026-03-28 12:02:55 [auto1.it] INFO: Found listing with ID: VV14244
2026-03-28 12:02:55 [auto1.it] INFO: Found listing with ID: JR03876
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR03876%27 HTTP/1.1" 200 None
2026-03-28 12:02:55 [auto1.it] INFO: Scrape type for JR03876: 0
2026-03-28 12:02:55 [auto1.it] INFO: Found listing with ID: VH71925
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH71925%27 HTTP/1.1" 200 None
2026-03-28 12:02:55 [auto1.it] INFO: Scrape type for VH71925: 0
2026-03-28 12:02:55 [auto1.it] INFO: Found listing with ID: TE89149
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE89149%27 HTTP/1.1" 200 None
2026-03-28 12:02:55 [auto1.it] INFO: Scrape type for TE89149: 0
2026-03-28 12:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:56 [auto1.it] INFO: Channel: 24h | Page: 24 | totalHits: 3673 | hits on page: 40
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: CC36566
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC36566%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for CC36566: 0
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: RT91263
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT91263%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for RT91263: 0
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: VP99832
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: DS58810
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: JT10117
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT10117%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for JT10117: 0
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: HS83274
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: LA76603
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: CC08861
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC08861%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for CC08861: 0
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: XN65989
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN65989%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for XN65989: 0
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: UP48367
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: HD54235
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: HS60587
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS60587%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for HS60587: 0
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: TX80961
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX80961%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for TX80961: 0
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: BP45354
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP45354%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for BP45354: 0
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: SS67586
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: ZW77638
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW77638%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for ZW77638: 0
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: DS11019
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS11019%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for DS11019: 0
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: MT42798
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT42798%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for MT42798: 0
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: AY21125
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: XF71251
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF71251%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for XF71251: 0
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: YG03340
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: HV87754
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: UE23071
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE23071%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for UE23071: 0
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: SP98700
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: CH78028
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: RS56443
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS56443%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for RS56443: 0
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: VZ89804
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: FP61129
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP61129%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for FP61129: 0
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: AT32399
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT32399%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for AT32399: 0
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: LC14849
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC14849%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for LC14849: 0
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: WJ96008
2026-03-28 12:02:56 [auto1.it] INFO: Found listing with ID: AF81201
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF81201%27 HTTP/1.1" 200 None
2026-03-28 12:02:56 [auto1.it] INFO: Scrape type for AF81201: 2
2026-03-28 12:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54dd442c-05bf-5106-897c-c3f9e064371c with identifier: AF81201
2026-03-28 12:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54dd442c-05bf-5106-897c-c3f9e064371c with scrape type 2
2026-03-28 12:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54dd442c-05bf-5106-897c-c3f9e064371c with scrape type 2
2026-03-28 12:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 54dd442c-05bf-5106-897c-c3f9e064371c, identifier: AF81201
2026-03-28 12:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 54dd442c-05bf-5106-897c-c3f9e064371c with identifier: AF81201
2026-03-28 12:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 54dd442c-05bf-5106-897c-c3f9e064371c with identifier: AF81201
2026-03-28 12:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 54dd442c-05bf-5106-897c-c3f9e064371c with identifier: AF81201 to the API
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:16:38Z',
'fuel_type': 'diesel',
'id': '54dd442c-05bf-5106-897c-c3f9e064371c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF81201',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Freelander',
'odometer': 272333,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-24',
'seller_name': None,
'title': 'Land Rover Freelander 2.2 Td4 SE',
'transmission': 'manual',
'trim': 'SE',
'year': 2014}
2026-03-28 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF81201%27 HTTP/1.1" 200 None
2026-03-28 12:02:57 [auto1.it] INFO: Saving data for AF81201: {'auction_closing_time': 1774714598.0, 'created_time': 1774515657.593385, 'last_price_update_time': 1774699377.016806}
2026-03-28 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AF81201') HTTP/1.1" 204 0
2026-03-28 12:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:57 [auto1.it] INFO: Found listing with ID: RR40401
2026-03-28 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR40401%27 HTTP/1.1" 200 None
2026-03-28 12:02:57 [auto1.it] INFO: Scrape type for RR40401: 2
2026-03-28 12:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b105351-4b8b-5d33-85b5-f9cb3ff27b61 with identifier: RR40401
2026-03-28 12:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b105351-4b8b-5d33-85b5-f9cb3ff27b61 with scrape type 2
2026-03-28 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b105351-4b8b-5d33-85b5-f9cb3ff27b61 with scrape type 2
2026-03-28 12:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2b105351-4b8b-5d33-85b5-f9cb3ff27b61, identifier: RR40401
2026-03-28 12:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2b105351-4b8b-5d33-85b5-f9cb3ff27b61 with identifier: RR40401
2026-03-28 12:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2b105351-4b8b-5d33-85b5-f9cb3ff27b61 with identifier: RR40401
2026-03-28 12:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2b105351-4b8b-5d33-85b5-f9cb3ff27b61 with identifier: RR40401 to the API
2026-03-28 12:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:12:33Z',
'fuel_type': 'diesel',
'id': '2b105351-4b8b-5d33-85b5-f9cb3ff27b61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR40401',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 132276,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-23',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 270 L1 Trend',
'transmission': 'manual',
'trim': '270 L1 Trend',
'year': 2017}
2026-03-28 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR40401%27 HTTP/1.1" 200 None
2026-03-28 12:02:57 [auto1.it] INFO: Saving data for RR40401: {'auction_closing_time': 1774714353.0, 'created_time': 1774515714.574722, 'last_price_update_time': 1774699377.564555}
2026-03-28 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RR40401') HTTP/1.1" 204 0
2026-03-28 12:02:57 [auto1.it] INFO: Found listing with ID: TA22060
2026-03-28 12:02:57 [auto1.it] INFO: Found listing with ID: ZW69892
2026-03-28 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW69892%27 HTTP/1.1" 200 None
2026-03-28 12:02:57 [auto1.it] INFO: Scrape type for ZW69892: 2
2026-03-28 12:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6181487e-3ac8-5cd4-8265-d7c6a45c413e with identifier: ZW69892
2026-03-28 12:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6181487e-3ac8-5cd4-8265-d7c6a45c413e with scrape type 2
2026-03-28 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6181487e-3ac8-5cd4-8265-d7c6a45c413e with scrape type 2
2026-03-28 12:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6181487e-3ac8-5cd4-8265-d7c6a45c413e, identifier: ZW69892
2026-03-28 12:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6181487e-3ac8-5cd4-8265-d7c6a45c413e with identifier: ZW69892
2026-03-28 12:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6181487e-3ac8-5cd4-8265-d7c6a45c413e with identifier: ZW69892
2026-03-28 12:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6181487e-3ac8-5cd4-8265-d7c6a45c413e with identifier: ZW69892 to the API
2026-03-28 12:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:36:41Z',
'fuel_type': 'diesel',
'id': '6181487e-3ac8-5cd4-8265-d7c6a45c413e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW69892',
'listing': 'auction',
'make': 'Jaguar',
'model': 'E-Pace',
'odometer': 87073,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-08',
'seller_name': None,
'title': 'Jaguar E-Pace D165 Mild-Hybrid S AWD',
'transmission': 'automatic',
'trim': 'S AWD',
'year': 2021}
2026-03-28 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW69892%27 HTTP/1.1" 200 None
2026-03-28 12:02:58 [auto1.it] INFO: Saving data for ZW69892: {'auction_closing_time': 1774715801.0, 'created_time': 1774515740.530698, 'last_price_update_time': 1774699378.007795}
2026-03-28 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZW69892') HTTP/1.1" 204 0
2026-03-28 12:02:58 [auto1.it] INFO: Found listing with ID: VS11522
2026-03-28 12:02:58 [auto1.it] INFO: Found listing with ID: NU78956
2026-03-28 12:02:58 [auto1.it] INFO: Found listing with ID: PT72554
2026-03-28 12:02:58 [auto1.it] INFO: Found listing with ID: BV97691
2026-03-28 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV97691%27 HTTP/1.1" 200 None
2026-03-28 12:02:58 [auto1.it] INFO: Scrape type for BV97691: 0
2026-03-28 12:02:58 [auto1.it] INFO: Found listing with ID: CF78450
2026-03-28 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF78450%27 HTTP/1.1" 200 None
2026-03-28 12:02:58 [auto1.it] INFO: Scrape type for CF78450: 0
2026-03-28 12:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:58 [auto1.it] INFO: Channel: 24h | Page: 25 | totalHits: 3673 | hits on page: 40
2026-03-28 12:02:58 [auto1.it] INFO: Found listing with ID: FU36199
2026-03-28 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU36199%27 HTTP/1.1" 200 None
2026-03-28 12:02:58 [auto1.it] INFO: Scrape type for FU36199: 0
2026-03-28 12:02:58 [auto1.it] INFO: Found listing with ID: AD96495
2026-03-28 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD96495%27 HTTP/1.1" 200 None
2026-03-28 12:02:58 [auto1.it] INFO: Scrape type for AD96495: 2
2026-03-28 12:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fa2d1f3-03ae-5338-a7ca-2f16d5a593cc with identifier: AD96495
2026-03-28 12:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fa2d1f3-03ae-5338-a7ca-2f16d5a593cc with scrape type 2
2026-03-28 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fa2d1f3-03ae-5338-a7ca-2f16d5a593cc with scrape type 2
2026-03-28 12:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2fa2d1f3-03ae-5338-a7ca-2f16d5a593cc, identifier: AD96495
2026-03-28 12:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2fa2d1f3-03ae-5338-a7ca-2f16d5a593cc with identifier: AD96495
2026-03-28 12:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2fa2d1f3-03ae-5338-a7ca-2f16d5a593cc with identifier: AD96495
2026-03-28 12:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2fa2d1f3-03ae-5338-a7ca-2f16d5a593cc with identifier: AD96495 to the API
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-28T16:00:16Z',
'fuel_type': 'petrol',
'id': '2fa2d1f3-03ae-5338-a7ca-2f16d5a593cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD96495',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 148936,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-27',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 THP Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2018}
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD96495%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Saving data for AD96495: {'auction_closing_time': 1774713616.0, 'created_time': 1774515732.043336, 'last_price_update_time': 1774699379.37907}
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AD96495') HTTP/1.1" 204 0
2026-03-28 12:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: DJ66527
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: EC51019
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC51019%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for EC51019: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: CH88707
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: LY98983
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY98983%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for LY98983: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: YP32890
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP32890%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for YP32890: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: WL70343
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL70343%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for WL70343: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: JD09994
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD09994%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for JD09994: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: AA32249
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: AX60042
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX60042%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for AX60042: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: NN95862
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: MH62974
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH62974%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for MH62974: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: VS31933
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS31933%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for VS31933: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: KH50025
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH50025%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for KH50025: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: KZ03059
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ03059%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for KZ03059: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: BA03672
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA03672%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for BA03672: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: DY31540
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY31540%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for DY31540: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: WG30264
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG30264%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for WG30264: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: LH23447
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH23447%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for LH23447: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: DB60512
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: ER97620
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: LW22359
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW22359%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for LW22359: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: RA17642
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA17642%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for RA17642: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: XA69003
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: FA25945
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: XH39362
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: EE84208
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: AM77280
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: VH07550
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: DW53696
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: HA02667
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: VF37743
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF37743%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for VF37743: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: YF99217
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF99217%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for YF99217: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: DY73296
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY73296%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for DY73296: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: EG78333
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG78333%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for EG78333: 0
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: PY58212
2026-03-28 12:02:59 [auto1.it] INFO: Found listing with ID: RZ99853
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ99853%27 HTTP/1.1" 200 None
2026-03-28 12:02:59 [auto1.it] INFO: Scrape type for RZ99853: 2
2026-03-28 12:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f762c57-891f-5c4c-b0cc-988b3738e03d with identifier: RZ99853
2026-03-28 12:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f762c57-891f-5c4c-b0cc-988b3738e03d with scrape type 2
2026-03-28 12:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f762c57-891f-5c4c-b0cc-988b3738e03d with scrape type 2
2026-03-28 12:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f762c57-891f-5c4c-b0cc-988b3738e03d, identifier: RZ99853
2026-03-28 12:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f762c57-891f-5c4c-b0cc-988b3738e03d with identifier: RZ99853
2026-03-28 12:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f762c57-891f-5c4c-b0cc-988b3738e03d with identifier: RZ99853
2026-03-28 12:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f762c57-891f-5c4c-b0cc-988b3738e03d with identifier: RZ99853 to the API
2026-03-28 12:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 179,
'expiration_date': '2026-03-28T16:08:25Z',
'fuel_type': 'diesel',
'id': '0f762c57-891f-5c4c-b0cc-988b3738e03d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ99853',
'listing': 'auction',
'make': 'Fiat',
'model': 'Ducato',
'odometer': 178582,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-31',
'seller_name': None,
'title': 'Fiat Ducato 2.2 M-Jet L5H3 RS: 4035 mm',
'transmission': 'automatic',
'trim': 'L5H3 RS: 4035 mm',
'year': 2022}
2026-03-28 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ99853%27 HTTP/1.1" 200 None
2026-03-28 12:03:00 [auto1.it] INFO: Saving data for RZ99853: {'auction_closing_time': 1774714105.0, 'created_time': 1774515718.069971, 'last_price_update_time': 1774699380.365093}
2026-03-28 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RZ99853') HTTP/1.1" 204 0
2026-03-28 12:03:00 [auto1.it] INFO: Found listing with ID: RL06920
2026-03-28 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL06920%27 HTTP/1.1" 200 None
2026-03-28 12:03:00 [auto1.it] INFO: Scrape type for RL06920: 0
2026-03-28 12:03:00 [auto1.it] INFO: Found listing with ID: GK45626
2026-03-28 12:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:01 [auto1.it] INFO: Channel: 24h | Page: 26 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:01 [auto1.it] INFO: Found listing with ID: TY80704
2026-03-28 12:03:01 [auto1.it] INFO: Found listing with ID: TU01190
2026-03-28 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU01190%27 HTTP/1.1" 200 None
2026-03-28 12:03:01 [auto1.it] INFO: Scrape type for TU01190: 0
2026-03-28 12:03:01 [auto1.it] INFO: Found listing with ID: LW64667
2026-03-28 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW64667%27 HTTP/1.1" 200 None
2026-03-28 12:03:01 [auto1.it] INFO: Scrape type for LW64667: 2
2026-03-28 12:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 520253d3-a283-5f8f-88ed-430ae2ff941b with identifier: LW64667
2026-03-28 12:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 520253d3-a283-5f8f-88ed-430ae2ff941b with scrape type 2
2026-03-28 12:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 520253d3-a283-5f8f-88ed-430ae2ff941b with scrape type 2
2026-03-28 12:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 520253d3-a283-5f8f-88ed-430ae2ff941b, identifier: LW64667
2026-03-28 12:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 520253d3-a283-5f8f-88ed-430ae2ff941b with identifier: LW64667
2026-03-28 12:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 520253d3-a283-5f8f-88ed-430ae2ff941b with identifier: LW64667
2026-03-28 12:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 520253d3-a283-5f8f-88ed-430ae2ff941b with identifier: LW64667 to the API
2026-03-28 12:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:59:08Z',
'fuel_type': 'diesel',
'id': '520253d3-a283-5f8f-88ed-430ae2ff941b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW64667',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 151438,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-28',
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Energy Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2017}
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW64667%27 HTTP/1.1" 200 None
2026-03-28 12:03:02 [auto1.it] INFO: Saving data for LW64667: {'auction_closing_time': 1774717148.0, 'created_time': 1774515721.52166, 'last_price_update_time': 1774699382.09228}
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LW64667') HTTP/1.1" 204 0
2026-03-28 12:03:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: AG51649
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: HY24657
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY24657%27 HTTP/1.1" 200 None
2026-03-28 12:03:02 [auto1.it] INFO: Scrape type for HY24657: 0
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: BA90157
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA90157%27 HTTP/1.1" 200 None
2026-03-28 12:03:02 [auto1.it] INFO: Scrape type for BA90157: 0
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: AZ56413
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: EV65529
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: HK54342
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK54342%27 HTTP/1.1" 200 None
2026-03-28 12:03:02 [auto1.it] INFO: Scrape type for HK54342: 0
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: TD67992
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD67992%27 HTTP/1.1" 200 None
2026-03-28 12:03:02 [auto1.it] INFO: Scrape type for TD67992: 2
2026-03-28 12:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d01a0149-f1bb-52f3-8586-c057af749a0b with identifier: TD67992
2026-03-28 12:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d01a0149-f1bb-52f3-8586-c057af749a0b with scrape type 2
2026-03-28 12:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d01a0149-f1bb-52f3-8586-c057af749a0b with scrape type 2
2026-03-28 12:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d01a0149-f1bb-52f3-8586-c057af749a0b, identifier: TD67992
2026-03-28 12:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d01a0149-f1bb-52f3-8586-c057af749a0b with identifier: TD67992
2026-03-28 12:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d01a0149-f1bb-52f3-8586-c057af749a0b with identifier: TD67992
2026-03-28 12:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d01a0149-f1bb-52f3-8586-c057af749a0b with identifier: TD67992 to the API
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:31:09Z',
'fuel_type': 'diesel',
'id': 'd01a0149-f1bb-52f3-8586-c057af749a0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD67992',
'listing': 'auction',
'make': 'Infiniti',
'model': 'Q30',
'odometer': 218769,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-20',
'seller_name': None,
'title': 'Infiniti Q30 1.5 Diesel Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2016}
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD67992%27 HTTP/1.1" 200 None
2026-03-28 12:03:02 [auto1.it] INFO: Saving data for TD67992: {'auction_closing_time': 1774715469.0, 'created_time': 1772309534.579174, 'last_price_update_time': 1774699382.727669}
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TD67992') HTTP/1.1" 204 0
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: BD83162
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: WZ30101
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: FP75199
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: KX92942
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: HC85966
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: RC69852
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC69852%27 HTTP/1.1" 200 None
2026-03-28 12:03:02 [auto1.it] INFO: Scrape type for RC69852: 0
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: NB44357
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB44357%27 HTTP/1.1" 200 None
2026-03-28 12:03:02 [auto1.it] INFO: Scrape type for NB44357: 0
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: NV42271
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: CS16004
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: YA80598
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: EX06021
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX06021%27 HTTP/1.1" 200 None
2026-03-28 12:03:02 [auto1.it] INFO: Scrape type for EX06021: 0
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: MS41612
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS41612%27 HTTP/1.1" 200 None
2026-03-28 12:03:02 [auto1.it] INFO: Scrape type for MS41612: 0
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: RN15914
2026-03-28 12:03:02 [auto1.it] INFO: Found listing with ID: TP79080
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP79080%27 HTTP/1.1" 200 None
2026-03-28 12:03:02 [auto1.it] INFO: Scrape type for TP79080: 2
2026-03-28 12:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bbd25ec-d79e-533b-ae13-646fcc33bf54 with identifier: TP79080
2026-03-28 12:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bbd25ec-d79e-533b-ae13-646fcc33bf54 with scrape type 2
2026-03-28 12:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bbd25ec-d79e-533b-ae13-646fcc33bf54 with scrape type 2
2026-03-28 12:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0bbd25ec-d79e-533b-ae13-646fcc33bf54, identifier: TP79080
2026-03-28 12:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0bbd25ec-d79e-533b-ae13-646fcc33bf54 with identifier: TP79080
2026-03-28 12:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0bbd25ec-d79e-533b-ae13-646fcc33bf54 with identifier: TP79080
2026-03-28 12:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0bbd25ec-d79e-533b-ae13-646fcc33bf54 with identifier: TP79080 to the API
2026-03-28 12:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 211,
'expiration_date': '2026-03-28T16:03:11Z',
'fuel_type': 'hybrid',
'id': '0bbd25ec-d79e-533b-ae13-646fcc33bf54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP79080',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC40',
'odometer': 101146,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-08',
'seller_name': None,
'title': 'Volvo XC40 1.5 T5 Recharge Plug-in Hybrid Inscription Expression '
'2WD',
'transmission': 'automatic',
'trim': 'Inscription Expression 2WD',
'year': 2021}
2026-03-28 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP79080%27 HTTP/1.1" 200 None
2026-03-28 12:03:03 [auto1.it] INFO: Saving data for TP79080: {'auction_closing_time': 1774713791.0, 'created_time': 1774515736.461623, 'last_price_update_time': 1774699383.354421}
2026-03-28 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TP79080') HTTP/1.1" 204 0
2026-03-28 12:03:03 [auto1.it] INFO: Found listing with ID: WE89582
2026-03-28 12:03:03 [auto1.it] INFO: Found listing with ID: EF87195
2026-03-28 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF87195%27 HTTP/1.1" 200 None
2026-03-28 12:03:03 [auto1.it] INFO: Scrape type for EF87195: 2
2026-03-28 12:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fe84691-f83e-5249-8af9-631bd29125c8 with identifier: EF87195
2026-03-28 12:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fe84691-f83e-5249-8af9-631bd29125c8 with scrape type 2
2026-03-28 12:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fe84691-f83e-5249-8af9-631bd29125c8 with scrape type 2
2026-03-28 12:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3fe84691-f83e-5249-8af9-631bd29125c8, identifier: EF87195
2026-03-28 12:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3fe84691-f83e-5249-8af9-631bd29125c8 with identifier: EF87195
2026-03-28 12:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3fe84691-f83e-5249-8af9-631bd29125c8 with identifier: EF87195
2026-03-28 12:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3fe84691-f83e-5249-8af9-631bd29125c8 with identifier: EF87195 to the API
2026-03-28 12:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-28T16:31:22Z',
'fuel_type': 'hybrid',
'id': '3fe84691-f83e-5249-8af9-631bd29125c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF87195',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 141763,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-17',
'seller_name': None,
'title': 'Toyota RAV 4 2.5 Hybrid 4x2 Business',
'transmission': 'automatic',
'trim': '4x2 Business',
'year': 2021}
2026-03-28 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF87195%27 HTTP/1.1" 200 None
2026-03-28 12:03:03 [auto1.it] INFO: Saving data for EF87195: {'auction_closing_time': 1774715482.0, 'created_time': 1774515727.701366, 'last_price_update_time': 1774699383.951642}
2026-03-28 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EF87195') HTTP/1.1" 204 0
2026-03-28 12:03:03 [auto1.it] INFO: Found listing with ID: WE25816
2026-03-28 12:03:03 [auto1.it] INFO: Found listing with ID: BH62739
2026-03-28 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH62739%27 HTTP/1.1" 200 None
2026-03-28 12:03:03 [auto1.it] INFO: Scrape type for BH62739: 0
2026-03-28 12:03:03 [auto1.it] INFO: Found listing with ID: HE61861
2026-03-28 12:03:03 [auto1.it] INFO: Found listing with ID: ZP49610
2026-03-28 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP49610%27 HTTP/1.1" 200 None
2026-03-28 12:03:04 [auto1.it] INFO: Scrape type for ZP49610: 0
2026-03-28 12:03:04 [auto1.it] INFO: Found listing with ID: JF46642
2026-03-28 12:03:04 [auto1.it] INFO: Found listing with ID: PD12623
2026-03-28 12:03:04 [auto1.it] INFO: Found listing with ID: KZ30481
2026-03-28 12:03:04 [auto1.it] INFO: Found listing with ID: XG03695
2026-03-28 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XG03695%27 HTTP/1.1" 200 None
2026-03-28 12:03:04 [auto1.it] INFO: Scrape type for XG03695: 0
2026-03-28 12:03:04 [auto1.it] INFO: Found listing with ID: ZM05911
2026-03-28 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM05911%27 HTTP/1.1" 200 None
2026-03-28 12:03:04 [auto1.it] INFO: Scrape type for ZM05911: 0
2026-03-28 12:03:04 [auto1.it] INFO: Found listing with ID: SK71918
2026-03-28 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK71918%27 HTTP/1.1" 200 None
2026-03-28 12:03:04 [auto1.it] INFO: Scrape type for SK71918: 0
2026-03-28 12:03:04 [auto1.it] INFO: Found listing with ID: RY16068
2026-03-28 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY16068%27 HTTP/1.1" 200 None
2026-03-28 12:03:04 [auto1.it] INFO: Scrape type for RY16068: 0
2026-03-28 12:03:04 [auto1.it] INFO: Found listing with ID: ZL28386
2026-03-28 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL28386%27 HTTP/1.1" 200 None
2026-03-28 12:03:04 [auto1.it] INFO: Scrape type for ZL28386: 0
2026-03-28 12:03:04 [auto1.it] INFO: Found listing with ID: HA95428
2026-03-28 12:03:04 [auto1.it] INFO: Found listing with ID: YV30830
2026-03-28 12:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:05 [auto1.it] INFO: Channel: 24h | Page: 27 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: GW68034
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: CC46702
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC46702%27 HTTP/1.1" 200 None
2026-03-28 12:03:05 [auto1.it] INFO: Scrape type for CC46702: 0
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: GY41303
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY41303%27 HTTP/1.1" 200 None
2026-03-28 12:03:05 [auto1.it] INFO: Scrape type for GY41303: 2
2026-03-28 12:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b49089e2-f1fb-56de-91e9-d8f0d33177ad with identifier: GY41303
2026-03-28 12:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b49089e2-f1fb-56de-91e9-d8f0d33177ad with scrape type 2
2026-03-28 12:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b49089e2-f1fb-56de-91e9-d8f0d33177ad with scrape type 2
2026-03-28 12:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b49089e2-f1fb-56de-91e9-d8f0d33177ad, identifier: GY41303
2026-03-28 12:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b49089e2-f1fb-56de-91e9-d8f0d33177ad with identifier: GY41303
2026-03-28 12:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b49089e2-f1fb-56de-91e9-d8f0d33177ad with identifier: GY41303
2026-03-28 12:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b49089e2-f1fb-56de-91e9-d8f0d33177ad with identifier: GY41303 to the API
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:18:53Z',
'fuel_type': 'diesel',
'id': 'b49089e2-f1fb-56de-91e9-d8f0d33177ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY41303',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 244807,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-13',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY41303%27 HTTP/1.1" 200 None
2026-03-28 12:03:05 [auto1.it] INFO: Saving data for GY41303: {'auction_closing_time': 1774714733.0, 'created_time': 1774515699.890265, 'last_price_update_time': 1774699385.633793}
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GY41303') HTTP/1.1" 204 0
2026-03-28 12:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: JN64307
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: DT10688
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: KW88913
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: WR05757
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: KN14536
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: GR13537
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR13537%27 HTTP/1.1" 200 None
2026-03-28 12:03:05 [auto1.it] INFO: Scrape type for GR13537: 0
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: PU36388
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: CJ46241
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: DF43050
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF43050%27 HTTP/1.1" 200 None
2026-03-28 12:03:05 [auto1.it] INFO: Scrape type for DF43050: 0
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: PN79982
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN79982%27 HTTP/1.1" 200 None
2026-03-28 12:03:05 [auto1.it] INFO: Scrape type for PN79982: 0
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: VS33073
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS33073%27 HTTP/1.1" 200 None
2026-03-28 12:03:05 [auto1.it] INFO: Scrape type for VS33073: 0
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: GR09815
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: RG52060
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: SJ09087
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ09087%27 HTTP/1.1" 200 None
2026-03-28 12:03:05 [auto1.it] INFO: Scrape type for SJ09087: 0
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: CV33669
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: UB96617
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB96617%27 HTTP/1.1" 200 None
2026-03-28 12:03:05 [auto1.it] INFO: Scrape type for UB96617: 0
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: CC54288
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC54288%27 HTTP/1.1" 200 None
2026-03-28 12:03:05 [auto1.it] INFO: Scrape type for CC54288: 0
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: SR46685
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR46685%27 HTTP/1.1" 200 None
2026-03-28 12:03:05 [auto1.it] INFO: Scrape type for SR46685: 0
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: ZK89803
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK89803%27 HTTP/1.1" 200 None
2026-03-28 12:03:05 [auto1.it] INFO: Scrape type for ZK89803: 0
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: BX02357
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: GH50385
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GH50385%27 HTTP/1.1" 200 None
2026-03-28 12:03:05 [auto1.it] INFO: Scrape type for GH50385: 0
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: JK53283
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: JF95895
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: NT74531
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT74531%27 HTTP/1.1" 200 None
2026-03-28 12:03:05 [auto1.it] INFO: Scrape type for NT74531: 0
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: TS34792
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS34792%27 HTTP/1.1" 200 None
2026-03-28 12:03:05 [auto1.it] INFO: Scrape type for TS34792: 0
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: CS89848
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS89848%27 HTTP/1.1" 200 None
2026-03-28 12:03:05 [auto1.it] INFO: Scrape type for CS89848: 0
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: UY09098
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY09098%27 HTTP/1.1" 200 None
2026-03-28 12:03:05 [auto1.it] INFO: Scrape type for UY09098: 0
2026-03-28 12:03:05 [auto1.it] INFO: Found listing with ID: CP19767
2026-03-28 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP19767%27 HTTP/1.1" 200 None
2026-03-28 12:03:06 [auto1.it] INFO: Scrape type for CP19767: 0
2026-03-28 12:03:06 [auto1.it] INFO: Found listing with ID: KR43222
2026-03-28 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR43222%27 HTTP/1.1" 200 None
2026-03-28 12:03:06 [auto1.it] INFO: Scrape type for KR43222: 2
2026-03-28 12:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16a5b737-86b7-512d-a933-f1dd39f31189 with identifier: KR43222
2026-03-28 12:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16a5b737-86b7-512d-a933-f1dd39f31189 with scrape type 2
2026-03-28 12:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16a5b737-86b7-512d-a933-f1dd39f31189 with scrape type 2
2026-03-28 12:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 16a5b737-86b7-512d-a933-f1dd39f31189, identifier: KR43222
2026-03-28 12:03:06 [scrapy.extensions.logstats] INFO: Crawled 225 pages (at 32 pages/min), scraped 150 items (at 62 items/min)
2026-03-28 12:03:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-28 12:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 16a5b737-86b7-512d-a933-f1dd39f31189 with identifier: KR43222
2026-03-28 12:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 16a5b737-86b7-512d-a933-f1dd39f31189 with identifier: KR43222
2026-03-28 12:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 16a5b737-86b7-512d-a933-f1dd39f31189 with identifier: KR43222 to the API
2026-03-28 12:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:32:48Z',
'fuel_type': 'diesel',
'id': '16a5b737-86b7-512d-a933-f1dd39f31189',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR43222',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 174681,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-22',
'seller_name': None,
'title': 'BMW 5er 520d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-28 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR43222%27 HTTP/1.1" 200 None
2026-03-28 12:03:06 [auto1.it] INFO: Saving data for KR43222: {'auction_closing_time': 1774715568.0, 'created_time': 1774126840.103317, 'last_price_update_time': 1774699386.456182}
2026-03-28 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KR43222') HTTP/1.1" 204 0
2026-03-28 12:03:06 [auto1.it] INFO: Found listing with ID: SU00968
2026-03-28 12:03:06 [auto1.it] INFO: Found listing with ID: NT59940
2026-03-28 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT59940%27 HTTP/1.1" 200 None
2026-03-28 12:03:06 [auto1.it] INFO: Scrape type for NT59940: 0
2026-03-28 12:03:06 [auto1.it] INFO: Found listing with ID: JA46265
2026-03-28 12:03:06 [auto1.it] INFO: Found listing with ID: RR88002
2026-03-28 12:03:06 [auto1.it] INFO: Found listing with ID: KJ52341
2026-03-28 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ52341%27 HTTP/1.1" 200 None
2026-03-28 12:03:06 [auto1.it] INFO: Scrape type for KJ52341: 0
2026-03-28 12:03:06 [auto1.it] INFO: Found listing with ID: ZS89496
2026-03-28 12:03:06 [auto1.it] INFO: Found listing with ID: LF91623
2026-03-28 12:03:06 [auto1.it] INFO: Found listing with ID: EB44721
2026-03-28 12:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:07 [auto1.it] INFO: Channel: 24h | Page: 28 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: TZ05140
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: NG93941
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: NL26741
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: BF95758
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: LG12773
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: SK24078
2026-03-28 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK24078%27 HTTP/1.1" 200 None
2026-03-28 12:03:07 [auto1.it] INFO: Scrape type for SK24078: 0
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: AN86148
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: EM78419
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: TT32643
2026-03-28 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT32643%27 HTTP/1.1" 200 None
2026-03-28 12:03:07 [auto1.it] INFO: Scrape type for TT32643: 0
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: GD67829
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: RA70814
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: BX38119
2026-03-28 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX38119%27 HTTP/1.1" 200 None
2026-03-28 12:03:07 [auto1.it] INFO: Scrape type for BX38119: 0
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: FR55609
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: ZW61080
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: ZN01061
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: CB66149
2026-03-28 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB66149%27 HTTP/1.1" 200 None
2026-03-28 12:03:07 [auto1.it] INFO: Scrape type for CB66149: 0
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: PY10905
2026-03-28 12:03:07 [auto1.it] INFO: Found listing with ID: AR54345
2026-03-28 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR54345%27 HTTP/1.1" 200 None
2026-03-28 12:03:07 [auto1.it] INFO: Scrape type for AR54345: 2
2026-03-28 12:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af88927a-7f40-528a-bd88-d87193f13010 with identifier: AR54345
2026-03-28 12:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af88927a-7f40-528a-bd88-d87193f13010 with scrape type 2
2026-03-28 12:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af88927a-7f40-528a-bd88-d87193f13010 with scrape type 2
2026-03-28 12:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af88927a-7f40-528a-bd88-d87193f13010, identifier: AR54345
2026-03-28 12:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af88927a-7f40-528a-bd88-d87193f13010 with identifier: AR54345
2026-03-28 12:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af88927a-7f40-528a-bd88-d87193f13010 with identifier: AR54345
2026-03-28 12:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af88927a-7f40-528a-bd88-d87193f13010 with identifier: AR54345 to the API
2026-03-28 12:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:36:43Z',
'fuel_type': 'diesel',
'id': 'af88927a-7f40-528a-bd88-d87193f13010',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR54345',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 129273,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-10',
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi Laureate 4x4',
'transmission': 'manual',
'trim': 'Laureate 4x4',
'year': 2014}
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR54345%27 HTTP/1.1" 200 None
2026-03-28 12:03:08 [auto1.it] INFO: Saving data for AR54345: {'auction_closing_time': 1774715803.0, 'created_time': 1774515692.808619, 'last_price_update_time': 1774699388.07743}
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AR54345') HTTP/1.1" 204 0
2026-03-28 12:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: HH71659
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: YL77107
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL77107%27 HTTP/1.1" 200 None
2026-03-28 12:03:08 [auto1.it] INFO: Scrape type for YL77107: 0
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: NZ65760
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ65760%27 HTTP/1.1" 200 None
2026-03-28 12:03:08 [auto1.it] INFO: Scrape type for NZ65760: 0
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: EZ92268
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ92268%27 HTTP/1.1" 200 None
2026-03-28 12:03:08 [auto1.it] INFO: Scrape type for EZ92268: 0
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: SS19742
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS19742%27 HTTP/1.1" 200 None
2026-03-28 12:03:08 [auto1.it] INFO: Scrape type for SS19742: 0
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: UA22723
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: WN10249
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: BS22593
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: RS53925
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS53925%27 HTTP/1.1" 200 None
2026-03-28 12:03:08 [auto1.it] INFO: Scrape type for RS53925: 0
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: WF98355
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: KK16501
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK16501%27 HTTP/1.1" 200 None
2026-03-28 12:03:08 [auto1.it] INFO: Scrape type for KK16501: 0
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: AL46410
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL46410%27 HTTP/1.1" 200 None
2026-03-28 12:03:08 [auto1.it] INFO: Scrape type for AL46410: 0
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: EY73607
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: NR08149
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR08149%27 HTTP/1.1" 200 None
2026-03-28 12:03:08 [auto1.it] INFO: Scrape type for NR08149: 0
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: BR68512
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: ED61814
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: EW91722
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW91722%27 HTTP/1.1" 200 None
2026-03-28 12:03:08 [auto1.it] INFO: Scrape type for EW91722: 0
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: JC71555
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: ZF01645
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: NX47141
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: DN07271
2026-03-28 12:03:08 [auto1.it] INFO: Found listing with ID: GY11839
2026-03-28 12:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:09 [auto1.it] INFO: Channel: 24h | Page: 29 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: AV12122
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: TW69998
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW69998%27 HTTP/1.1" 200 None
2026-03-28 12:03:09 [auto1.it] INFO: Scrape type for TW69998: 0
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: WX96902
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX96902%27 HTTP/1.1" 200 None
2026-03-28 12:03:09 [auto1.it] INFO: Scrape type for WX96902: 0
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: ZZ84284
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: ST13349
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: AT74871
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: LZ72377
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: ZE71737
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: LG98930
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: CX09724
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: MK54778
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: PZ08956
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: XY83174
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY83174%27 HTTP/1.1" 200 None
2026-03-28 12:03:09 [auto1.it] INFO: Scrape type for XY83174: 0
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: JK67025
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK67025%27 HTTP/1.1" 200 None
2026-03-28 12:03:09 [auto1.it] INFO: Scrape type for JK67025: 0
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: WS86026
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: ZA88698
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA88698%27 HTTP/1.1" 200 None
2026-03-28 12:03:09 [auto1.it] INFO: Scrape type for ZA88698: 0
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: PM10461
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: SP76213
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: CS00409
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS00409%27 HTTP/1.1" 200 None
2026-03-28 12:03:09 [auto1.it] INFO: Scrape type for CS00409: 0
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: VM52207
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM52207%27 HTTP/1.1" 200 None
2026-03-28 12:03:09 [auto1.it] INFO: Scrape type for VM52207: 0
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: HA26046
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA26046%27 HTTP/1.1" 200 None
2026-03-28 12:03:09 [auto1.it] INFO: Scrape type for HA26046: 0
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: NP04036
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP04036%27 HTTP/1.1" 200 None
2026-03-28 12:03:09 [auto1.it] INFO: Scrape type for NP04036: 0
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: TR59701
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR59701%27 HTTP/1.1" 200 None
2026-03-28 12:03:09 [auto1.it] INFO: Scrape type for TR59701: 0
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: KX10481
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: YH31612
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: YM20104
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: NW69655
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: GS12960
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: LL73922
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: CG84087
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG84087%27 HTTP/1.1" 200 None
2026-03-28 12:03:09 [auto1.it] INFO: Scrape type for CG84087: 0
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: CV08843
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV08843%27 HTTP/1.1" 200 None
2026-03-28 12:03:09 [auto1.it] INFO: Scrape type for CV08843: 0
2026-03-28 12:03:09 [auto1.it] INFO: Found listing with ID: RT64884
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT64884%27 HTTP/1.1" 200 None
2026-03-28 12:03:09 [auto1.it] INFO: Scrape type for RT64884: 2
2026-03-28 12:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a47aebba-df13-5682-84d8-2b28bd63f430 with identifier: RT64884
2026-03-28 12:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a47aebba-df13-5682-84d8-2b28bd63f430 with scrape type 2
2026-03-28 12:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a47aebba-df13-5682-84d8-2b28bd63f430 with scrape type 2
2026-03-28 12:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a47aebba-df13-5682-84d8-2b28bd63f430, identifier: RT64884
2026-03-28 12:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a47aebba-df13-5682-84d8-2b28bd63f430 with identifier: RT64884
2026-03-28 12:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a47aebba-df13-5682-84d8-2b28bd63f430 with identifier: RT64884
2026-03-28 12:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a47aebba-df13-5682-84d8-2b28bd63f430 with identifier: RT64884 to the API
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:25:29Z',
'fuel_type': 'petrol',
'id': 'a47aebba-df13-5682-84d8-2b28bd63f430',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT64884',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 155491,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-05-12',
'seller_name': None,
'title': 'Renault Twingo 1.2 Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2008}
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT64884%27 HTTP/1.1" 200 None
2026-03-28 12:03:10 [auto1.it] INFO: Saving data for RT64884: {'auction_closing_time': 1774715129.0, 'created_time': 1774001932.078937, 'last_price_update_time': 1774699390.01259}
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT64884') HTTP/1.1" 204 0
2026-03-28 12:03:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:10 [auto1.it] INFO: Found listing with ID: YX93099
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX93099%27 HTTP/1.1" 200 None
2026-03-28 12:03:10 [auto1.it] INFO: Scrape type for YX93099: 0
2026-03-28 12:03:10 [auto1.it] INFO: Found listing with ID: TD31675
2026-03-28 12:03:10 [auto1.it] INFO: Found listing with ID: XJ00543
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ00543%27 HTTP/1.1" 200 None
2026-03-28 12:03:10 [auto1.it] INFO: Scrape type for XJ00543: 2
2026-03-28 12:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f8cdf69-3dfc-5751-9ee5-cd199139b31b with identifier: XJ00543
2026-03-28 12:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f8cdf69-3dfc-5751-9ee5-cd199139b31b with scrape type 2
2026-03-28 12:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f8cdf69-3dfc-5751-9ee5-cd199139b31b with scrape type 2
2026-03-28 12:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f8cdf69-3dfc-5751-9ee5-cd199139b31b, identifier: XJ00543
2026-03-28 12:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f8cdf69-3dfc-5751-9ee5-cd199139b31b with identifier: XJ00543
2026-03-28 12:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f8cdf69-3dfc-5751-9ee5-cd199139b31b with identifier: XJ00543
2026-03-28 12:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f8cdf69-3dfc-5751-9ee5-cd199139b31b with identifier: XJ00543 to the API
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:25:51Z',
'fuel_type': 'diesel',
'id': '0f8cdf69-3dfc-5751-9ee5-cd199139b31b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ00543',
'listing': 'auction',
'make': 'Isuzu',
'model': 'D-MAX',
'odometer': 137937,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-08',
'seller_name': None,
'title': 'Isuzu D-MAX 1.9 Turbodiesel Single Cab Basis 4WD',
'transmission': 'manual',
'trim': 'Single Cab Basis 4WD',
'year': 2019}
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ00543%27 HTTP/1.1" 200 None
2026-03-28 12:03:10 [auto1.it] INFO: Saving data for XJ00543: {'auction_closing_time': 1774715151.0, 'created_time': 1774094538.688033, 'last_price_update_time': 1774699390.573115}
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XJ00543') HTTP/1.1" 204 0
2026-03-28 12:03:10 [auto1.it] INFO: Found listing with ID: VX61752
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX61752%27 HTTP/1.1" 200 None
2026-03-28 12:03:10 [auto1.it] INFO: Scrape type for VX61752: 0
2026-03-28 12:03:10 [auto1.it] INFO: Found listing with ID: RB12034
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB12034%27 HTTP/1.1" 200 None
2026-03-28 12:03:10 [auto1.it] INFO: Scrape type for RB12034: 0
2026-03-28 12:03:10 [auto1.it] INFO: Found listing with ID: UX48429
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX48429%27 HTTP/1.1" 200 None
2026-03-28 12:03:10 [auto1.it] INFO: Scrape type for UX48429: 0
2026-03-28 12:03:10 [auto1.it] INFO: Found listing with ID: AX27463
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX27463%27 HTTP/1.1" 200 None
2026-03-28 12:03:10 [auto1.it] INFO: Scrape type for AX27463: 0
2026-03-28 12:03:10 [auto1.it] INFO: Found listing with ID: EB51163
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB51163%27 HTTP/1.1" 200 None
2026-03-28 12:03:10 [auto1.it] INFO: Scrape type for EB51163: 0
2026-03-28 12:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:11 [auto1.it] INFO: Channel: 24h | Page: 30 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: UH08527
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH08527%27 HTTP/1.1" 200 None
2026-03-28 12:03:11 [auto1.it] INFO: Scrape type for UH08527: 0
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: HR07647
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR07647%27 HTTP/1.1" 200 None
2026-03-28 12:03:11 [auto1.it] INFO: Scrape type for HR07647: 0
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: PJ46449
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: ZY55169
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY55169%27 HTTP/1.1" 200 None
2026-03-28 12:03:11 [auto1.it] INFO: Scrape type for ZY55169: 0
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: GX95672
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: SP14530
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP14530%27 HTTP/1.1" 200 None
2026-03-28 12:03:11 [auto1.it] INFO: Scrape type for SP14530: 0
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: AA77653
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA77653%27 HTTP/1.1" 200 None
2026-03-28 12:03:11 [auto1.it] INFO: Scrape type for AA77653: 0
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: XM03029
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM03029%27 HTTP/1.1" 200 None
2026-03-28 12:03:11 [auto1.it] INFO: Scrape type for XM03029: 0
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: LK74969
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: CB30744
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB30744%27 HTTP/1.1" 200 None
2026-03-28 12:03:11 [auto1.it] INFO: Scrape type for CB30744: 0
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: RE87143
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE87143%27 HTTP/1.1" 200 None
2026-03-28 12:03:11 [auto1.it] INFO: Scrape type for RE87143: 0
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: SN57039
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN57039%27 HTTP/1.1" 200 None
2026-03-28 12:03:11 [auto1.it] INFO: Scrape type for SN57039: 0
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: KL78509
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: KU41331
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU41331%27 HTTP/1.1" 200 None
2026-03-28 12:03:11 [auto1.it] INFO: Scrape type for KU41331: 0
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: TG15136
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: JF99544
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF99544%27 HTTP/1.1" 200 None
2026-03-28 12:03:11 [auto1.it] INFO: Scrape type for JF99544: 0
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: JC73899
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: ZA39687
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: JR96571
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: CK86990
2026-03-28 12:03:11 [auto1.it] INFO: Found listing with ID: PL52224
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL52224%27 HTTP/1.1" 200 None
2026-03-28 12:03:11 [auto1.it] INFO: Scrape type for PL52224: 2
2026-03-28 12:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 876b717e-e2da-52da-987f-46ee9bd9fadb with identifier: PL52224
2026-03-28 12:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 876b717e-e2da-52da-987f-46ee9bd9fadb with scrape type 2
2026-03-28 12:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 876b717e-e2da-52da-987f-46ee9bd9fadb with scrape type 2
2026-03-28 12:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 876b717e-e2da-52da-987f-46ee9bd9fadb, identifier: PL52224
2026-03-28 12:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 876b717e-e2da-52da-987f-46ee9bd9fadb with identifier: PL52224
2026-03-28 12:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 876b717e-e2da-52da-987f-46ee9bd9fadb with identifier: PL52224
2026-03-28 12:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 876b717e-e2da-52da-987f-46ee9bd9fadb with identifier: PL52224 to the API
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:18:47Z',
'fuel_type': 'petrol',
'id': '876b717e-e2da-52da-987f-46ee9bd9fadb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL52224',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 93416,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-26',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2017}
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL52224%27 HTTP/1.1" 200 None
2026-03-28 12:03:12 [auto1.it] INFO: Saving data for PL52224: {'auction_closing_time': 1774714727.0, 'created_time': 1774515707.932578, 'last_price_update_time': 1774699392.287576}
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PL52224') HTTP/1.1" 204 0
2026-03-28 12:03:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: KU76175
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: FF25963
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: SR16589
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: HU73227
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: PR39180
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: LW03785
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: PZ70422
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ70422%27 HTTP/1.1" 200 None
2026-03-28 12:03:12 [auto1.it] INFO: Scrape type for PZ70422: 2
2026-03-28 12:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33707f92-b992-5504-a76c-ff551c3861c4 with identifier: PZ70422
2026-03-28 12:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33707f92-b992-5504-a76c-ff551c3861c4 with scrape type 2
2026-03-28 12:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33707f92-b992-5504-a76c-ff551c3861c4 with scrape type 2
2026-03-28 12:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 33707f92-b992-5504-a76c-ff551c3861c4, identifier: PZ70422
2026-03-28 12:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 33707f92-b992-5504-a76c-ff551c3861c4 with identifier: PZ70422
2026-03-28 12:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 33707f92-b992-5504-a76c-ff551c3861c4 with identifier: PZ70422
2026-03-28 12:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 33707f92-b992-5504-a76c-ff551c3861c4 with identifier: PZ70422 to the API
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-28T16:15:52Z',
'fuel_type': 'hybrid',
'id': '33707f92-b992-5504-a76c-ff551c3861c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ70422',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 69445,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-29',
'seller_name': None,
'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2023}
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ70422%27 HTTP/1.1" 200 None
2026-03-28 12:03:12 [auto1.it] INFO: Saving data for PZ70422: {'auction_closing_time': 1774714552.0, 'created_time': 1774515634.543274, 'last_price_update_time': 1774699392.818925}
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ70422') HTTP/1.1" 204 0
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: AL46390
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL46390%27 HTTP/1.1" 200 None
2026-03-28 12:03:12 [auto1.it] INFO: Scrape type for AL46390: 0
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: HP25104
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: BF43503
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF43503%27 HTTP/1.1" 200 None
2026-03-28 12:03:12 [auto1.it] INFO: Scrape type for BF43503: 0
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: RA46767
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: ZH71174
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: AP00004
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP00004%27 HTTP/1.1" 200 None
2026-03-28 12:03:12 [auto1.it] INFO: Scrape type for AP00004: 0
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: VJ49724
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ49724%27 HTTP/1.1" 200 None
2026-03-28 12:03:12 [auto1.it] INFO: Scrape type for VJ49724: 0
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: VG29105
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG29105%27 HTTP/1.1" 200 None
2026-03-28 12:03:12 [auto1.it] INFO: Scrape type for VG29105: 0
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: CB60846
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB60846%27 HTTP/1.1" 200 None
2026-03-28 12:03:12 [auto1.it] INFO: Scrape type for CB60846: 0
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: ZU34198
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: TW04222
2026-03-28 12:03:12 [auto1.it] INFO: Found listing with ID: CB25121
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB25121%27 HTTP/1.1" 200 None
2026-03-28 12:03:12 [auto1.it] INFO: Scrape type for CB25121: 0
2026-03-28 12:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:16 [auto1.it] INFO: Channel: 24h | Page: 31 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: DA23296
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA23296%27 HTTP/1.1" 200 None
2026-03-28 12:03:16 [auto1.it] INFO: Scrape type for DA23296: 0
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: PN87184
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: NV88375
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV88375%27 HTTP/1.1" 200 None
2026-03-28 12:03:16 [auto1.it] INFO: Scrape type for NV88375: 0
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: JY18899
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY18899%27 HTTP/1.1" 200 None
2026-03-28 12:03:16 [auto1.it] INFO: Scrape type for JY18899: 0
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: BA93594
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA93594%27 HTTP/1.1" 200 None
2026-03-28 12:03:16 [auto1.it] INFO: Scrape type for BA93594: 0
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: YM08087
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM08087%27 HTTP/1.1" 200 None
2026-03-28 12:03:16 [auto1.it] INFO: Scrape type for YM08087: 0
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: CM37896
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM37896%27 HTTP/1.1" 200 None
2026-03-28 12:03:16 [auto1.it] INFO: Scrape type for CM37896: 0
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: EK96047
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: JD15995
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: LW17354
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW17354%27 HTTP/1.1" 200 None
2026-03-28 12:03:16 [auto1.it] INFO: Scrape type for LW17354: 0
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: JS97160
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS97160%27 HTTP/1.1" 200 None
2026-03-28 12:03:16 [auto1.it] INFO: Scrape type for JS97160: 0
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: TZ48601
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ48601%27 HTTP/1.1" 200 None
2026-03-28 12:03:16 [auto1.it] INFO: Scrape type for TZ48601: 0
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: AY64399
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: SG52105
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: YV94917
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV94917%27 HTTP/1.1" 200 None
2026-03-28 12:03:16 [auto1.it] INFO: Scrape type for YV94917: 0
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: SD31467
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD31467%27 HTTP/1.1" 200 None
2026-03-28 12:03:16 [auto1.it] INFO: Scrape type for SD31467: 0
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: YH31345
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: AF62726
2026-03-28 12:03:16 [auto1.it] INFO: Found listing with ID: ZD65765
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD65765%27 HTTP/1.1" 200 None
2026-03-28 12:03:16 [auto1.it] INFO: Scrape type for ZD65765: 2
2026-03-28 12:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e783f757-f92e-5e3a-a9d0-1de6beeda8a8 with identifier: ZD65765
2026-03-28 12:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e783f757-f92e-5e3a-a9d0-1de6beeda8a8 with scrape type 2
2026-03-28 12:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e783f757-f92e-5e3a-a9d0-1de6beeda8a8 with scrape type 2
2026-03-28 12:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e783f757-f92e-5e3a-a9d0-1de6beeda8a8, identifier: ZD65765
2026-03-28 12:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e783f757-f92e-5e3a-a9d0-1de6beeda8a8 with identifier: ZD65765
2026-03-28 12:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e783f757-f92e-5e3a-a9d0-1de6beeda8a8 with identifier: ZD65765
2026-03-28 12:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e783f757-f92e-5e3a-a9d0-1de6beeda8a8 with identifier: ZD65765 to the API
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:53:59Z',
'fuel_type': 'diesel',
'id': 'e783f757-f92e-5e3a-a9d0-1de6beeda8a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD65765',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 201981,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-18',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 TDI Kombi BlueMotion',
'transmission': 'automatic',
'trim': 'Kombi BlueMotion',
'year': 2018}
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD65765%27 HTTP/1.1" 200 None
2026-03-28 12:03:17 [auto1.it] INFO: Saving data for ZD65765: {'auction_closing_time': 1774716839.0, 'created_time': 1774515663.921362, 'last_price_update_time': 1774699397.058098}
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZD65765') HTTP/1.1" 204 0
2026-03-28 12:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: CW24266
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: YD38640
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: NF26556
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: VN28128
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN28128%27 HTTP/1.1" 200 None
2026-03-28 12:03:17 [auto1.it] INFO: Scrape type for VN28128: 0
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: PS25996
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS25996%27 HTTP/1.1" 200 None
2026-03-28 12:03:17 [auto1.it] INFO: Scrape type for PS25996: 0
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: JL83734
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL83734%27 HTTP/1.1" 200 None
2026-03-28 12:03:17 [auto1.it] INFO: Scrape type for JL83734: 0
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: WG31996
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: XZ26785
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ26785%27 HTTP/1.1" 200 None
2026-03-28 12:03:17 [auto1.it] INFO: Scrape type for XZ26785: 0
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: PL66586
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: FD29696
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD29696%27 HTTP/1.1" 200 None
2026-03-28 12:03:17 [auto1.it] INFO: Scrape type for FD29696: 0
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: TH27811
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: HT57713
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT57713%27 HTTP/1.1" 200 None
2026-03-28 12:03:17 [auto1.it] INFO: Scrape type for HT57713: 0
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: KD83488
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD83488%27 HTTP/1.1" 200 None
2026-03-28 12:03:17 [auto1.it] INFO: Scrape type for KD83488: 0
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: DC26275
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC26275%27 HTTP/1.1" 200 None
2026-03-28 12:03:17 [auto1.it] INFO: Scrape type for DC26275: 0
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: VX48328
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX48328%27 HTTP/1.1" 200 None
2026-03-28 12:03:17 [auto1.it] INFO: Scrape type for VX48328: 0
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: HU51198
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: WP70299
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: EA17133
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: AU09842
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: VS08893
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS08893%27 HTTP/1.1" 200 None
2026-03-28 12:03:17 [auto1.it] INFO: Scrape type for VS08893: 0
2026-03-28 12:03:17 [auto1.it] INFO: Found listing with ID: RP80474
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RP80474%27 HTTP/1.1" 200 None
2026-03-28 12:03:17 [auto1.it] INFO: Scrape type for RP80474: 0
2026-03-28 12:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:18 [auto1.it] INFO: Channel: 24h | Page: 32 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: AM02692
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM02692%27 HTTP/1.1" 200 None
2026-03-28 12:03:18 [auto1.it] INFO: Scrape type for AM02692: 0
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: LY27741
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY27741%27 HTTP/1.1" 200 None
2026-03-28 12:03:18 [auto1.it] INFO: Scrape type for LY27741: 0
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: SE55523
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: TA36833
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: BE49358
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE49358%27 HTTP/1.1" 200 None
2026-03-28 12:03:18 [auto1.it] INFO: Scrape type for BE49358: 0
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: HY06064
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: EC55479
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC55479%27 HTTP/1.1" 200 None
2026-03-28 12:03:18 [auto1.it] INFO: Scrape type for EC55479: 0
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: GZ47839
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: MN87452
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: XY19791
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: NB30939
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB30939%27 HTTP/1.1" 200 None
2026-03-28 12:03:18 [auto1.it] INFO: Scrape type for NB30939: 0
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: TA75240
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: PA17142
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: FL87170
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: FB70845
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: AU70231
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU70231%27 HTTP/1.1" 200 None
2026-03-28 12:03:18 [auto1.it] INFO: Scrape type for AU70231: 0
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: EZ99260
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: DG86254
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG86254%27 HTTP/1.1" 200 None
2026-03-28 12:03:18 [auto1.it] INFO: Scrape type for DG86254: 0
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: RG08073
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG08073%27 HTTP/1.1" 200 None
2026-03-28 12:03:18 [auto1.it] INFO: Scrape type for RG08073: 0
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: KJ53675
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ53675%27 HTTP/1.1" 200 None
2026-03-28 12:03:18 [auto1.it] INFO: Scrape type for KJ53675: 0
2026-03-28 12:03:18 [auto1.it] INFO: Found listing with ID: SY54017
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY54017%27 HTTP/1.1" 200 None
2026-03-28 12:03:18 [auto1.it] INFO: Scrape type for SY54017: 2
2026-03-28 12:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63dbe74a-b728-56c0-bc09-a7d2c9d0f57d with identifier: SY54017
2026-03-28 12:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63dbe74a-b728-56c0-bc09-a7d2c9d0f57d with scrape type 2
2026-03-28 12:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63dbe74a-b728-56c0-bc09-a7d2c9d0f57d with scrape type 2
2026-03-28 12:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 63dbe74a-b728-56c0-bc09-a7d2c9d0f57d, identifier: SY54017
2026-03-28 12:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 63dbe74a-b728-56c0-bc09-a7d2c9d0f57d with identifier: SY54017
2026-03-28 12:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 63dbe74a-b728-56c0-bc09-a7d2c9d0f57d with identifier: SY54017
2026-03-28 12:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 63dbe74a-b728-56c0-bc09-a7d2c9d0f57d with identifier: SY54017 to the API
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-28T16:49:06Z',
'fuel_type': 'petrol',
'id': '63dbe74a-b728-56c0-bc09-a7d2c9d0f57d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY54017',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 118305,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-23',
'seller_name': None,
'title': 'Citroen C4 Cactus 1.2 e-VTi Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2017}
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY54017%27 HTTP/1.1" 200 None
2026-03-28 12:03:18 [auto1.it] INFO: Saving data for SY54017: {'auction_closing_time': 1774716546.0, 'created_time': 1774101676.537369, 'last_price_update_time': 1774699398.904604}
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SY54017') HTTP/1.1" 204 0
2026-03-28 12:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:19 [auto1.it] INFO: Found listing with ID: BT65910
2026-03-28 12:03:19 [auto1.it] INFO: Found listing with ID: SS15336
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS15336%27 HTTP/1.1" 200 None
2026-03-28 12:03:19 [auto1.it] INFO: Scrape type for SS15336: 0
2026-03-28 12:03:19 [auto1.it] INFO: Found listing with ID: GJ83032
2026-03-28 12:03:19 [auto1.it] INFO: Found listing with ID: XJ82802
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ82802%27 HTTP/1.1" 200 None
2026-03-28 12:03:19 [auto1.it] INFO: Scrape type for XJ82802: 0
2026-03-28 12:03:19 [auto1.it] INFO: Found listing with ID: JK56152
2026-03-28 12:03:19 [auto1.it] INFO: Found listing with ID: NZ90613
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ90613%27 HTTP/1.1" 200 None
2026-03-28 12:03:19 [auto1.it] INFO: Scrape type for NZ90613: 0
2026-03-28 12:03:19 [auto1.it] INFO: Found listing with ID: JH99386
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH99386%27 HTTP/1.1" 200 None
2026-03-28 12:03:19 [auto1.it] INFO: Scrape type for JH99386: 0
2026-03-28 12:03:19 [auto1.it] INFO: Found listing with ID: GE08005
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE08005%27 HTTP/1.1" 200 None
2026-03-28 12:03:19 [auto1.it] INFO: Scrape type for GE08005: 2
2026-03-28 12:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a9e34ea-7df6-528c-a0a7-3ec7541778ac with identifier: GE08005
2026-03-28 12:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a9e34ea-7df6-528c-a0a7-3ec7541778ac with scrape type 2
2026-03-28 12:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a9e34ea-7df6-528c-a0a7-3ec7541778ac with scrape type 2
2026-03-28 12:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3a9e34ea-7df6-528c-a0a7-3ec7541778ac, identifier: GE08005
2026-03-28 12:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3a9e34ea-7df6-528c-a0a7-3ec7541778ac with identifier: GE08005
2026-03-28 12:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3a9e34ea-7df6-528c-a0a7-3ec7541778ac with identifier: GE08005
2026-03-28 12:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3a9e34ea-7df6-528c-a0a7-3ec7541778ac with identifier: GE08005 to the API
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-03-28T16:05:24Z',
'fuel_type': 'diesel',
'id': '3a9e34ea-7df6-528c-a0a7-3ec7541778ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE08005',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 264594,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-26',
'seller_name': None,
'title': 'Volvo XC90 2.0 D5 Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2016}
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE08005%27 HTTP/1.1" 200 None
2026-03-28 12:03:19 [auto1.it] INFO: Saving data for GE08005: {'auction_closing_time': 1774713924.0, 'created_time': 1774094518.432202, 'last_price_update_time': 1774699399.559006}
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GE08005') HTTP/1.1" 204 0
2026-03-28 12:03:19 [auto1.it] INFO: Found listing with ID: LT53678
2026-03-28 12:03:19 [auto1.it] INFO: Found listing with ID: FU79114
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU79114%27 HTTP/1.1" 200 None
2026-03-28 12:03:19 [auto1.it] INFO: Scrape type for FU79114: 2
2026-03-28 12:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 027d622d-2cb3-5dde-90a7-c19bd73c30a6 with identifier: FU79114
2026-03-28 12:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 027d622d-2cb3-5dde-90a7-c19bd73c30a6 with scrape type 2
2026-03-28 12:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 027d622d-2cb3-5dde-90a7-c19bd73c30a6 with scrape type 2
2026-03-28 12:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 027d622d-2cb3-5dde-90a7-c19bd73c30a6, identifier: FU79114
2026-03-28 12:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 027d622d-2cb3-5dde-90a7-c19bd73c30a6 with identifier: FU79114
2026-03-28 12:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 027d622d-2cb3-5dde-90a7-c19bd73c30a6 with identifier: FU79114
2026-03-28 12:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 027d622d-2cb3-5dde-90a7-c19bd73c30a6 with identifier: FU79114 to the API
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:54:34Z',
'fuel_type': 'petrol',
'id': '027d622d-2cb3-5dde-90a7-c19bd73c30a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU79114',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 189247,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-28',
'seller_name': None,
'title': 'Opel Corsa 1.2 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2010}
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU79114%27 HTTP/1.1" 200 None
2026-03-28 12:03:19 [auto1.it] INFO: Saving data for FU79114: {'auction_closing_time': 1774716874.0, 'created_time': 1771883710.753868, 'last_price_update_time': 1774699399.972041}
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FU79114') HTTP/1.1" 204 0
2026-03-28 12:03:19 [auto1.it] INFO: Found listing with ID: LV68988
2026-03-28 12:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV68988%27 HTTP/1.1" 200 None
2026-03-28 12:03:20 [auto1.it] INFO: Scrape type for LV68988: 0
2026-03-28 12:03:20 [auto1.it] INFO: Found listing with ID: UN42756
2026-03-28 12:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN42756%27 HTTP/1.1" 200 None
2026-03-28 12:03:20 [auto1.it] INFO: Scrape type for UN42756: 0
2026-03-28 12:03:20 [auto1.it] INFO: Found listing with ID: SZ24732
2026-03-28 12:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ24732%27 HTTP/1.1" 200 None
2026-03-28 12:03:20 [auto1.it] INFO: Scrape type for SZ24732: 0
2026-03-28 12:03:20 [auto1.it] INFO: Found listing with ID: WT09600
2026-03-28 12:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT09600%27 HTTP/1.1" 200 None
2026-03-28 12:03:20 [auto1.it] INFO: Scrape type for WT09600: 0
2026-03-28 12:03:20 [auto1.it] INFO: Found listing with ID: XN00477
2026-03-28 12:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN00477%27 HTTP/1.1" 200 None
2026-03-28 12:03:20 [auto1.it] INFO: Scrape type for XN00477: 0
2026-03-28 12:03:20 [auto1.it] INFO: Found listing with ID: EP46295
2026-03-28 12:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP46295%27 HTTP/1.1" 200 None
2026-03-28 12:03:20 [auto1.it] INFO: Scrape type for EP46295: 0
2026-03-28 12:03:20 [auto1.it] INFO: Found listing with ID: WY28975
2026-03-28 12:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY28975%27 HTTP/1.1" 200 None
2026-03-28 12:03:20 [auto1.it] INFO: Scrape type for WY28975: 0
2026-03-28 12:03:20 [auto1.it] INFO: Found listing with ID: FG66384
2026-03-28 12:03:20 [auto1.it] INFO: Found listing with ID: HB99393
2026-03-28 12:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB99393%27 HTTP/1.1" 200 None
2026-03-28 12:03:20 [auto1.it] INFO: Scrape type for HB99393: 0
2026-03-28 12:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:21 [auto1.it] INFO: Channel: 24h | Page: 33 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: SG75657
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG75657%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for SG75657: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: ZM53307
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM53307%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for ZM53307: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: CN94330
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: ME96207
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: ET79230
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET79230%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for ET79230: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: PL88516
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: AB63446
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: AG45482
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG45482%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for AG45482: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: UT31107
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT31107%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for UT31107: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: BE28605
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE28605%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for BE28605: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: KU20000
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU20000%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for KU20000: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: BR59197
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR59197%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for BR59197: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: GL68572
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL68572%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for GL68572: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: AH48855
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH48855%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for AH48855: 2
2026-03-28 12:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e7c6693-0bfd-56e2-a6bd-dd5dcf8b0eeb with identifier: AH48855
2026-03-28 12:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e7c6693-0bfd-56e2-a6bd-dd5dcf8b0eeb with scrape type 2
2026-03-28 12:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e7c6693-0bfd-56e2-a6bd-dd5dcf8b0eeb with scrape type 2
2026-03-28 12:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2e7c6693-0bfd-56e2-a6bd-dd5dcf8b0eeb, identifier: AH48855
2026-03-28 12:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2e7c6693-0bfd-56e2-a6bd-dd5dcf8b0eeb with identifier: AH48855
2026-03-28 12:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2e7c6693-0bfd-56e2-a6bd-dd5dcf8b0eeb with identifier: AH48855
2026-03-28 12:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2e7c6693-0bfd-56e2-a6bd-dd5dcf8b0eeb with identifier: AH48855 to the API
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:20:03Z',
'fuel_type': 'diesel',
'id': '2e7c6693-0bfd-56e2-a6bd-dd5dcf8b0eeb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH48855',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 91595,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-21',
'seller_name': None,
'title': 'Volvo XC90 2.4 D3 Kinetic 2WD',
'transmission': 'automatic',
'trim': 'Kinetic 2WD',
'year': 2012}
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH48855%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Saving data for AH48855: {'auction_closing_time': 1774714803.0, 'created_time': 1774515693.859524, 'last_price_update_time': 1774699401.600436}
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AH48855') HTTP/1.1" 204 0
2026-03-28 12:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: DD73045
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: US62865
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US62865%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for US62865: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: VB10041
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: LS85229
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS85229%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for LS85229: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: GN54162
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN54162%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for GN54162: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: TM85458
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM85458%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for TM85458: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: UW44918
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW44918%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for UW44918: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: BE09297
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE09297%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for BE09297: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: ZD06174
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: ZM37074
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: DZ91111
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: PL95293
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: LC48470
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC48470%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for LC48470: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: RM58290
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM58290%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for RM58290: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: CT52714
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT52714%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for CT52714: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: AM26734
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM26734%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for AM26734: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: XT06571
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: ZR51869
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: XL05283
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL05283%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for XL05283: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: RC86938
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC86938%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for RC86938: 0
2026-03-28 12:03:21 [auto1.it] INFO: Found listing with ID: XB17509
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB17509%27 HTTP/1.1" 200 None
2026-03-28 12:03:21 [auto1.it] INFO: Scrape type for XB17509: 2
2026-03-28 12:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5568f92-062a-54de-95e6-b313c511f139 with identifier: XB17509
2026-03-28 12:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5568f92-062a-54de-95e6-b313c511f139 with scrape type 2
2026-03-28 12:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5568f92-062a-54de-95e6-b313c511f139 with scrape type 2
2026-03-28 12:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e5568f92-062a-54de-95e6-b313c511f139, identifier: XB17509
2026-03-28 12:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e5568f92-062a-54de-95e6-b313c511f139 with identifier: XB17509
2026-03-28 12:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e5568f92-062a-54de-95e6-b313c511f139 with identifier: XB17509
2026-03-28 12:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e5568f92-062a-54de-95e6-b313c511f139 with identifier: XB17509 to the API
2026-03-28 12:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:43:20Z',
'fuel_type': 'diesel',
'id': 'e5568f92-062a-54de-95e6-b313c511f139',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB17509',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 280852,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-18',
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
'transmission': 'automatic',
'trim': 'Limited FWD',
'year': 2018}
2026-03-28 12:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB17509%27 HTTP/1.1" 200 None
2026-03-28 12:03:22 [auto1.it] INFO: Saving data for XB17509: {'auction_closing_time': 1774716200.0, 'created_time': 1774094537.896925, 'last_price_update_time': 1774699402.601557}
2026-03-28 12:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XB17509') HTTP/1.1" 204 0
2026-03-28 12:03:22 [auto1.it] INFO: Found listing with ID: EV67408
2026-03-28 12:03:22 [auto1.it] INFO: Found listing with ID: BX32751
2026-03-28 12:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX32751%27 HTTP/1.1" 200 None
2026-03-28 12:03:22 [auto1.it] INFO: Scrape type for BX32751: 0
2026-03-28 12:03:22 [auto1.it] INFO: Found listing with ID: HX97698
2026-03-28 12:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX97698%27 HTTP/1.1" 200 None
2026-03-28 12:03:22 [auto1.it] INFO: Scrape type for HX97698: 2
2026-03-28 12:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddbcc2f5-539b-5505-becf-fa65402eb6ad with identifier: HX97698
2026-03-28 12:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddbcc2f5-539b-5505-becf-fa65402eb6ad with scrape type 2
2026-03-28 12:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddbcc2f5-539b-5505-becf-fa65402eb6ad with scrape type 2
2026-03-28 12:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ddbcc2f5-539b-5505-becf-fa65402eb6ad, identifier: HX97698
2026-03-28 12:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ddbcc2f5-539b-5505-becf-fa65402eb6ad with identifier: HX97698
2026-03-28 12:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ddbcc2f5-539b-5505-becf-fa65402eb6ad with identifier: HX97698
2026-03-28 12:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ddbcc2f5-539b-5505-becf-fa65402eb6ad with identifier: HX97698 to the API
2026-03-28 12:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:36:14Z',
'fuel_type': 'diesel',
'id': 'ddbcc2f5-539b-5505-becf-fa65402eb6ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX97698',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 136538,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-05',
'seller_name': None,
'title': 'Renault Megane 1.6 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2016}
2026-03-28 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX97698%27 HTTP/1.1" 200 None
2026-03-28 12:03:23 [auto1.it] INFO: Saving data for HX97698: {'auction_closing_time': 1774715774.0, 'created_time': 1774515721.929521, 'last_price_update_time': 1774699403.15097}
2026-03-28 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HX97698') HTTP/1.1" 204 0
2026-03-28 12:03:23 [auto1.it] INFO: Found listing with ID: LU41088
2026-03-28 12:03:23 [auto1.it] INFO: Found listing with ID: JA23612
2026-03-28 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA23612%27 HTTP/1.1" 200 None
2026-03-28 12:03:23 [auto1.it] INFO: Scrape type for JA23612: 2
2026-03-28 12:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 738f4691-b26d-52e2-ba9a-9680c19b3c14 with identifier: JA23612
2026-03-28 12:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 738f4691-b26d-52e2-ba9a-9680c19b3c14 with scrape type 2
2026-03-28 12:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 738f4691-b26d-52e2-ba9a-9680c19b3c14 with scrape type 2
2026-03-28 12:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 738f4691-b26d-52e2-ba9a-9680c19b3c14, identifier: JA23612
2026-03-28 12:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 738f4691-b26d-52e2-ba9a-9680c19b3c14 with identifier: JA23612
2026-03-28 12:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 738f4691-b26d-52e2-ba9a-9680c19b3c14 with identifier: JA23612
2026-03-28 12:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 738f4691-b26d-52e2-ba9a-9680c19b3c14 with identifier: JA23612 to the API
2026-03-28 12:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-28T16:56:36Z',
'fuel_type': 'diesel',
'id': '738f4691-b26d-52e2-ba9a-9680c19b3c14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA23612',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 104545,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-28',
'seller_name': None,
'title': 'BMW X1 xDrive 25d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2016}
2026-03-28 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA23612%27 HTTP/1.1" 200 None
2026-03-28 12:03:23 [auto1.it] INFO: Saving data for JA23612: {'auction_closing_time': 1774716996.0, 'created_time': 1774094507.210297, 'last_price_update_time': 1774699403.592689}
2026-03-28 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JA23612') HTTP/1.1" 204 0
2026-03-28 12:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:24 [auto1.it] INFO: Channel: 24h | Page: 34 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:24 [auto1.it] INFO: Found listing with ID: WV29949
2026-03-28 12:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV29949%27 HTTP/1.1" 200 None
2026-03-28 12:03:24 [auto1.it] INFO: Scrape type for WV29949: 0
2026-03-28 12:03:24 [auto1.it] INFO: Found listing with ID: XT85260
2026-03-28 12:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT85260%27 HTTP/1.1" 200 None
2026-03-28 12:03:24 [auto1.it] INFO: Scrape type for XT85260: 0
2026-03-28 12:03:24 [auto1.it] INFO: Found listing with ID: EA68503
2026-03-28 12:03:24 [auto1.it] INFO: Found listing with ID: TK21590
2026-03-28 12:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK21590%27 HTTP/1.1" 200 None
2026-03-28 12:03:24 [auto1.it] INFO: Scrape type for TK21590: 0
2026-03-28 12:03:24 [auto1.it] INFO: Found listing with ID: LV91282
2026-03-28 12:03:24 [auto1.it] INFO: Found listing with ID: WC44789
2026-03-28 12:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC44789%27 HTTP/1.1" 200 None
2026-03-28 12:03:24 [auto1.it] INFO: Scrape type for WC44789: 2
2026-03-28 12:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18b9ea94-25a6-5f04-953b-f91bc778d688 with identifier: WC44789
2026-03-28 12:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18b9ea94-25a6-5f04-953b-f91bc778d688 with scrape type 2
2026-03-28 12:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18b9ea94-25a6-5f04-953b-f91bc778d688 with scrape type 2
2026-03-28 12:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 18b9ea94-25a6-5f04-953b-f91bc778d688, identifier: WC44789
2026-03-28 12:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 18b9ea94-25a6-5f04-953b-f91bc778d688 with identifier: WC44789
2026-03-28 12:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 18b9ea94-25a6-5f04-953b-f91bc778d688 with identifier: WC44789
2026-03-28 12:03:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 18b9ea94-25a6-5f04-953b-f91bc778d688 with identifier: WC44789 to the API
2026-03-28 12:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:59:25Z',
'fuel_type': 'diesel',
'id': '18b9ea94-25a6-5f04-953b-f91bc778d688',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC44789',
'listing': 'auction',
'make': 'Fiat',
'model': '500L',
'odometer': 156994,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-30',
'seller_name': None,
'title': 'Fiat 500L 1.3 JTD Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2014}
2026-03-28 12:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC44789%27 HTTP/1.1" 200 None
2026-03-28 12:03:24 [auto1.it] INFO: Saving data for WC44789: {'auction_closing_time': 1774717165.0, 'created_time': 1774515675.832534, 'last_price_update_time': 1774699404.911598}
2026-03-28 12:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WC44789') HTTP/1.1" 204 0
2026-03-28 12:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: NF30981
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: UV29542
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: EE95145
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: BD71903
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD71903%27 HTTP/1.1" 200 None
2026-03-28 12:03:25 [auto1.it] INFO: Scrape type for BD71903: 0
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: AY66790
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: NF08896
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: SS87934
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: HP55152
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: JV35295
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV35295%27 HTTP/1.1" 200 None
2026-03-28 12:03:25 [auto1.it] INFO: Scrape type for JV35295: 0
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: ED24082
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: WX67440
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: GR86359
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR86359%27 HTTP/1.1" 200 None
2026-03-28 12:03:25 [auto1.it] INFO: Scrape type for GR86359: 0
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: DW12727
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW12727%27 HTTP/1.1" 200 None
2026-03-28 12:03:25 [auto1.it] INFO: Scrape type for DW12727: 0
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: SE81174
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: VZ97279
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ97279%27 HTTP/1.1" 200 None
2026-03-28 12:03:25 [auto1.it] INFO: Scrape type for VZ97279: 0
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: BN27649
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN27649%27 HTTP/1.1" 200 None
2026-03-28 12:03:25 [auto1.it] INFO: Scrape type for BN27649: 0
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: JR54930
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: RZ16714
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ16714%27 HTTP/1.1" 200 None
2026-03-28 12:03:25 [auto1.it] INFO: Scrape type for RZ16714: 0
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: WL53251
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL53251%27 HTTP/1.1" 200 None
2026-03-28 12:03:25 [auto1.it] INFO: Scrape type for WL53251: 0
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: RF41966
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF41966%27 HTTP/1.1" 200 None
2026-03-28 12:03:25 [auto1.it] INFO: Scrape type for RF41966: 0
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: DV87281
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: LP60965
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: SS74594
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: GA52227
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: SE94922
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE94922%27 HTTP/1.1" 200 None
2026-03-28 12:03:25 [auto1.it] INFO: Scrape type for SE94922: 0
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: KC15841
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC15841%27 HTTP/1.1" 200 None
2026-03-28 12:03:25 [auto1.it] INFO: Scrape type for KC15841: 0
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: AL92131
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL92131%27 HTTP/1.1" 200 None
2026-03-28 12:03:25 [auto1.it] INFO: Scrape type for AL92131: 0
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: SP03533
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP03533%27 HTTP/1.1" 200 None
2026-03-28 12:03:25 [auto1.it] INFO: Scrape type for SP03533: 0
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: EP94562
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP94562%27 HTTP/1.1" 200 None
2026-03-28 12:03:25 [auto1.it] INFO: Scrape type for EP94562: 0
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: HP33672
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: PZ35188
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ35188%27 HTTP/1.1" 200 None
2026-03-28 12:03:25 [auto1.it] INFO: Scrape type for PZ35188: 0
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: XK43361
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: AF46529
2026-03-28 12:03:25 [auto1.it] INFO: Found listing with ID: DR37659
2026-03-28 12:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:26 [auto1.it] INFO: Channel: 24h | Page: 35 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: RA62003
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA62003%27 HTTP/1.1" 200 None
2026-03-28 12:03:26 [auto1.it] INFO: Scrape type for RA62003: 0
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: PX04626
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: JJ49663
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ49663%27 HTTP/1.1" 200 None
2026-03-28 12:03:26 [auto1.it] INFO: Scrape type for JJ49663: 0
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: NC94766
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: TM14031
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM14031%27 HTTP/1.1" 200 None
2026-03-28 12:03:26 [auto1.it] INFO: Scrape type for TM14031: 0
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: TG82781
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG82781%27 HTTP/1.1" 200 None
2026-03-28 12:03:26 [auto1.it] INFO: Scrape type for TG82781: 0
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: ES51073
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: FT97220
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT97220%27 HTTP/1.1" 200 None
2026-03-28 12:03:26 [auto1.it] INFO: Scrape type for FT97220: 0
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: WU99232
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: SA50428
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: JJ80566
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: WH82404
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH82404%27 HTTP/1.1" 200 None
2026-03-28 12:03:26 [auto1.it] INFO: Scrape type for WH82404: 0
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: KC02263
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC02263%27 HTTP/1.1" 200 None
2026-03-28 12:03:26 [auto1.it] INFO: Scrape type for KC02263: 0
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: WX97705
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: GH19384
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: NR23984
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: CJ26443
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: EC13131
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: GU38190
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU38190%27 HTTP/1.1" 200 None
2026-03-28 12:03:26 [auto1.it] INFO: Scrape type for GU38190: 0
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: YH62584
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: SN06060
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: ZJ24732
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ24732%27 HTTP/1.1" 200 None
2026-03-28 12:03:26 [auto1.it] INFO: Scrape type for ZJ24732: 0
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: GR20661
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: YK56738
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: GW87429
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW87429%27 HTTP/1.1" 200 None
2026-03-28 12:03:26 [auto1.it] INFO: Scrape type for GW87429: 0
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: BH09542
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: NM70552
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM70552%27 HTTP/1.1" 200 None
2026-03-28 12:03:26 [auto1.it] INFO: Scrape type for NM70552: 0
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: HH07211
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH07211%27 HTTP/1.1" 200 None
2026-03-28 12:03:26 [auto1.it] INFO: Scrape type for HH07211: 0
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: SY55940
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY55940%27 HTTP/1.1" 200 None
2026-03-28 12:03:26 [auto1.it] INFO: Scrape type for SY55940: 0
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: HU85714
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU85714%27 HTTP/1.1" 200 None
2026-03-28 12:03:26 [auto1.it] INFO: Scrape type for HU85714: 0
2026-03-28 12:03:26 [auto1.it] INFO: Found listing with ID: SN24706
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN24706%27 HTTP/1.1" 200 None
2026-03-28 12:03:26 [auto1.it] INFO: Scrape type for SN24706: 2
2026-03-28 12:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b052db-5bab-5df1-be5a-2a280b3bb100 with identifier: SN24706
2026-03-28 12:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b052db-5bab-5df1-be5a-2a280b3bb100 with scrape type 2
2026-03-28 12:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10b052db-5bab-5df1-be5a-2a280b3bb100 with scrape type 2
2026-03-28 12:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 10b052db-5bab-5df1-be5a-2a280b3bb100, identifier: SN24706
2026-03-28 12:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 10b052db-5bab-5df1-be5a-2a280b3bb100 with identifier: SN24706
2026-03-28 12:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 10b052db-5bab-5df1-be5a-2a280b3bb100 with identifier: SN24706
2026-03-28 12:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 10b052db-5bab-5df1-be5a-2a280b3bb100 with identifier: SN24706 to the API
2026-03-28 12:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:01:59Z',
'fuel_type': 'diesel',
'id': '10b052db-5bab-5df1-be5a-2a280b3bb100',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN24706',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 184724,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-28',
'seller_name': None,
'title': 'Peugeot 3008 1.6 HDi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2013}
2026-03-28 12:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN24706%27 HTTP/1.1" 200 None
2026-03-28 12:03:27 [auto1.it] INFO: Saving data for SN24706: {'auction_closing_time': 1774713719.0, 'created_time': 1774515642.43419, 'last_price_update_time': 1774699407.248719}
2026-03-28 12:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SN24706') HTTP/1.1" 204 0
2026-03-28 12:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:27 [auto1.it] INFO: Found listing with ID: ZP79936
2026-03-28 12:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP79936%27 HTTP/1.1" 200 None
2026-03-28 12:03:27 [auto1.it] INFO: Scrape type for ZP79936: 0
2026-03-28 12:03:27 [auto1.it] INFO: Found listing with ID: NL88933
2026-03-28 12:03:27 [auto1.it] INFO: Found listing with ID: HD78178
2026-03-28 12:03:27 [auto1.it] INFO: Found listing with ID: DE32338
2026-03-28 12:03:27 [auto1.it] INFO: Found listing with ID: AK32072
2026-03-28 12:03:27 [auto1.it] INFO: Found listing with ID: AB09853
2026-03-28 12:03:27 [auto1.it] INFO: Found listing with ID: PS40086
2026-03-28 12:03:27 [auto1.it] INFO: Found listing with ID: XJ23148
2026-03-28 12:03:27 [auto1.it] INFO: Found listing with ID: FX22483
2026-03-28 12:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX22483%27 HTTP/1.1" 200 None
2026-03-28 12:03:27 [auto1.it] INFO: Scrape type for FX22483: 0
2026-03-28 12:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:28 [auto1.it] INFO: Channel: 24h | Page: 36 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: BY60716
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY60716%27 HTTP/1.1" 200 None
2026-03-28 12:03:28 [auto1.it] INFO: Scrape type for BY60716: 0
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: JR58034
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: AE43427
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE43427%27 HTTP/1.1" 200 None
2026-03-28 12:03:28 [auto1.it] INFO: Scrape type for AE43427: 0
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: RU31162
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: VS39586
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: EA47428
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA47428%27 HTTP/1.1" 200 None
2026-03-28 12:03:28 [auto1.it] INFO: Scrape type for EA47428: 0
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: WB86834
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: NL88332
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL88332%27 HTTP/1.1" 200 None
2026-03-28 12:03:28 [auto1.it] INFO: Scrape type for NL88332: 0
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: EW60341
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: HG53110
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG53110%27 HTTP/1.1" 200 None
2026-03-28 12:03:28 [auto1.it] INFO: Scrape type for HG53110: 0
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: XD73151
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: PE73293
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE73293%27 HTTP/1.1" 200 None
2026-03-28 12:03:28 [auto1.it] INFO: Scrape type for PE73293: 0
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: AN97971
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN97971%27 HTTP/1.1" 200 None
2026-03-28 12:03:28 [auto1.it] INFO: Scrape type for AN97971: 0
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: RN28798
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: XR36551
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR36551%27 HTTP/1.1" 200 None
2026-03-28 12:03:28 [auto1.it] INFO: Scrape type for XR36551: 0
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: ZX52658
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: GT17675
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: DN72005
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: UJ09788
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ09788%27 HTTP/1.1" 200 None
2026-03-28 12:03:28 [auto1.it] INFO: Scrape type for UJ09788: 0
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: RF11851
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: MG39360
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: UR73173
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: SY30215
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: XR70694
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR70694%27 HTTP/1.1" 200 None
2026-03-28 12:03:28 [auto1.it] INFO: Scrape type for XR70694: 0
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: YM70173
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM70173%27 HTTP/1.1" 200 None
2026-03-28 12:03:28 [auto1.it] INFO: Scrape type for YM70173: 0
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: VE91156
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE91156%27 HTTP/1.1" 200 None
2026-03-28 12:03:28 [auto1.it] INFO: Scrape type for VE91156: 0
2026-03-28 12:03:28 [auto1.it] INFO: Found listing with ID: GS51961
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS51961%27 HTTP/1.1" 200 None
2026-03-28 12:03:28 [auto1.it] INFO: Scrape type for GS51961: 2
2026-03-28 12:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ec9c818-2d30-512b-a019-281150e7dd46 with identifier: GS51961
2026-03-28 12:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ec9c818-2d30-512b-a019-281150e7dd46 with scrape type 2
2026-03-28 12:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ec9c818-2d30-512b-a019-281150e7dd46 with scrape type 2
2026-03-28 12:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3ec9c818-2d30-512b-a019-281150e7dd46, identifier: GS51961
2026-03-28 12:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3ec9c818-2d30-512b-a019-281150e7dd46 with identifier: GS51961
2026-03-28 12:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3ec9c818-2d30-512b-a019-281150e7dd46 with identifier: GS51961
2026-03-28 12:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3ec9c818-2d30-512b-a019-281150e7dd46 with identifier: GS51961 to the API
2026-03-28 12:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-28T16:08:07Z',
'fuel_type': 'gas',
'id': '3ec9c818-2d30-512b-a019-281150e7dd46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS51961',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 193933,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-12',
'seller_name': None,
'title': 'Fiat Panda 1.2 Dynamic GPL',
'transmission': 'manual',
'trim': 'Dynamic GPL',
'year': 2010}
2026-03-28 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS51961%27 HTTP/1.1" 200 None
2026-03-28 12:03:29 [auto1.it] INFO: Saving data for GS51961: {'auction_closing_time': 1774714087.0, 'created_time': 1774515644.236115, 'last_price_update_time': 1774699409.22025}
2026-03-28 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GS51961') HTTP/1.1" 204 0
2026-03-28 12:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:29 [auto1.it] INFO: Found listing with ID: JP32854
2026-03-28 12:03:29 [auto1.it] INFO: Found listing with ID: BR14904
2026-03-28 12:03:29 [auto1.it] INFO: Found listing with ID: DN82434
2026-03-28 12:03:29 [auto1.it] INFO: Found listing with ID: LH79871
2026-03-28 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH79871%27 HTTP/1.1" 200 None
2026-03-28 12:03:29 [auto1.it] INFO: Scrape type for LH79871: 0
2026-03-28 12:03:29 [auto1.it] INFO: Found listing with ID: AA53692
2026-03-28 12:03:29 [auto1.it] INFO: Found listing with ID: XU52863
2026-03-28 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU52863%27 HTTP/1.1" 200 None
2026-03-28 12:03:29 [auto1.it] INFO: Scrape type for XU52863: 0
2026-03-28 12:03:29 [auto1.it] INFO: Found listing with ID: XE42433
2026-03-28 12:03:29 [auto1.it] INFO: Found listing with ID: GZ15334
2026-03-28 12:03:29 [auto1.it] INFO: Found listing with ID: WJ00117
2026-03-28 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ00117%27 HTTP/1.1" 200 None
2026-03-28 12:03:29 [auto1.it] INFO: Scrape type for WJ00117: 0
2026-03-28 12:03:29 [auto1.it] INFO: Found listing with ID: GM47184
2026-03-28 12:03:29 [auto1.it] INFO: Found listing with ID: KY15246
2026-03-28 12:03:29 [auto1.it] INFO: Found listing with ID: FX38353
2026-03-28 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX38353%27 HTTP/1.1" 200 None
2026-03-28 12:03:29 [auto1.it] INFO: Scrape type for FX38353: 0
2026-03-28 12:03:29 [auto1.it] INFO: Found listing with ID: JM07675
2026-03-28 12:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:30 [auto1.it] INFO: Channel: 24h | Page: 37 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: NF63759
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: BF97905
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: YW01927
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW01927%27 HTTP/1.1" 200 None
2026-03-28 12:03:30 [auto1.it] INFO: Scrape type for YW01927: 0
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: RV18634
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV18634%27 HTTP/1.1" 200 None
2026-03-28 12:03:30 [auto1.it] INFO: Scrape type for RV18634: 0
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: RP22465
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RP22465%27 HTTP/1.1" 200 None
2026-03-28 12:03:30 [auto1.it] INFO: Scrape type for RP22465: 0
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: MD04022
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: RL85068
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: UN95232
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: GM12910
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: UM01016
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: AK10390
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK10390%27 HTTP/1.1" 200 None
2026-03-28 12:03:30 [auto1.it] INFO: Scrape type for AK10390: 0
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: FU92743
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: VM43481
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM43481%27 HTTP/1.1" 200 None
2026-03-28 12:03:30 [auto1.it] INFO: Scrape type for VM43481: 0
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: NY79703
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: ZR63557
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR63557%27 HTTP/1.1" 200 None
2026-03-28 12:03:30 [auto1.it] INFO: Scrape type for ZR63557: 0
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: YN42952
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: PD49568
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: WM56040
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: TW09366
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: PJ86967
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: LC98621
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: WT33776
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: CZ68446
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: BK05178
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: GA57810
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA57810%27 HTTP/1.1" 200 None
2026-03-28 12:03:30 [auto1.it] INFO: Scrape type for GA57810: 0
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: JV05733
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: MZ19905
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ19905%27 HTTP/1.1" 200 None
2026-03-28 12:03:30 [auto1.it] INFO: Scrape type for MZ19905: 0
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: EG69855
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: NX71377
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX71377%27 HTTP/1.1" 200 None
2026-03-28 12:03:30 [auto1.it] INFO: Scrape type for NX71377: 2
2026-03-28 12:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3339f13-6abf-50db-a1b8-65d40aecbd7c with identifier: NX71377
2026-03-28 12:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3339f13-6abf-50db-a1b8-65d40aecbd7c with scrape type 2
2026-03-28 12:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3339f13-6abf-50db-a1b8-65d40aecbd7c with scrape type 2
2026-03-28 12:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a3339f13-6abf-50db-a1b8-65d40aecbd7c, identifier: NX71377
2026-03-28 12:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a3339f13-6abf-50db-a1b8-65d40aecbd7c with identifier: NX71377
2026-03-28 12:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a3339f13-6abf-50db-a1b8-65d40aecbd7c with identifier: NX71377
2026-03-28 12:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a3339f13-6abf-50db-a1b8-65d40aecbd7c with identifier: NX71377 to the API
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 136,
'expiration_date': '2026-03-28T16:31:39Z',
'fuel_type': 'diesel',
'id': 'a3339f13-6abf-50db-a1b8-65d40aecbd7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX71377',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 24650,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-28',
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi EcoBlue 280 L1 Trend',
'transmission': 'automatic',
'trim': '280 L1 Trend',
'year': 2025}
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX71377%27 HTTP/1.1" 200 None
2026-03-28 12:03:30 [auto1.it] INFO: Saving data for NX71377: {'auction_closing_time': 1774715499.0, 'created_time': 1774515686.542556, 'last_price_update_time': 1774699410.830424}
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NX71377') HTTP/1.1" 204 0
2026-03-28 12:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: MB21840
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB21840%27 HTTP/1.1" 200 None
2026-03-28 12:03:30 [auto1.it] INFO: Scrape type for MB21840: 0
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: KF04407
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: NB08226
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: WJ13439
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ13439%27 HTTP/1.1" 200 None
2026-03-28 12:03:30 [auto1.it] INFO: Scrape type for WJ13439: 0
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: VF45343
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF45343%27 HTTP/1.1" 200 None
2026-03-28 12:03:30 [auto1.it] INFO: Scrape type for VF45343: 0
2026-03-28 12:03:30 [auto1.it] INFO: Found listing with ID: VD09142
2026-03-28 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VD09142%27 HTTP/1.1" 200 None
2026-03-28 12:03:31 [auto1.it] INFO: Scrape type for VD09142: 0
2026-03-28 12:03:31 [auto1.it] INFO: Found listing with ID: GG79286
2026-03-28 12:03:31 [auto1.it] INFO: Found listing with ID: LE05558
2026-03-28 12:03:31 [auto1.it] INFO: Found listing with ID: DJ62312
2026-03-28 12:03:31 [auto1.it] INFO: Found listing with ID: AG53064
2026-03-28 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG53064%27 HTTP/1.1" 200 None
2026-03-28 12:03:31 [auto1.it] INFO: Scrape type for AG53064: 0
2026-03-28 12:03:31 [auto1.it] INFO: Found listing with ID: DH05313
2026-03-28 12:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:31 [auto1.it] INFO: Channel: 24h | Page: 38 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:31 [auto1.it] INFO: Found listing with ID: VC28315
2026-03-28 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC28315%27 HTTP/1.1" 200 None
2026-03-28 12:03:31 [auto1.it] INFO: Scrape type for VC28315: 0
2026-03-28 12:03:31 [auto1.it] INFO: Found listing with ID: NC89315
2026-03-28 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC89315%27 HTTP/1.1" 200 None
2026-03-28 12:03:31 [auto1.it] INFO: Scrape type for NC89315: 0
2026-03-28 12:03:31 [auto1.it] INFO: Found listing with ID: NU69507
2026-03-28 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU69507%27 HTTP/1.1" 200 None
2026-03-28 12:03:31 [auto1.it] INFO: Scrape type for NU69507: 0
2026-03-28 12:03:31 [auto1.it] INFO: Found listing with ID: AE94250
2026-03-28 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE94250%27 HTTP/1.1" 200 None
2026-03-28 12:03:31 [auto1.it] INFO: Scrape type for AE94250: 0
2026-03-28 12:03:31 [auto1.it] INFO: Found listing with ID: ZR59714
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR59714%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for ZR59714: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: WH67048
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH67048%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for WH67048: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: JH32473
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: CV59380
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: RK20934
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK20934%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for RK20934: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: NC77921
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC77921%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for NC77921: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: YE04007
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE04007%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for YE04007: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: NT79390
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT79390%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for NT79390: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: FP22884
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: ZV86353
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV86353%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for ZV86353: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: LW86273
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: FG09627
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG09627%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for FG09627: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: BG42211
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: XB60526
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB60526%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for XB60526: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: JS97263
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: FX24983
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: VU11306
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: WH96118
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: DB15291
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB15291%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for DB15291: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: CG32909
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG32909%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for CG32909: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: FE11339
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE11339%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for FE11339: 2
2026-03-28 12:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b56a2826-e333-5674-bd01-b7c79cb83831 with identifier: FE11339
2026-03-28 12:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b56a2826-e333-5674-bd01-b7c79cb83831 with scrape type 2
2026-03-28 12:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b56a2826-e333-5674-bd01-b7c79cb83831 with scrape type 2
2026-03-28 12:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b56a2826-e333-5674-bd01-b7c79cb83831, identifier: FE11339
2026-03-28 12:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b56a2826-e333-5674-bd01-b7c79cb83831 with identifier: FE11339
2026-03-28 12:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b56a2826-e333-5674-bd01-b7c79cb83831 with identifier: FE11339
2026-03-28 12:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b56a2826-e333-5674-bd01-b7c79cb83831 with identifier: FE11339 to the API
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:54:27Z',
'fuel_type': 'petrol',
'id': 'b56a2826-e333-5674-bd01-b7c79cb83831',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE11339',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix20',
'odometer': 67600,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-02',
'seller_name': None,
'title': 'Hyundai ix20 1.4 Comfort Blue',
'transmission': 'manual',
'trim': 'Comfort Blue',
'year': 2016}
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE11339%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Saving data for FE11339: {'auction_closing_time': 1774716867.0, 'created_time': 1774101726.88846, 'last_price_update_time': 1774699412.633082}
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FE11339') HTTP/1.1" 204 0
2026-03-28 12:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: KY33943
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: RY92911
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY92911%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for RY92911: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: CR43850
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR43850%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for CR43850: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: YM64414
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: VW82283
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW82283%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for VW82283: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: LN22753
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN22753%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for LN22753: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: MH41109
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH41109%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for MH41109: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: VH13695
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH13695%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for VH13695: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: UJ01358
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: NT98508
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: CW72749
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: SP39094
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP39094%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for SP39094: 0
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: TZ83605
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: NJ78354
2026-03-28 12:03:32 [auto1.it] INFO: Found listing with ID: KU06425
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU06425%27 HTTP/1.1" 200 None
2026-03-28 12:03:32 [auto1.it] INFO: Scrape type for KU06425: 0
2026-03-28 12:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:33 [auto1.it] INFO: Channel: 24h | Page: 39 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:33 [auto1.it] INFO: Found listing with ID: VC06734
2026-03-28 12:03:33 [auto1.it] INFO: Found listing with ID: NF56876
2026-03-28 12:03:33 [auto1.it] INFO: Found listing with ID: PK52051
2026-03-28 12:03:33 [auto1.it] INFO: Found listing with ID: JM74615
2026-03-28 12:03:33 [auto1.it] INFO: Found listing with ID: TD16332
2026-03-28 12:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD16332%27 HTTP/1.1" 200 None
2026-03-28 12:03:33 [auto1.it] INFO: Scrape type for TD16332: 2
2026-03-28 12:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3ca1a62-9e7d-5cad-b8ac-d006490265bc with identifier: TD16332
2026-03-28 12:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3ca1a62-9e7d-5cad-b8ac-d006490265bc with scrape type 2
2026-03-28 12:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3ca1a62-9e7d-5cad-b8ac-d006490265bc with scrape type 2
2026-03-28 12:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e3ca1a62-9e7d-5cad-b8ac-d006490265bc, identifier: TD16332
2026-03-28 12:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e3ca1a62-9e7d-5cad-b8ac-d006490265bc with identifier: TD16332
2026-03-28 12:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e3ca1a62-9e7d-5cad-b8ac-d006490265bc with identifier: TD16332
2026-03-28 12:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e3ca1a62-9e7d-5cad-b8ac-d006490265bc with identifier: TD16332 to the API
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:26:16Z',
'fuel_type': 'diesel',
'id': 'e3ca1a62-9e7d-5cad-b8ac-d006490265bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD16332',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 236665,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-22',
'seller_name': None,
'title': 'BMW X3 xDrive 20d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2020}
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD16332%27 HTTP/1.1" 200 None
2026-03-28 12:03:34 [auto1.it] INFO: Saving data for TD16332: {'auction_closing_time': 1774715176.0, 'created_time': 1774094592.253235, 'last_price_update_time': 1774699414.213963}
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TD16332') HTTP/1.1" 204 0
2026-03-28 12:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:34 [auto1.it] INFO: Found listing with ID: RF01908
2026-03-28 12:03:34 [auto1.it] INFO: Found listing with ID: YW19585
2026-03-28 12:03:34 [auto1.it] INFO: Found listing with ID: YD46190
2026-03-28 12:03:34 [auto1.it] INFO: Found listing with ID: XD91118
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD91118%27 HTTP/1.1" 200 None
2026-03-28 12:03:34 [auto1.it] INFO: Scrape type for XD91118: 0
2026-03-28 12:03:34 [auto1.it] INFO: Found listing with ID: PW09444
2026-03-28 12:03:34 [auto1.it] INFO: Found listing with ID: WE18403
2026-03-28 12:03:34 [auto1.it] INFO: Found listing with ID: GY98380
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY98380%27 HTTP/1.1" 200 None
2026-03-28 12:03:34 [auto1.it] INFO: Scrape type for GY98380: 0
2026-03-28 12:03:34 [auto1.it] INFO: Found listing with ID: BK23225
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK23225%27 HTTP/1.1" 200 None
2026-03-28 12:03:34 [auto1.it] INFO: Scrape type for BK23225: 2
2026-03-28 12:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d38c4caa-a162-5949-9553-bd3ea8d6c15a with identifier: BK23225
2026-03-28 12:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d38c4caa-a162-5949-9553-bd3ea8d6c15a with scrape type 2
2026-03-28 12:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d38c4caa-a162-5949-9553-bd3ea8d6c15a with scrape type 2
2026-03-28 12:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d38c4caa-a162-5949-9553-bd3ea8d6c15a, identifier: BK23225
2026-03-28 12:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d38c4caa-a162-5949-9553-bd3ea8d6c15a with identifier: BK23225
2026-03-28 12:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d38c4caa-a162-5949-9553-bd3ea8d6c15a with identifier: BK23225
2026-03-28 12:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d38c4caa-a162-5949-9553-bd3ea8d6c15a with identifier: BK23225 to the API
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 145,
'expiration_date': '2026-03-28T16:01:46Z',
'fuel_type': 'petrol',
'id': 'd38c4caa-a162-5949-9553-bd3ea8d6c15a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK23225',
'listing': 'auction',
'make': 'Abarth',
'model': '595',
'odometer': 41507,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-29',
'seller_name': None,
'title': 'Abarth 595 1.4 Turbo',
'transmission': 'manual',
'trim': '',
'year': 2017}
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK23225%27 HTTP/1.1" 200 None
2026-03-28 12:03:34 [auto1.it] INFO: Saving data for BK23225: {'auction_closing_time': 1774713706.0, 'created_time': 1773130612.419768, 'last_price_update_time': 1774699414.77327}
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BK23225') HTTP/1.1" 204 0
2026-03-28 12:03:34 [auto1.it] INFO: Found listing with ID: FS99230
2026-03-28 12:03:34 [auto1.it] INFO: Found listing with ID: GU51710
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU51710%27 HTTP/1.1" 200 None
2026-03-28 12:03:34 [auto1.it] INFO: Scrape type for GU51710: 0
2026-03-28 12:03:34 [auto1.it] INFO: Found listing with ID: LC66242
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC66242%27 HTTP/1.1" 200 None
2026-03-28 12:03:34 [auto1.it] INFO: Scrape type for LC66242: 0
2026-03-28 12:03:34 [auto1.it] INFO: Found listing with ID: CK40026
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK40026%27 HTTP/1.1" 200 None
2026-03-28 12:03:34 [auto1.it] INFO: Scrape type for CK40026: 0
2026-03-28 12:03:34 [auto1.it] INFO: Found listing with ID: NH64941
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH64941%27 HTTP/1.1" 200 None
2026-03-28 12:03:34 [auto1.it] INFO: Scrape type for NH64941: 2
2026-03-28 12:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b22ccf-554c-52e6-8021-8324f27bd25c with identifier: NH64941
2026-03-28 12:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b22ccf-554c-52e6-8021-8324f27bd25c with scrape type 2
2026-03-28 12:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10b22ccf-554c-52e6-8021-8324f27bd25c with scrape type 2
2026-03-28 12:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 10b22ccf-554c-52e6-8021-8324f27bd25c, identifier: NH64941
2026-03-28 12:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 10b22ccf-554c-52e6-8021-8324f27bd25c with identifier: NH64941
2026-03-28 12:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 10b22ccf-554c-52e6-8021-8324f27bd25c with identifier: NH64941
2026-03-28 12:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 10b22ccf-554c-52e6-8021-8324f27bd25c with identifier: NH64941 to the API
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:54:28Z',
'fuel_type': 'diesel',
'id': '10b22ccf-554c-52e6-8021-8324f27bd25c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH64941',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 140516,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-13',
'seller_name': None,
'title': 'Ford C-Max 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH64941%27 HTTP/1.1" 200 None
2026-03-28 12:03:35 [auto1.it] INFO: Saving data for NH64941: {'auction_closing_time': 1774716868.0, 'created_time': 1774515633.940636, 'last_price_update_time': 1774699415.290071}
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NH64941') HTTP/1.1" 204 0
2026-03-28 12:03:35 [auto1.it] INFO: Found listing with ID: ZW62743
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW62743%27 HTTP/1.1" 200 None
2026-03-28 12:03:35 [auto1.it] INFO: Scrape type for ZW62743: 0
2026-03-28 12:03:35 [auto1.it] INFO: Found listing with ID: GF15997
2026-03-28 12:03:35 [auto1.it] INFO: Found listing with ID: TX43497
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX43497%27 HTTP/1.1" 200 None
2026-03-28 12:03:35 [auto1.it] INFO: Scrape type for TX43497: 0
2026-03-28 12:03:35 [auto1.it] INFO: Found listing with ID: LF46608
2026-03-28 12:03:35 [auto1.it] INFO: Found listing with ID: EW58174
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW58174%27 HTTP/1.1" 200 None
2026-03-28 12:03:35 [auto1.it] INFO: Scrape type for EW58174: 0
2026-03-28 12:03:35 [auto1.it] INFO: Found listing with ID: BJ54442
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ54442%27 HTTP/1.1" 200 None
2026-03-28 12:03:35 [auto1.it] INFO: Scrape type for BJ54442: 0
2026-03-28 12:03:35 [auto1.it] INFO: Found listing with ID: WG71830
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG71830%27 HTTP/1.1" 200 None
2026-03-28 12:03:35 [auto1.it] INFO: Scrape type for WG71830: 0
2026-03-28 12:03:35 [auto1.it] INFO: Found listing with ID: BN39787
2026-03-28 12:03:35 [auto1.it] INFO: Found listing with ID: CU47897
2026-03-28 12:03:35 [auto1.it] INFO: Found listing with ID: PC45346
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC45346%27 HTTP/1.1" 200 None
2026-03-28 12:03:35 [auto1.it] INFO: Scrape type for PC45346: 0
2026-03-28 12:03:35 [auto1.it] INFO: Found listing with ID: PP79756
2026-03-28 12:03:35 [auto1.it] INFO: Found listing with ID: ET18212
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET18212%27 HTTP/1.1" 200 None
2026-03-28 12:03:35 [auto1.it] INFO: Scrape type for ET18212: 2
2026-03-28 12:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e424ca48-1340-5335-83ae-bbcd296eaf33 with identifier: ET18212
2026-03-28 12:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e424ca48-1340-5335-83ae-bbcd296eaf33 with scrape type 2
2026-03-28 12:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e424ca48-1340-5335-83ae-bbcd296eaf33 with scrape type 2
2026-03-28 12:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e424ca48-1340-5335-83ae-bbcd296eaf33, identifier: ET18212
2026-03-28 12:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e424ca48-1340-5335-83ae-bbcd296eaf33 with identifier: ET18212
2026-03-28 12:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e424ca48-1340-5335-83ae-bbcd296eaf33 with identifier: ET18212
2026-03-28 12:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e424ca48-1340-5335-83ae-bbcd296eaf33 with identifier: ET18212 to the API
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:39:08Z',
'fuel_type': 'diesel',
'id': 'e424ca48-1340-5335-83ae-bbcd296eaf33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET18212',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 87587,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-25',
'seller_name': None,
'title': 'BMW 1er 116d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2021}
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET18212%27 HTTP/1.1" 200 None
2026-03-28 12:03:35 [auto1.it] INFO: Saving data for ET18212: {'auction_closing_time': 1774715948.0, 'created_time': 1773910935.135749, 'last_price_update_time': 1774699415.976843}
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ET18212') HTTP/1.1" 204 0
2026-03-28 12:03:36 [auto1.it] INFO: Found listing with ID: UB44414
2026-03-28 12:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB44414%27 HTTP/1.1" 200 None
2026-03-28 12:03:36 [auto1.it] INFO: Scrape type for UB44414: 0
2026-03-28 12:03:36 [auto1.it] INFO: Found listing with ID: KA06591
2026-03-28 12:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA06591%27 HTTP/1.1" 200 None
2026-03-28 12:03:36 [auto1.it] INFO: Scrape type for KA06591: 0
2026-03-28 12:03:36 [auto1.it] INFO: Found listing with ID: CY67116
2026-03-28 12:03:36 [auto1.it] INFO: Found listing with ID: GN28871
2026-03-28 12:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN28871%27 HTTP/1.1" 200 None
2026-03-28 12:03:36 [auto1.it] INFO: Scrape type for GN28871: 0
2026-03-28 12:03:36 [auto1.it] INFO: Found listing with ID: GA27692
2026-03-28 12:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA27692%27 HTTP/1.1" 200 None
2026-03-28 12:03:36 [auto1.it] INFO: Scrape type for GA27692: 0
2026-03-28 12:03:36 [auto1.it] INFO: Found listing with ID: DR95248
2026-03-28 12:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR95248%27 HTTP/1.1" 200 None
2026-03-28 12:03:36 [auto1.it] INFO: Scrape type for DR95248: 0
2026-03-28 12:03:36 [auto1.it] INFO: Found listing with ID: BC82783
2026-03-28 12:03:36 [auto1.it] INFO: Found listing with ID: NR20429
2026-03-28 12:03:36 [auto1.it] INFO: Found listing with ID: WK48161
2026-03-28 12:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK48161%27 HTTP/1.1" 200 None
2026-03-28 12:03:36 [auto1.it] INFO: Scrape type for WK48161: 0
2026-03-28 12:03:36 [auto1.it] INFO: Found listing with ID: NV90062
2026-03-28 12:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV90062%27 HTTP/1.1" 200 None
2026-03-28 12:03:36 [auto1.it] INFO: Scrape type for NV90062: 0
2026-03-28 12:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:36 [auto1.it] INFO: Channel: 24h | Page: 40 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:36 [auto1.it] INFO: Found listing with ID: EE16681
2026-03-28 12:03:36 [auto1.it] INFO: Found listing with ID: FR49245
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR49245%27 HTTP/1.1" 200 None
2026-03-28 12:03:37 [auto1.it] INFO: Scrape type for FR49245: 0
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: RY75551
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: ZR71790
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: KF98112
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: XK39914
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: KA09698
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA09698%27 HTTP/1.1" 200 None
2026-03-28 12:03:37 [auto1.it] INFO: Scrape type for KA09698: 0
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: UD95493
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: UB69293
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB69293%27 HTTP/1.1" 200 None
2026-03-28 12:03:37 [auto1.it] INFO: Scrape type for UB69293: 2
2026-03-28 12:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc8f9ed4-4384-554d-a914-45306dc4dc2c with identifier: UB69293
2026-03-28 12:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc8f9ed4-4384-554d-a914-45306dc4dc2c with scrape type 2
2026-03-28 12:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc8f9ed4-4384-554d-a914-45306dc4dc2c with scrape type 2
2026-03-28 12:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fc8f9ed4-4384-554d-a914-45306dc4dc2c, identifier: UB69293
2026-03-28 12:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fc8f9ed4-4384-554d-a914-45306dc4dc2c with identifier: UB69293
2026-03-28 12:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fc8f9ed4-4384-554d-a914-45306dc4dc2c with identifier: UB69293
2026-03-28 12:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fc8f9ed4-4384-554d-a914-45306dc4dc2c with identifier: UB69293 to the API
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:47:37Z',
'fuel_type': 'diesel',
'id': 'fc8f9ed4-4384-554d-a914-45306dc4dc2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB69293',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 191556,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-28',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2019}
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB69293%27 HTTP/1.1" 200 None
2026-03-28 12:03:37 [auto1.it] INFO: Saving data for UB69293: {'auction_closing_time': 1774716457.0, 'created_time': 1774515725.275461, 'last_price_update_time': 1774699417.482466}
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UB69293') HTTP/1.1" 204 0
2026-03-28 12:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: DW64097
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: AR58542
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR58542%27 HTTP/1.1" 200 None
2026-03-28 12:03:37 [auto1.it] INFO: Scrape type for AR58542: 0
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: AP13803
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP13803%27 HTTP/1.1" 200 None
2026-03-28 12:03:37 [auto1.it] INFO: Scrape type for AP13803: 0
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: BA49572
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: AH31892
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH31892%27 HTTP/1.1" 200 None
2026-03-28 12:03:37 [auto1.it] INFO: Scrape type for AH31892: 0
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: JZ33949
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: HG28302
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG28302%27 HTTP/1.1" 200 None
2026-03-28 12:03:37 [auto1.it] INFO: Scrape type for HG28302: 0
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: MZ33664
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: DH47051
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: SV45287
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: YR08736
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR08736%27 HTTP/1.1" 200 None
2026-03-28 12:03:37 [auto1.it] INFO: Scrape type for YR08736: 0
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: JM31879
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: BB73520
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB73520%27 HTTP/1.1" 200 None
2026-03-28 12:03:37 [auto1.it] INFO: Scrape type for BB73520: 0
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: BX36809
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX36809%27 HTTP/1.1" 200 None
2026-03-28 12:03:37 [auto1.it] INFO: Scrape type for BX36809: 0
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: MD72836
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: CU10476
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU10476%27 HTTP/1.1" 200 None
2026-03-28 12:03:37 [auto1.it] INFO: Scrape type for CU10476: 0
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: SJ04841
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ04841%27 HTTP/1.1" 200 None
2026-03-28 12:03:37 [auto1.it] INFO: Scrape type for SJ04841: 0
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: VV36209
2026-03-28 12:03:37 [auto1.it] INFO: Found listing with ID: FL80694
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL80694%27 HTTP/1.1" 200 None
2026-03-28 12:03:37 [auto1.it] INFO: Scrape type for FL80694: 2
2026-03-28 12:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df6fbdfc-82b6-543a-8872-8ef69070ccce with identifier: FL80694
2026-03-28 12:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df6fbdfc-82b6-543a-8872-8ef69070ccce with scrape type 2
2026-03-28 12:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df6fbdfc-82b6-543a-8872-8ef69070ccce with scrape type 2
2026-03-28 12:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: df6fbdfc-82b6-543a-8872-8ef69070ccce, identifier: FL80694
2026-03-28 12:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: df6fbdfc-82b6-543a-8872-8ef69070ccce with identifier: FL80694
2026-03-28 12:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: df6fbdfc-82b6-543a-8872-8ef69070ccce with identifier: FL80694
2026-03-28 12:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: df6fbdfc-82b6-543a-8872-8ef69070ccce with identifier: FL80694 to the API
2026-03-28 12:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:40:39Z',
'fuel_type': 'diesel',
'id': 'df6fbdfc-82b6-543a-8872-8ef69070ccce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL80694',
'listing': 'auction',
'make': 'Fiat',
'model': '500L',
'odometer': 115586,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-16',
'seller_name': None,
'title': 'Fiat 500L 1.6 JTDM Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2015}
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL80694%27 HTTP/1.1" 200 None
2026-03-28 12:03:38 [auto1.it] INFO: Saving data for FL80694: {'auction_closing_time': 1774716039.0, 'created_time': 1774515620.585138, 'last_price_update_time': 1774699418.250764}
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FL80694') HTTP/1.1" 204 0
2026-03-28 12:03:38 [auto1.it] INFO: Found listing with ID: EM88233
2026-03-28 12:03:38 [auto1.it] INFO: Found listing with ID: FF42282
2026-03-28 12:03:38 [auto1.it] INFO: Found listing with ID: UH38063
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH38063%27 HTTP/1.1" 200 None
2026-03-28 12:03:38 [auto1.it] INFO: Scrape type for UH38063: 0
2026-03-28 12:03:38 [auto1.it] INFO: Found listing with ID: BR49145
2026-03-28 12:03:38 [auto1.it] INFO: Found listing with ID: XE50216
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE50216%27 HTTP/1.1" 200 None
2026-03-28 12:03:38 [auto1.it] INFO: Scrape type for XE50216: 0
2026-03-28 12:03:38 [auto1.it] INFO: Found listing with ID: VH95383
2026-03-28 12:03:38 [auto1.it] INFO: Found listing with ID: VB21815
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB21815%27 HTTP/1.1" 200 None
2026-03-28 12:03:38 [auto1.it] INFO: Scrape type for VB21815: 0
2026-03-28 12:03:38 [auto1.it] INFO: Found listing with ID: WU32452
2026-03-28 12:03:38 [auto1.it] INFO: Found listing with ID: KW78911
2026-03-28 12:03:38 [auto1.it] INFO: Found listing with ID: AB01371
2026-03-28 12:03:38 [auto1.it] INFO: Found listing with ID: XF08656
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF08656%27 HTTP/1.1" 200 None
2026-03-28 12:03:38 [auto1.it] INFO: Scrape type for XF08656: 0
2026-03-28 12:03:38 [auto1.it] INFO: Found listing with ID: BT51990
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT51990%27 HTTP/1.1" 200 None
2026-03-28 12:03:38 [auto1.it] INFO: Scrape type for BT51990: 2
2026-03-28 12:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 537a0315-c72a-595a-bad8-1f7115b1dae4 with identifier: BT51990
2026-03-28 12:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 537a0315-c72a-595a-bad8-1f7115b1dae4 with scrape type 2
2026-03-28 12:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 537a0315-c72a-595a-bad8-1f7115b1dae4 with scrape type 2
2026-03-28 12:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 537a0315-c72a-595a-bad8-1f7115b1dae4, identifier: BT51990
2026-03-28 12:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 537a0315-c72a-595a-bad8-1f7115b1dae4 with identifier: BT51990
2026-03-28 12:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 537a0315-c72a-595a-bad8-1f7115b1dae4 with identifier: BT51990
2026-03-28 12:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 537a0315-c72a-595a-bad8-1f7115b1dae4 with identifier: BT51990 to the API
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:04:50Z',
'fuel_type': 'diesel',
'id': '537a0315-c72a-595a-bad8-1f7115b1dae4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT51990',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix20',
'odometer': 246210,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-29',
'seller_name': None,
'title': 'Hyundai ix20 1.4 CRDi Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2014}
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT51990%27 HTTP/1.1" 200 None
2026-03-28 12:03:38 [auto1.it] INFO: Saving data for BT51990: {'auction_closing_time': 1774713890.0, 'created_time': 1774515736.050156, 'last_price_update_time': 1774699418.901214}
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BT51990') HTTP/1.1" 204 0
2026-03-28 12:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:40 [auto1.it] INFO: Channel: 24h | Page: 41 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: CT54414
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT54414%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for CT54414: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: BJ21664
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ21664%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for BJ21664: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: ET28084
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: JS18967
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS18967%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for JS18967: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: UT61687
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: KV14402
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: KV97590
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: SN54717
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN54717%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for SN54717: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: PF84937
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: DT23804
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: UE59883
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE59883%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for UE59883: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: KX90230
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX90230%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for KX90230: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: HU53243
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU53243%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for HU53243: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: ZD91383
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: PZ68086
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: AC58297
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC58297%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for AC58297: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: ED83032
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED83032%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for ED83032: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: ZJ46829
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ46829%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for ZJ46829: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: XW11581
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: BS34699
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS34699%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for BS34699: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: FA74836
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA74836%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for FA74836: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: VB18666
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: YU90984
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU90984%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for YU90984: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: TF40729
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: LN63295
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN63295%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for LN63295: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: DA14696
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: YX40722
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX40722%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for YX40722: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: WS98369
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS98369%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for WS98369: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: JW15936
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: HG36581
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG36581%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for HG36581: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: BF27617
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF27617%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for BF27617: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: FH04610
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: WU42873
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: HW72110
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: ZF50990
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF50990%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for ZF50990: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: LD57265
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: TA99011
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: KR59858
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR59858%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for KR59858: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: SK65228
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK65228%27 HTTP/1.1" 200 None
2026-03-28 12:03:40 [auto1.it] INFO: Scrape type for SK65228: 0
2026-03-28 12:03:40 [auto1.it] INFO: Found listing with ID: VS16589
2026-03-28 12:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:41 [auto1.it] INFO: Channel: 24h | Page: 42 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: RY64752
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: XW75946
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: ZU45449
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: WM58215
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: ZP08653
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: MT35916
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT35916%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for MT35916: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: XH06429
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: JB22661
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB22661%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for JB22661: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: TW76525
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW76525%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for TW76525: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: CP76510
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: TB87558
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB87558%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for TB87558: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: CC19770
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: VY00315
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY00315%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for VY00315: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: PD51522
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: VW75885
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW75885%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for VW75885: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: PA11194
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA11194%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for PA11194: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: KT64374
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT64374%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for KT64374: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: HS22192
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: GU77220
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU77220%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for GU77220: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: KC61332
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: VZ02173
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: GR02262
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: LJ91384
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: CY31858
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: WM29038
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM29038%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for WM29038: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: XN45534
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: LR14245
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR14245%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for LR14245: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: UH68033
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH68033%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for UH68033: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: VN85673
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: RM92926
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM92926%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for RM92926: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: NV20276
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV20276%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for NV20276: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: UX25777
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: EK30542
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: ME36954
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: FY24285
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY24285%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for FY24285: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: GW87454
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW87454%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for GW87454: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: JS13846
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: NB30604
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB30604%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for NB30604: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: CS63696
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS63696%27 HTTP/1.1" 200 None
2026-03-28 12:03:41 [auto1.it] INFO: Scrape type for CS63696: 0
2026-03-28 12:03:41 [auto1.it] INFO: Found listing with ID: HW76597
2026-03-28 12:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:42 [auto1.it] INFO: Channel: 24h | Page: 43 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:42 [auto1.it] INFO: Found listing with ID: AB32606
2026-03-28 12:03:42 [auto1.it] INFO: Found listing with ID: TM60577
2026-03-28 12:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM60577%27 HTTP/1.1" 200 None
2026-03-28 12:03:42 [auto1.it] INFO: Scrape type for TM60577: 0
2026-03-28 12:03:42 [auto1.it] INFO: Found listing with ID: NT36373
2026-03-28 12:03:42 [auto1.it] INFO: Found listing with ID: YX73536
2026-03-28 12:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX73536%27 HTTP/1.1" 200 None
2026-03-28 12:03:42 [auto1.it] INFO: Scrape type for YX73536: 0
2026-03-28 12:03:42 [auto1.it] INFO: Found listing with ID: YH73900
2026-03-28 12:03:42 [auto1.it] INFO: Found listing with ID: TN90495
2026-03-28 12:03:42 [auto1.it] INFO: Found listing with ID: UE02945
2026-03-28 12:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE02945%27 HTTP/1.1" 200 None
2026-03-28 12:03:42 [auto1.it] INFO: Scrape type for UE02945: 0
2026-03-28 12:03:42 [auto1.it] INFO: Found listing with ID: AX03147
2026-03-28 12:03:42 [auto1.it] INFO: Found listing with ID: BZ92290
2026-03-28 12:03:42 [auto1.it] INFO: Found listing with ID: PB66725
2026-03-28 12:03:42 [auto1.it] INFO: Found listing with ID: TB34384
2026-03-28 12:03:42 [auto1.it] INFO: Found listing with ID: MJ42614
2026-03-28 12:03:42 [auto1.it] INFO: Found listing with ID: RJ57897
2026-03-28 12:03:42 [auto1.it] INFO: Found listing with ID: GT90583
2026-03-28 12:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT90583%27 HTTP/1.1" 200 None
2026-03-28 12:03:43 [auto1.it] INFO: Scrape type for GT90583: 0
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: BJ81440
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: AF34826
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: UC76692
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC76692%27 HTTP/1.1" 200 None
2026-03-28 12:03:43 [auto1.it] INFO: Scrape type for UC76692: 0
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: XX89232
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX89232%27 HTTP/1.1" 200 None
2026-03-28 12:03:43 [auto1.it] INFO: Scrape type for XX89232: 0
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: PW51230
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW51230%27 HTTP/1.1" 200 None
2026-03-28 12:03:43 [auto1.it] INFO: Scrape type for PW51230: 0
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: TU80185
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: KE18489
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: TN86545
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: DT89557
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT89557%27 HTTP/1.1" 200 None
2026-03-28 12:03:43 [auto1.it] INFO: Scrape type for DT89557: 0
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: SN05333
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN05333%27 HTTP/1.1" 200 None
2026-03-28 12:03:43 [auto1.it] INFO: Scrape type for SN05333: 0
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: NF06538
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: XD75344
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: WV36491
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV36491%27 HTTP/1.1" 200 None
2026-03-28 12:03:43 [auto1.it] INFO: Scrape type for WV36491: 0
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: HR62667
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: NG38983
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG38983%27 HTTP/1.1" 200 None
2026-03-28 12:03:43 [auto1.it] INFO: Scrape type for NG38983: 0
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: GT34435
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT34435%27 HTTP/1.1" 200 None
2026-03-28 12:03:43 [auto1.it] INFO: Scrape type for GT34435: 2
2026-03-28 12:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06c63319-e6ee-57b2-a13a-bf92adc38d63 with identifier: GT34435
2026-03-28 12:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06c63319-e6ee-57b2-a13a-bf92adc38d63 with scrape type 2
2026-03-28 12:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06c63319-e6ee-57b2-a13a-bf92adc38d63 with scrape type 2
2026-03-28 12:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 06c63319-e6ee-57b2-a13a-bf92adc38d63, identifier: GT34435
2026-03-28 12:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 06c63319-e6ee-57b2-a13a-bf92adc38d63 with identifier: GT34435
2026-03-28 12:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 06c63319-e6ee-57b2-a13a-bf92adc38d63 with identifier: GT34435
2026-03-28 12:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 06c63319-e6ee-57b2-a13a-bf92adc38d63 with identifier: GT34435 to the API
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:07:59Z',
'fuel_type': 'diesel',
'id': '06c63319-e6ee-57b2-a13a-bf92adc38d63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT34435',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 110855,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-29',
'seller_name': None,
'title': 'Fiat 500X 1.6 JTDM Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2015}
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT34435%27 HTTP/1.1" 200 None
2026-03-28 12:03:43 [auto1.it] INFO: Saving data for GT34435: {'auction_closing_time': 1774714079.0, 'created_time': 1774515666.91934, 'last_price_update_time': 1774699423.684439}
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GT34435') HTTP/1.1" 204 0
2026-03-28 12:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: DM32670
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM32670%27 HTTP/1.1" 200 None
2026-03-28 12:03:43 [auto1.it] INFO: Scrape type for DM32670: 0
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: SM92282
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM92282%27 HTTP/1.1" 200 None
2026-03-28 12:03:43 [auto1.it] INFO: Scrape type for SM92282: 0
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: LF83969
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF83969%27 HTTP/1.1" 200 None
2026-03-28 12:03:43 [auto1.it] INFO: Scrape type for LF83969: 0
2026-03-28 12:03:43 [auto1.it] INFO: Found listing with ID: YA27066
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA27066%27 HTTP/1.1" 200 None
2026-03-28 12:03:43 [auto1.it] INFO: Scrape type for YA27066: 2
2026-03-28 12:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64d0b21c-6cb5-5f8a-bc8f-c52094350be5 with identifier: YA27066
2026-03-28 12:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64d0b21c-6cb5-5f8a-bc8f-c52094350be5 with scrape type 2
2026-03-28 12:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64d0b21c-6cb5-5f8a-bc8f-c52094350be5 with scrape type 2
2026-03-28 12:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 64d0b21c-6cb5-5f8a-bc8f-c52094350be5, identifier: YA27066
2026-03-28 12:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 64d0b21c-6cb5-5f8a-bc8f-c52094350be5 with identifier: YA27066
2026-03-28 12:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 64d0b21c-6cb5-5f8a-bc8f-c52094350be5 with identifier: YA27066
2026-03-28 12:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 64d0b21c-6cb5-5f8a-bc8f-c52094350be5 with identifier: YA27066 to the API
2026-03-28 12:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:33:31Z',
'fuel_type': 'petrol',
'id': '64d0b21c-6cb5-5f8a-bc8f-c52094350be5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA27066',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 145334,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-28',
'seller_name': None,
'title': 'Toyota Aygo 1.0 X-Play',
'transmission': 'manual',
'trim': 'X-Play',
'year': 2015}
2026-03-28 12:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA27066%27 HTTP/1.1" 200 None
2026-03-28 12:03:44 [auto1.it] INFO: Saving data for YA27066: {'auction_closing_time': 1774715611.0, 'created_time': 1774515658.49447, 'last_price_update_time': 1774699424.253329}
2026-03-28 12:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YA27066') HTTP/1.1" 204 0
2026-03-28 12:03:44 [auto1.it] INFO: Found listing with ID: GF32219
2026-03-28 12:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF32219%27 HTTP/1.1" 200 None
2026-03-28 12:03:44 [auto1.it] INFO: Scrape type for GF32219: 0
2026-03-28 12:03:44 [auto1.it] INFO: Found listing with ID: WW13816
2026-03-28 12:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW13816%27 HTTP/1.1" 200 None
2026-03-28 12:03:44 [auto1.it] INFO: Scrape type for WW13816: 0
2026-03-28 12:03:44 [auto1.it] INFO: Found listing with ID: KW05782
2026-03-28 12:03:44 [auto1.it] INFO: Found listing with ID: FM41301
2026-03-28 12:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM41301%27 HTTP/1.1" 200 None
2026-03-28 12:03:44 [auto1.it] INFO: Scrape type for FM41301: 0
2026-03-28 12:03:44 [auto1.it] INFO: Found listing with ID: PV36445
2026-03-28 12:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV36445%27 HTTP/1.1" 200 None
2026-03-28 12:03:44 [auto1.it] INFO: Scrape type for PV36445: 0
2026-03-28 12:03:44 [auto1.it] INFO: Found listing with ID: JE16682
2026-03-28 12:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:45 [auto1.it] INFO: Channel: 24h | Page: 44 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: PY44760
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: YA27479
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: GP83867
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: RK56494
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK56494%27 HTTP/1.1" 200 None
2026-03-28 12:03:45 [auto1.it] INFO: Scrape type for RK56494: 0
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: FS14402
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS14402%27 HTTP/1.1" 200 None
2026-03-28 12:03:45 [auto1.it] INFO: Scrape type for FS14402: 0
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: AS05452
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: ES04012
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: LZ09270
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: AS39534
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS39534%27 HTTP/1.1" 200 None
2026-03-28 12:03:45 [auto1.it] INFO: Scrape type for AS39534: 0
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: DL65362
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: EN70026
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN70026%27 HTTP/1.1" 200 None
2026-03-28 12:03:45 [auto1.it] INFO: Scrape type for EN70026: 0
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: XT78781
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT78781%27 HTTP/1.1" 200 None
2026-03-28 12:03:45 [auto1.it] INFO: Scrape type for XT78781: 0
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: CZ95838
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: LZ34680
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: AN40699
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN40699%27 HTTP/1.1" 200 None
2026-03-28 12:03:45 [auto1.it] INFO: Scrape type for AN40699: 0
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: UC06691
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC06691%27 HTTP/1.1" 200 None
2026-03-28 12:03:45 [auto1.it] INFO: Scrape type for UC06691: 0
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: ZH38248
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH38248%27 HTTP/1.1" 200 None
2026-03-28 12:03:45 [auto1.it] INFO: Scrape type for ZH38248: 0
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: DZ90619
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: CE26038
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: NB63581
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB63581%27 HTTP/1.1" 200 None
2026-03-28 12:03:45 [auto1.it] INFO: Scrape type for NB63581: 2
2026-03-28 12:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 782ea339-b04d-50b1-88db-13399b7be615 with identifier: NB63581
2026-03-28 12:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 782ea339-b04d-50b1-88db-13399b7be615 with scrape type 2
2026-03-28 12:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 782ea339-b04d-50b1-88db-13399b7be615 with scrape type 2
2026-03-28 12:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 782ea339-b04d-50b1-88db-13399b7be615, identifier: NB63581
2026-03-28 12:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 782ea339-b04d-50b1-88db-13399b7be615 with identifier: NB63581
2026-03-28 12:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 782ea339-b04d-50b1-88db-13399b7be615 with identifier: NB63581
2026-03-28 12:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 782ea339-b04d-50b1-88db-13399b7be615 with identifier: NB63581 to the API
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:16:22Z',
'fuel_type': 'diesel',
'id': '782ea339-b04d-50b1-88db-13399b7be615',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB63581',
'listing': 'auction',
'make': 'Jaguar',
'model': 'E-Pace',
'odometer': 170557,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-10',
'seller_name': None,
'title': 'Jaguar E-Pace D150 AWD',
'transmission': 'automatic',
'trim': 'AWD',
'year': 2018}
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB63581%27 HTTP/1.1" 200 None
2026-03-28 12:03:45 [auto1.it] INFO: Saving data for NB63581: {'auction_closing_time': 1774714582.0, 'created_time': 1774515731.075597, 'last_price_update_time': 1774699425.846979}
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NB63581') HTTP/1.1" 204 0
2026-03-28 12:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: VM26372
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: NL15395
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: BG87604
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: LZ35961
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: YT66548
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: AZ05187
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: WS24501
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS24501%27 HTTP/1.1" 200 None
2026-03-28 12:03:45 [auto1.it] INFO: Scrape type for WS24501: 0
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: NR87302
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR87302%27 HTTP/1.1" 200 None
2026-03-28 12:03:45 [auto1.it] INFO: Scrape type for NR87302: 0
2026-03-28 12:03:45 [auto1.it] INFO: Found listing with ID: ML34451
2026-03-28 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML34451%27 HTTP/1.1" 200 None
2026-03-28 12:03:46 [auto1.it] INFO: Scrape type for ML34451: 0
2026-03-28 12:03:46 [auto1.it] INFO: Found listing with ID: ZS54460
2026-03-28 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS54460%27 HTTP/1.1" 200 None
2026-03-28 12:03:46 [auto1.it] INFO: Scrape type for ZS54460: 0
2026-03-28 12:03:46 [auto1.it] INFO: Found listing with ID: KC88593
2026-03-28 12:03:46 [auto1.it] INFO: Found listing with ID: JH12834
2026-03-28 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH12834%27 HTTP/1.1" 200 None
2026-03-28 12:03:46 [auto1.it] INFO: Scrape type for JH12834: 0
2026-03-28 12:03:46 [auto1.it] INFO: Found listing with ID: UH56050
2026-03-28 12:03:46 [auto1.it] INFO: Found listing with ID: VE88440
2026-03-28 12:03:46 [auto1.it] INFO: Found listing with ID: WS26494
2026-03-28 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS26494%27 HTTP/1.1" 200 None
2026-03-28 12:03:46 [auto1.it] INFO: Scrape type for WS26494: 0
2026-03-28 12:03:46 [auto1.it] INFO: Found listing with ID: VK91535
2026-03-28 12:03:46 [auto1.it] INFO: Found listing with ID: BF34891
2026-03-28 12:03:46 [auto1.it] INFO: Found listing with ID: FJ33750
2026-03-28 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ33750%27 HTTP/1.1" 200 None
2026-03-28 12:03:46 [auto1.it] INFO: Scrape type for FJ33750: 0
2026-03-28 12:03:46 [auto1.it] INFO: Found listing with ID: XN46207
2026-03-28 12:03:46 [auto1.it] INFO: Found listing with ID: NF47535
2026-03-28 12:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:47 [auto1.it] INFO: Channel: 24h | Page: 45 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:47 [auto1.it] INFO: Found listing with ID: AW83777
2026-03-28 12:03:47 [auto1.it] INFO: Found listing with ID: UN97193
2026-03-28 12:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN97193%27 HTTP/1.1" 200 None
2026-03-28 12:03:47 [auto1.it] INFO: Scrape type for UN97193: 2
2026-03-28 12:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ca21c55-ea7b-5de7-be56-1454eca3c3f4 with identifier: UN97193
2026-03-28 12:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ca21c55-ea7b-5de7-be56-1454eca3c3f4 with scrape type 2
2026-03-28 12:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ca21c55-ea7b-5de7-be56-1454eca3c3f4 with scrape type 2
2026-03-28 12:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6ca21c55-ea7b-5de7-be56-1454eca3c3f4, identifier: UN97193
2026-03-28 12:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6ca21c55-ea7b-5de7-be56-1454eca3c3f4 with identifier: UN97193
2026-03-28 12:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6ca21c55-ea7b-5de7-be56-1454eca3c3f4 with identifier: UN97193
2026-03-28 12:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6ca21c55-ea7b-5de7-be56-1454eca3c3f4 with identifier: UN97193 to the API
2026-03-28 12:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:09:31Z',
'fuel_type': 'petrol',
'id': '6ca21c55-ea7b-5de7-be56-1454eca3c3f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN97193',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 227699,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-23',
'seller_name': None,
'title': 'Toyota Yaris 1.0 VVT-i Sol',
'transmission': 'manual',
'trim': 'Sol',
'year': 2011}
2026-03-28 12:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN97193%27 HTTP/1.1" 200 None
2026-03-28 12:03:47 [auto1.it] INFO: Saving data for UN97193: {'auction_closing_time': 1774714171.0, 'created_time': 1773232855.230352, 'last_price_update_time': 1774699427.969018}
2026-03-28 12:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UN97193') HTTP/1.1" 204 0
2026-03-28 12:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: MN57252
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN57252%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for MN57252: 2
2026-03-28 12:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccd17c53-a875-5475-b622-4a9f982cf781 with identifier: MN57252
2026-03-28 12:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccd17c53-a875-5475-b622-4a9f982cf781 with scrape type 2
2026-03-28 12:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccd17c53-a875-5475-b622-4a9f982cf781 with scrape type 2
2026-03-28 12:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ccd17c53-a875-5475-b622-4a9f982cf781, identifier: MN57252
2026-03-28 12:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ccd17c53-a875-5475-b622-4a9f982cf781 with identifier: MN57252
2026-03-28 12:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ccd17c53-a875-5475-b622-4a9f982cf781 with identifier: MN57252
2026-03-28 12:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ccd17c53-a875-5475-b622-4a9f982cf781 with identifier: MN57252 to the API
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:14:03Z',
'fuel_type': 'diesel',
'id': 'ccd17c53-a875-5475-b622-4a9f982cf781',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN57252',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 185977,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-26',
'seller_name': None,
'title': 'BMW 3er 320d Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2016}
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN57252%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Saving data for MN57252: {'auction_closing_time': 1774714443.0, 'created_time': 1773921636.904434, 'last_price_update_time': 1774699428.520413}
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MN57252') HTTP/1.1" 204 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: TZ83708
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ83708%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for TZ83708: 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: KZ82470
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ82470%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for KZ82470: 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: MW18742
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW18742%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for MW18742: 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: FC02474
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC02474%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for FC02474: 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: JA78037
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA78037%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for JA78037: 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: BN58540
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: FU65166
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: YV43254
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: CA25129
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA25129%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for CA25129: 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: CE40479
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: WT36822
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT36822%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for WT36822: 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: HN39146
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: DK95010
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK95010%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for DK95010: 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: ZT62923
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: MV32158
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV32158%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for MV32158: 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: RV46359
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV46359%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for RV46359: 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: VX22650
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: UV86732
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: LR88611
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: KC34999
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC34999%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for KC34999: 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: YG71564
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG71564%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for YG71564: 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: SU56229
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: FJ79920
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: LN35929
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: VS62042
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: VR29883
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: CR81411
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR81411%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for CR81411: 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: PS88419
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: HP97671
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP97671%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for HP97671: 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: NP87622
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP87622%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for NP87622: 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: UA26994
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: AM15207
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM15207%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for AM15207: 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: ZP66852
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: AJ97294
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: SW80726
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: MA64070
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA64070%27 HTTP/1.1" 200 None
2026-03-28 12:03:48 [auto1.it] INFO: Scrape type for MA64070: 0
2026-03-28 12:03:48 [auto1.it] INFO: Found listing with ID: EM71095
2026-03-28 12:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:49 [auto1.it] INFO: Channel: 24h | Page: 46 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:49 [auto1.it] INFO: Found listing with ID: VS38043
2026-03-28 12:03:49 [auto1.it] INFO: Found listing with ID: JW99626
2026-03-28 12:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW99626%27 HTTP/1.1" 200 None
2026-03-28 12:03:49 [auto1.it] INFO: Scrape type for JW99626: 0
2026-03-28 12:03:49 [auto1.it] INFO: Found listing with ID: MK90568
2026-03-28 12:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK90568%27 HTTP/1.1" 200 None
2026-03-28 12:03:49 [auto1.it] INFO: Scrape type for MK90568: 0
2026-03-28 12:03:49 [auto1.it] INFO: Found listing with ID: JX77984
2026-03-28 12:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX77984%27 HTTP/1.1" 200 None
2026-03-28 12:03:49 [auto1.it] INFO: Scrape type for JX77984: 2
2026-03-28 12:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99b6e6ac-3f43-552d-a6d1-79c10cb7267c with identifier: JX77984
2026-03-28 12:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99b6e6ac-3f43-552d-a6d1-79c10cb7267c with scrape type 2
2026-03-28 12:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99b6e6ac-3f43-552d-a6d1-79c10cb7267c with scrape type 2
2026-03-28 12:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 99b6e6ac-3f43-552d-a6d1-79c10cb7267c, identifier: JX77984
2026-03-28 12:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 99b6e6ac-3f43-552d-a6d1-79c10cb7267c with identifier: JX77984
2026-03-28 12:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 99b6e6ac-3f43-552d-a6d1-79c10cb7267c with identifier: JX77984
2026-03-28 12:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 99b6e6ac-3f43-552d-a6d1-79c10cb7267c with identifier: JX77984 to the API
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 151,
'expiration_date': '2026-03-28T16:42:58Z',
'fuel_type': 'petrol',
'id': '99b6e6ac-3f43-552d-a6d1-79c10cb7267c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX77984',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 64519,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-27',
'seller_name': None,
'title': 'Fiat 500X 1.3 Turbo S-Design Cross',
'transmission': 'automatic',
'trim': 'S-Design Cross',
'year': 2020}
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX77984%27 HTTP/1.1" 200 None
2026-03-28 12:03:50 [auto1.it] INFO: Saving data for JX77984: {'auction_closing_time': 1774716178.0, 'created_time': 1774515726.944078, 'last_price_update_time': 1774699430.324365}
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JX77984') HTTP/1.1" 204 0
2026-03-28 12:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:50 [auto1.it] INFO: Found listing with ID: PA30121
2026-03-28 12:03:50 [auto1.it] INFO: Found listing with ID: HJ68479
2026-03-28 12:03:50 [auto1.it] INFO: Found listing with ID: GK89586
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK89586%27 HTTP/1.1" 200 None
2026-03-28 12:03:50 [auto1.it] INFO: Scrape type for GK89586: 0
2026-03-28 12:03:50 [auto1.it] INFO: Found listing with ID: GT17174
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT17174%27 HTTP/1.1" 200 None
2026-03-28 12:03:50 [auto1.it] INFO: Scrape type for GT17174: 2
2026-03-28 12:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2b57496-0587-52e4-9a9b-7f3e8162c89d with identifier: GT17174
2026-03-28 12:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2b57496-0587-52e4-9a9b-7f3e8162c89d with scrape type 2
2026-03-28 12:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2b57496-0587-52e4-9a9b-7f3e8162c89d with scrape type 2
2026-03-28 12:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d2b57496-0587-52e4-9a9b-7f3e8162c89d, identifier: GT17174
2026-03-28 12:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d2b57496-0587-52e4-9a9b-7f3e8162c89d with identifier: GT17174
2026-03-28 12:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d2b57496-0587-52e4-9a9b-7f3e8162c89d with identifier: GT17174
2026-03-28 12:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d2b57496-0587-52e4-9a9b-7f3e8162c89d with identifier: GT17174 to the API
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:14:34Z',
'fuel_type': 'diesel',
'id': 'd2b57496-0587-52e4-9a9b-7f3e8162c89d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT17174',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Alfa 159',
'odometer': 290775,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-06',
'seller_name': None,
'title': 'Alfa Romeo Alfa 159 2.0 JTDM Turismo',
'transmission': 'manual',
'trim': 'Turismo',
'year': 2011}
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT17174%27 HTTP/1.1" 200 None
2026-03-28 12:03:50 [auto1.it] INFO: Saving data for GT17174: {'auction_closing_time': 1774714474.0, 'created_time': 1774015446.300334, 'last_price_update_time': 1774699430.89629}
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GT17174') HTTP/1.1" 204 0
2026-03-28 12:03:50 [auto1.it] INFO: Found listing with ID: RE49156
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE49156%27 HTTP/1.1" 200 None
2026-03-28 12:03:50 [auto1.it] INFO: Scrape type for RE49156: 2
2026-03-28 12:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e7a9f7a-1779-516a-ae90-94939914aa57 with identifier: RE49156
2026-03-28 12:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e7a9f7a-1779-516a-ae90-94939914aa57 with scrape type 2
2026-03-28 12:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e7a9f7a-1779-516a-ae90-94939914aa57 with scrape type 2
2026-03-28 12:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5e7a9f7a-1779-516a-ae90-94939914aa57, identifier: RE49156
2026-03-28 12:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5e7a9f7a-1779-516a-ae90-94939914aa57 with identifier: RE49156
2026-03-28 12:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5e7a9f7a-1779-516a-ae90-94939914aa57 with identifier: RE49156
2026-03-28 12:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5e7a9f7a-1779-516a-ae90-94939914aa57 with identifier: RE49156 to the API
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:04:08Z',
'fuel_type': 'diesel',
'id': '5e7a9f7a-1779-516a-ae90-94939914aa57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE49156',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 55677,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-30',
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi 280 L1 Trend',
'transmission': 'automatic',
'trim': '280 L1 Trend',
'year': 2023}
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE49156%27 HTTP/1.1" 200 None
2026-03-28 12:03:51 [auto1.it] INFO: Saving data for RE49156: {'auction_closing_time': 1774713848.0, 'created_time': 1774094492.396142, 'last_price_update_time': 1774699431.364479}
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RE49156') HTTP/1.1" 204 0
2026-03-28 12:03:51 [auto1.it] INFO: Found listing with ID: CJ22760
2026-03-28 12:03:51 [auto1.it] INFO: Found listing with ID: FW39632
2026-03-28 12:03:51 [auto1.it] INFO: Found listing with ID: JA96150
2026-03-28 12:03:51 [auto1.it] INFO: Found listing with ID: EG94847
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG94847%27 HTTP/1.1" 200 None
2026-03-28 12:03:51 [auto1.it] INFO: Scrape type for EG94847: 0
2026-03-28 12:03:51 [auto1.it] INFO: Found listing with ID: SN82896
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN82896%27 HTTP/1.1" 200 None
2026-03-28 12:03:51 [auto1.it] INFO: Scrape type for SN82896: 0
2026-03-28 12:03:51 [auto1.it] INFO: Found listing with ID: DC70843
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC70843%27 HTTP/1.1" 200 None
2026-03-28 12:03:51 [auto1.it] INFO: Scrape type for DC70843: 2
2026-03-28 12:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fd57ad0-340c-5d0b-b5ea-c0bcdb05805d with identifier: DC70843
2026-03-28 12:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fd57ad0-340c-5d0b-b5ea-c0bcdb05805d with scrape type 2
2026-03-28 12:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fd57ad0-340c-5d0b-b5ea-c0bcdb05805d with scrape type 2
2026-03-28 12:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5fd57ad0-340c-5d0b-b5ea-c0bcdb05805d, identifier: DC70843
2026-03-28 12:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5fd57ad0-340c-5d0b-b5ea-c0bcdb05805d with identifier: DC70843
2026-03-28 12:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5fd57ad0-340c-5d0b-b5ea-c0bcdb05805d with identifier: DC70843
2026-03-28 12:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5fd57ad0-340c-5d0b-b5ea-c0bcdb05805d with identifier: DC70843 to the API
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:36:42Z',
'fuel_type': 'diesel',
'id': '5fd57ad0-340c-5d0b-b5ea-c0bcdb05805d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC70843',
'listing': 'auction',
'make': 'Volvo',
'model': 'V60',
'odometer': 296420,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-29',
'seller_name': None,
'title': 'Volvo V60 1.6 D Kinetic',
'transmission': 'manual',
'trim': 'Kinetic',
'year': 2012}
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC70843%27 HTTP/1.1" 200 None
2026-03-28 12:03:51 [auto1.it] INFO: Saving data for DC70843: {'auction_closing_time': 1774715802.0, 'created_time': 1774515670.948823, 'last_price_update_time': 1774699431.826994}
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DC70843') HTTP/1.1" 204 0
2026-03-28 12:03:51 [auto1.it] INFO: Found listing with ID: VL00110
2026-03-28 12:03:51 [auto1.it] INFO: Found listing with ID: ZT47825
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT47825%27 HTTP/1.1" 200 None
2026-03-28 12:03:51 [auto1.it] INFO: Scrape type for ZT47825: 0
2026-03-28 12:03:51 [auto1.it] INFO: Found listing with ID: PZ52639
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ52639%27 HTTP/1.1" 200 None
2026-03-28 12:03:52 [auto1.it] INFO: Scrape type for PZ52639: 0
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: HS75428
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS75428%27 HTTP/1.1" 200 None
2026-03-28 12:03:52 [auto1.it] INFO: Scrape type for HS75428: 0
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: MZ40359
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ40359%27 HTTP/1.1" 200 None
2026-03-28 12:03:52 [auto1.it] INFO: Scrape type for MZ40359: 0
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: ZM41579
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: SA83411
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA83411%27 HTTP/1.1" 200 None
2026-03-28 12:03:52 [auto1.it] INFO: Scrape type for SA83411: 2
2026-03-28 12:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a6a37a6-5870-53ef-b237-6d569ae9e35e with identifier: SA83411
2026-03-28 12:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a6a37a6-5870-53ef-b237-6d569ae9e35e with scrape type 2
2026-03-28 12:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a6a37a6-5870-53ef-b237-6d569ae9e35e with scrape type 2
2026-03-28 12:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5a6a37a6-5870-53ef-b237-6d569ae9e35e, identifier: SA83411
2026-03-28 12:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5a6a37a6-5870-53ef-b237-6d569ae9e35e with identifier: SA83411
2026-03-28 12:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5a6a37a6-5870-53ef-b237-6d569ae9e35e with identifier: SA83411
2026-03-28 12:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5a6a37a6-5870-53ef-b237-6d569ae9e35e with identifier: SA83411 to the API
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:54:42Z',
'fuel_type': 'diesel',
'id': '5a6a37a6-5870-53ef-b237-6d569ae9e35e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA83411',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC40',
'odometer': 156629,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-21',
'seller_name': None,
'title': 'Volvo XC40 2.0 D3 R-Design AWD',
'transmission': 'automatic',
'trim': 'R-Design AWD',
'year': 2019}
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA83411%27 HTTP/1.1" 200 None
2026-03-28 12:03:52 [auto1.it] INFO: Saving data for SA83411: {'auction_closing_time': 1774716882.0, 'created_time': 1773500995.288333, 'last_price_update_time': 1774699432.546784}
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SA83411') HTTP/1.1" 204 0
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: PT34479
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT34479%27 HTTP/1.1" 200 None
2026-03-28 12:03:52 [auto1.it] INFO: Scrape type for PT34479: 0
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: SE61764
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: GT94067
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT94067%27 HTTP/1.1" 200 None
2026-03-28 12:03:52 [auto1.it] INFO: Scrape type for GT94067: 0
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: YR30940
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: AK38143
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: JW87652
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: MP39083
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: WA88594
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA88594%27 HTTP/1.1" 200 None
2026-03-28 12:03:52 [auto1.it] INFO: Scrape type for WA88594: 0
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: AB27161
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: NN45257
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN45257%27 HTTP/1.1" 200 None
2026-03-28 12:03:52 [auto1.it] INFO: Scrape type for NN45257: 0
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: JV66530
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV66530%27 HTTP/1.1" 200 None
2026-03-28 12:03:52 [auto1.it] INFO: Scrape type for JV66530: 0
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: JV92399
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: FP63529
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP63529%27 HTTP/1.1" 200 None
2026-03-28 12:03:52 [auto1.it] INFO: Scrape type for FP63529: 0
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: GD26025
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: DG54117
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG54117%27 HTTP/1.1" 200 None
2026-03-28 12:03:52 [auto1.it] INFO: Scrape type for DG54117: 0
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: LC35627
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC35627%27 HTTP/1.1" 200 None
2026-03-28 12:03:52 [auto1.it] INFO: Scrape type for LC35627: 0
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: GE96866
2026-03-28 12:03:52 [auto1.it] INFO: Found listing with ID: YT54925
2026-03-28 12:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:53 [auto1.it] INFO: Channel: 24h | Page: 47 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:53 [auto1.it] INFO: Found listing with ID: RN34673
2026-03-28 12:03:53 [auto1.it] INFO: Found listing with ID: MR41650
2026-03-28 12:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR41650%27 HTTP/1.1" 200 None
2026-03-28 12:03:53 [auto1.it] INFO: Scrape type for MR41650: 0
2026-03-28 12:03:53 [auto1.it] INFO: Found listing with ID: VF40015
2026-03-28 12:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF40015%27 HTTP/1.1" 200 None
2026-03-28 12:03:53 [auto1.it] INFO: Scrape type for VF40015: 0
2026-03-28 12:03:53 [auto1.it] INFO: Found listing with ID: WB49525
2026-03-28 12:03:53 [auto1.it] INFO: Found listing with ID: CG39914
2026-03-28 12:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG39914%27 HTTP/1.1" 200 None
2026-03-28 12:03:53 [auto1.it] INFO: Scrape type for CG39914: 0
2026-03-28 12:03:53 [auto1.it] INFO: Found listing with ID: KD78044
2026-03-28 12:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD78044%27 HTTP/1.1" 200 None
2026-03-28 12:03:53 [auto1.it] INFO: Scrape type for KD78044: 0
2026-03-28 12:03:53 [auto1.it] INFO: Found listing with ID: PH76883
2026-03-28 12:03:53 [auto1.it] INFO: Found listing with ID: PL46674
2026-03-28 12:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL46674%27 HTTP/1.1" 200 None
2026-03-28 12:03:53 [auto1.it] INFO: Scrape type for PL46674: 0
2026-03-28 12:03:53 [auto1.it] INFO: Found listing with ID: SJ27084
2026-03-28 12:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ27084%27 HTTP/1.1" 200 None
2026-03-28 12:03:53 [auto1.it] INFO: Scrape type for SJ27084: 0
2026-03-28 12:03:53 [auto1.it] INFO: Found listing with ID: XT06455
2026-03-28 12:03:53 [auto1.it] INFO: Found listing with ID: YR22180
2026-03-28 12:03:53 [auto1.it] INFO: Found listing with ID: DU27082
2026-03-28 12:03:53 [auto1.it] INFO: Found listing with ID: AH76679
2026-03-28 12:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH76679%27 HTTP/1.1" 200 None
2026-03-28 12:03:53 [auto1.it] INFO: Scrape type for AH76679: 2
2026-03-28 12:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adf4137e-b8ba-54ef-b816-e6cf4ef4404b with identifier: AH76679
2026-03-28 12:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adf4137e-b8ba-54ef-b816-e6cf4ef4404b with scrape type 2
2026-03-28 12:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adf4137e-b8ba-54ef-b816-e6cf4ef4404b with scrape type 2
2026-03-28 12:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: adf4137e-b8ba-54ef-b816-e6cf4ef4404b, identifier: AH76679
2026-03-28 12:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: adf4137e-b8ba-54ef-b816-e6cf4ef4404b with identifier: AH76679
2026-03-28 12:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: adf4137e-b8ba-54ef-b816-e6cf4ef4404b with identifier: AH76679
2026-03-28 12:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: adf4137e-b8ba-54ef-b816-e6cf4ef4404b with identifier: AH76679 to the API
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:45:40Z',
'fuel_type': 'diesel',
'id': 'adf4137e-b8ba-54ef-b816-e6cf4ef4404b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH76679',
'listing': 'auction',
'make': 'BMW',
'model': '4er',
'odometer': 249004,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-28',
'seller_name': None,
'title': 'BMW 4er 420d Gran Coupé Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2015}
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH76679%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Saving data for AH76679: {'auction_closing_time': 1774716340.0, 'created_time': 1774515755.163204, 'last_price_update_time': 1774699434.392921}
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AH76679') HTTP/1.1" 204 0
2026-03-28 12:03:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: ZS91075
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS91075%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Scrape type for ZS91075: 0
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: GJ69248
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: RH51266
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH51266%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Scrape type for RH51266: 0
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: HH67812
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH67812%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Scrape type for HH67812: 0
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: FF98619
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF98619%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Scrape type for FF98619: 0
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: PD61246
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD61246%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Scrape type for PD61246: 0
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: AN46141
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN46141%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Scrape type for AN46141: 0
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: VY12867
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY12867%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Scrape type for VY12867: 0
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: NP19925
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP19925%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Scrape type for NP19925: 0
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: GP32849
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GP32849%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Scrape type for GP32849: 0
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: RG23044
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: PE03343
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE03343%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Scrape type for PE03343: 0
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: NC40954
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC40954%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Scrape type for NC40954: 0
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: JS86571
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: SW25122
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: ZH41426
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH41426%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Scrape type for ZH41426: 0
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: EL59293
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: WR52243
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR52243%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Scrape type for WR52243: 0
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: RX05887
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: NF99780
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF99780%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Scrape type for NF99780: 0
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: UY31632
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: DV60834
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: FN63794
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: ZC00549
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC00549%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Scrape type for ZC00549: 0
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: TB04620
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB04620%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Scrape type for TB04620: 0
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: NJ73400
2026-03-28 12:03:54 [auto1.it] INFO: Found listing with ID: TH32608
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH32608%27 HTTP/1.1" 200 None
2026-03-28 12:03:54 [auto1.it] INFO: Scrape type for TH32608: 0
2026-03-28 12:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:55 [auto1.it] INFO: Channel: 24h | Page: 48 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:55 [auto1.it] INFO: Found listing with ID: ZB01532
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB01532%27 HTTP/1.1" 200 None
2026-03-28 12:03:55 [auto1.it] INFO: Scrape type for ZB01532: 0
2026-03-28 12:03:55 [auto1.it] INFO: Found listing with ID: LY23963
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY23963%27 HTTP/1.1" 200 None
2026-03-28 12:03:55 [auto1.it] INFO: Scrape type for LY23963: 0
2026-03-28 12:03:55 [auto1.it] INFO: Found listing with ID: AG78775
2026-03-28 12:03:55 [auto1.it] INFO: Found listing with ID: SY65620
2026-03-28 12:03:55 [auto1.it] INFO: Found listing with ID: WK43890
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK43890%27 HTTP/1.1" 200 None
2026-03-28 12:03:55 [auto1.it] INFO: Scrape type for WK43890: 0
2026-03-28 12:03:55 [auto1.it] INFO: Found listing with ID: WL49427
2026-03-28 12:03:55 [auto1.it] INFO: Found listing with ID: ZN97405
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN97405%27 HTTP/1.1" 200 None
2026-03-28 12:03:55 [auto1.it] INFO: Scrape type for ZN97405: 0
2026-03-28 12:03:55 [auto1.it] INFO: Found listing with ID: ET23172
2026-03-28 12:03:55 [auto1.it] INFO: Found listing with ID: PM46324
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM46324%27 HTTP/1.1" 200 None
2026-03-28 12:03:55 [auto1.it] INFO: Scrape type for PM46324: 0
2026-03-28 12:03:55 [auto1.it] INFO: Found listing with ID: VG33831
2026-03-28 12:03:55 [auto1.it] INFO: Found listing with ID: MX95744
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX95744%27 HTTP/1.1" 200 None
2026-03-28 12:03:55 [auto1.it] INFO: Scrape type for MX95744: 0
2026-03-28 12:03:55 [auto1.it] INFO: Found listing with ID: NA15959
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA15959%27 HTTP/1.1" 200 None
2026-03-28 12:03:55 [auto1.it] INFO: Scrape type for NA15959: 0
2026-03-28 12:03:55 [auto1.it] INFO: Found listing with ID: UZ16276
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ16276%27 HTTP/1.1" 200 None
2026-03-28 12:03:55 [auto1.it] INFO: Scrape type for UZ16276: 0
2026-03-28 12:03:55 [auto1.it] INFO: Found listing with ID: PX43587
2026-03-28 12:03:55 [auto1.it] INFO: Found listing with ID: AL00602
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL00602%27 HTTP/1.1" 200 None
2026-03-28 12:03:55 [auto1.it] INFO: Scrape type for AL00602: 0
2026-03-28 12:03:55 [auto1.it] INFO: Found listing with ID: UY92824
2026-03-28 12:03:55 [auto1.it] INFO: Found listing with ID: WK45429
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK45429%27 HTTP/1.1" 200 None
2026-03-28 12:03:56 [auto1.it] INFO: Scrape type for WK45429: 0
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: VV53069
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV53069%27 HTTP/1.1" 200 None
2026-03-28 12:03:56 [auto1.it] INFO: Scrape type for VV53069: 0
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: PR60258
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR60258%27 HTTP/1.1" 200 None
2026-03-28 12:03:56 [auto1.it] INFO: Scrape type for PR60258: 0
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: SM48224
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: CR59099
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: GL14484
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: WX74031
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX74031%27 HTTP/1.1" 200 None
2026-03-28 12:03:56 [auto1.it] INFO: Scrape type for WX74031: 0
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: EU31713
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU31713%27 HTTP/1.1" 200 None
2026-03-28 12:03:56 [auto1.it] INFO: Scrape type for EU31713: 0
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: PC08204
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC08204%27 HTTP/1.1" 200 None
2026-03-28 12:03:56 [auto1.it] INFO: Scrape type for PC08204: 0
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: ZR26877
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR26877%27 HTTP/1.1" 200 None
2026-03-28 12:03:56 [auto1.it] INFO: Scrape type for ZR26877: 2
2026-03-28 12:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 048ef1f9-421c-5e3a-9c59-57e52b315eb5 with identifier: ZR26877
2026-03-28 12:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 048ef1f9-421c-5e3a-9c59-57e52b315eb5 with scrape type 2
2026-03-28 12:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 048ef1f9-421c-5e3a-9c59-57e52b315eb5 with scrape type 2
2026-03-28 12:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 048ef1f9-421c-5e3a-9c59-57e52b315eb5, identifier: ZR26877
2026-03-28 12:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 048ef1f9-421c-5e3a-9c59-57e52b315eb5 with identifier: ZR26877
2026-03-28 12:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 048ef1f9-421c-5e3a-9c59-57e52b315eb5 with identifier: ZR26877
2026-03-28 12:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 048ef1f9-421c-5e3a-9c59-57e52b315eb5 with identifier: ZR26877 to the API
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:46:36Z',
'fuel_type': 'diesel',
'id': '048ef1f9-421c-5e3a-9c59-57e52b315eb5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR26877',
'listing': 'auction',
'make': 'Citroen',
'model': 'DS4',
'odometer': 220067,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-25',
'seller_name': None,
'title': 'Citroen DS4 1.6 e-HDi SoChic',
'transmission': 'automatic',
'trim': 'SoChic',
'year': 2013}
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR26877%27 HTTP/1.1" 200 None
2026-03-28 12:03:56 [auto1.it] INFO: Saving data for ZR26877: {'auction_closing_time': 1774716396.0, 'created_time': 1774515713.743978, 'last_price_update_time': 1774699436.557902}
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZR26877') HTTP/1.1" 204 0
2026-03-28 12:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: TE47770
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: YG22381
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG22381%27 HTTP/1.1" 200 None
2026-03-28 12:03:56 [auto1.it] INFO: Scrape type for YG22381: 0
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: DD82932
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: DM50235
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: MB79295
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: CV31826
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: FN50437
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN50437%27 HTTP/1.1" 200 None
2026-03-28 12:03:56 [auto1.it] INFO: Scrape type for FN50437: 0
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: TT40811
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT40811%27 HTTP/1.1" 200 None
2026-03-28 12:03:56 [auto1.it] INFO: Scrape type for TT40811: 0
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: FJ28833
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: SE98453
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE98453%27 HTTP/1.1" 200 None
2026-03-28 12:03:56 [auto1.it] INFO: Scrape type for SE98453: 0
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: FL86177
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL86177%27 HTTP/1.1" 200 None
2026-03-28 12:03:56 [auto1.it] INFO: Scrape type for FL86177: 0
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: MY86461
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY86461%27 HTTP/1.1" 200 None
2026-03-28 12:03:56 [auto1.it] INFO: Scrape type for MY86461: 0
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: LK58538
2026-03-28 12:03:56 [auto1.it] INFO: Found listing with ID: FW75708
2026-03-28 12:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:57 [auto1.it] INFO: Channel: 24h | Page: 49 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:57 [auto1.it] INFO: Found listing with ID: GD10861
2026-03-28 12:03:57 [auto1.it] INFO: Found listing with ID: AK03087
2026-03-28 12:03:57 [auto1.it] INFO: Found listing with ID: YR57836
2026-03-28 12:03:57 [auto1.it] INFO: Found listing with ID: PG69146
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG69146%27 HTTP/1.1" 200 None
2026-03-28 12:03:57 [auto1.it] INFO: Scrape type for PG69146: 0
2026-03-28 12:03:57 [auto1.it] INFO: Found listing with ID: VY17663
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY17663%27 HTTP/1.1" 200 None
2026-03-28 12:03:57 [auto1.it] INFO: Scrape type for VY17663: 0
2026-03-28 12:03:57 [auto1.it] INFO: Found listing with ID: PW49149
2026-03-28 12:03:57 [auto1.it] INFO: Found listing with ID: SN43721
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN43721%27 HTTP/1.1" 200 None
2026-03-28 12:03:57 [auto1.it] INFO: Scrape type for SN43721: 0
2026-03-28 12:03:57 [auto1.it] INFO: Found listing with ID: DB80555
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB80555%27 HTTP/1.1" 200 None
2026-03-28 12:03:57 [auto1.it] INFO: Scrape type for DB80555: 0
2026-03-28 12:03:57 [auto1.it] INFO: Found listing with ID: KL59990
2026-03-28 12:03:57 [auto1.it] INFO: Found listing with ID: YG69242
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG69242%27 HTTP/1.1" 200 None
2026-03-28 12:03:57 [auto1.it] INFO: Scrape type for YG69242: 0
2026-03-28 12:03:57 [auto1.it] INFO: Found listing with ID: UU42512
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU42512%27 HTTP/1.1" 200 None
2026-03-28 12:03:57 [auto1.it] INFO: Scrape type for UU42512: 0
2026-03-28 12:03:57 [auto1.it] INFO: Found listing with ID: ZY88816
2026-03-28 12:03:57 [auto1.it] INFO: Found listing with ID: KY93059
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY93059%27 HTTP/1.1" 200 None
2026-03-28 12:03:57 [auto1.it] INFO: Scrape type for KY93059: 0
2026-03-28 12:03:57 [auto1.it] INFO: Found listing with ID: MS58907
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS58907%27 HTTP/1.1" 200 None
2026-03-28 12:03:57 [auto1.it] INFO: Scrape type for MS58907: 0
2026-03-28 12:03:57 [auto1.it] INFO: Found listing with ID: BP59545
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP59545%27 HTTP/1.1" 200 None
2026-03-28 12:03:57 [auto1.it] INFO: Scrape type for BP59545: 0
2026-03-28 12:03:57 [auto1.it] INFO: Found listing with ID: HR68731
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR68731%27 HTTP/1.1" 200 None
2026-03-28 12:03:57 [auto1.it] INFO: Scrape type for HR68731: 2
2026-03-28 12:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8eab2df-70a4-58ae-9eac-df5d2d62f86a with identifier: HR68731
2026-03-28 12:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8eab2df-70a4-58ae-9eac-df5d2d62f86a with scrape type 2
2026-03-28 12:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8eab2df-70a4-58ae-9eac-df5d2d62f86a with scrape type 2
2026-03-28 12:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d8eab2df-70a4-58ae-9eac-df5d2d62f86a, identifier: HR68731
2026-03-28 12:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d8eab2df-70a4-58ae-9eac-df5d2d62f86a with identifier: HR68731
2026-03-28 12:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d8eab2df-70a4-58ae-9eac-df5d2d62f86a with identifier: HR68731
2026-03-28 12:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d8eab2df-70a4-58ae-9eac-df5d2d62f86a with identifier: HR68731 to the API
2026-03-28 12:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:06:35Z',
'fuel_type': 'diesel',
'id': 'd8eab2df-70a4-58ae-9eac-df5d2d62f86a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR68731',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 214303,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-05',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2013}
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR68731%27 HTTP/1.1" 200 None
2026-03-28 12:03:58 [auto1.it] INFO: Saving data for HR68731: {'auction_closing_time': 1774713995.0, 'created_time': 1774515710.008842, 'last_price_update_time': 1774699438.171487}
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HR68731') HTTP/1.1" 204 0
2026-03-28 12:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: ZL23627
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: GZ48200
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: ZK34576
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK34576%27 HTTP/1.1" 200 None
2026-03-28 12:03:58 [auto1.it] INFO: Scrape type for ZK34576: 0
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: TA76256
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: BA18808
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA18808%27 HTTP/1.1" 200 None
2026-03-28 12:03:58 [auto1.it] INFO: Scrape type for BA18808: 0
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: HX42058
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: CM62235
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: AL31593
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: FZ80781
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: EZ33304
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ33304%27 HTTP/1.1" 200 None
2026-03-28 12:03:58 [auto1.it] INFO: Scrape type for EZ33304: 0
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: BG88110
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: NH73732
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: WT52400
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT52400%27 HTTP/1.1" 200 None
2026-03-28 12:03:58 [auto1.it] INFO: Scrape type for WT52400: 0
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: PP13796
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: PE82748
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE82748%27 HTTP/1.1" 200 None
2026-03-28 12:03:58 [auto1.it] INFO: Scrape type for PE82748: 0
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: RD42515
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: RB40748
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB40748%27 HTTP/1.1" 200 None
2026-03-28 12:03:58 [auto1.it] INFO: Scrape type for RB40748: 0
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: WK11111
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: NR02013
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: DP25317
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP25317%27 HTTP/1.1" 200 None
2026-03-28 12:03:58 [auto1.it] INFO: Scrape type for DP25317: 0
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: RB41794
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB41794%27 HTTP/1.1" 200 None
2026-03-28 12:03:58 [auto1.it] INFO: Scrape type for RB41794: 0
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: PV17909
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: FR96632
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR96632%27 HTTP/1.1" 200 None
2026-03-28 12:03:58 [auto1.it] INFO: Scrape type for FR96632: 0
2026-03-28 12:03:58 [auto1.it] INFO: Found listing with ID: ZK68739
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK68739%27 HTTP/1.1" 200 None
2026-03-28 12:03:58 [auto1.it] INFO: Scrape type for ZK68739: 2
2026-03-28 12:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cf796f4-0783-594a-85ac-27b65f2448a9 with identifier: ZK68739
2026-03-28 12:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cf796f4-0783-594a-85ac-27b65f2448a9 with scrape type 2
2026-03-28 12:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cf796f4-0783-594a-85ac-27b65f2448a9 with scrape type 2
2026-03-28 12:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1cf796f4-0783-594a-85ac-27b65f2448a9, identifier: ZK68739
2026-03-28 12:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1cf796f4-0783-594a-85ac-27b65f2448a9 with identifier: ZK68739
2026-03-28 12:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1cf796f4-0783-594a-85ac-27b65f2448a9 with identifier: ZK68739
2026-03-28 12:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1cf796f4-0783-594a-85ac-27b65f2448a9 with identifier: ZK68739 to the API
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 88,
'expiration_date': '2026-03-28T16:53:23Z',
'fuel_type': 'diesel',
'id': '1cf796f4-0783-594a-85ac-27b65f2448a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK68739',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 217424,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-28',
'seller_name': None,
'title': 'Dacia Sandero 1.5 dCi Stepway',
'transmission': 'manual',
'trim': 'Stepway',
'year': 2012}
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK68739%27 HTTP/1.1" 200 None
2026-03-28 12:03:58 [auto1.it] INFO: Saving data for ZK68739: {'auction_closing_time': 1774716803.0, 'created_time': 1774515710.682, 'last_price_update_time': 1774699438.929013}
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZK68739') HTTP/1.1" 204 0
2026-03-28 12:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:03:59 [auto1.it] INFO: Channel: 24h | Page: 50 | totalHits: 3673 | hits on page: 40
2026-03-28 12:03:59 [auto1.it] INFO: Found listing with ID: JV47316
2026-03-28 12:03:59 [auto1.it] INFO: Found listing with ID: VU35787
2026-03-28 12:03:59 [auto1.it] INFO: Found listing with ID: CZ70189
2026-03-28 12:03:59 [auto1.it] INFO: Found listing with ID: MD89845
2026-03-28 12:03:59 [auto1.it] INFO: Found listing with ID: JY72806
2026-03-28 12:03:59 [auto1.it] INFO: Found listing with ID: WS96553
2026-03-28 12:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS96553%27 HTTP/1.1" 200 None
2026-03-28 12:03:59 [auto1.it] INFO: Scrape type for WS96553: 0
2026-03-28 12:03:59 [auto1.it] INFO: Found listing with ID: FE23339
2026-03-28 12:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE23339%27 HTTP/1.1" 200 None
2026-03-28 12:03:59 [auto1.it] INFO: Scrape type for FE23339: 0
2026-03-28 12:03:59 [auto1.it] INFO: Found listing with ID: PC30910
2026-03-28 12:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC30910%27 HTTP/1.1" 200 None
2026-03-28 12:04:00 [auto1.it] INFO: Scrape type for PC30910: 0
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: EG37801
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG37801%27 HTTP/1.1" 200 None
2026-03-28 12:04:00 [auto1.it] INFO: Scrape type for EG37801: 0
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: CS73145
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: MB91559
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: JE32624
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: SX13991
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX13991%27 HTTP/1.1" 200 None
2026-03-28 12:04:00 [auto1.it] INFO: Scrape type for SX13991: 0
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: JD24635
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: NK12319
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK12319%27 HTTP/1.1" 200 None
2026-03-28 12:04:00 [auto1.it] INFO: Scrape type for NK12319: 0
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: EV42289
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV42289%27 HTTP/1.1" 200 None
2026-03-28 12:04:00 [auto1.it] INFO: Scrape type for EV42289: 0
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: FH21751
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: LL47627
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL47627%27 HTTP/1.1" 200 None
2026-03-28 12:04:00 [auto1.it] INFO: Scrape type for LL47627: 0
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: AK61800
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: FU99331
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: ZJ09783
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: GF05972
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: KU92785
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: FD98463
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: UM22430
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM22430%27 HTTP/1.1" 200 None
2026-03-28 12:04:00 [auto1.it] INFO: Scrape type for UM22430: 0
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: DT48563
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT48563%27 HTTP/1.1" 200 None
2026-03-28 12:04:00 [auto1.it] INFO: Scrape type for DT48563: 0
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: LN31957
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN31957%27 HTTP/1.1" 200 None
2026-03-28 12:04:00 [auto1.it] INFO: Scrape type for LN31957: 0
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: XD93142
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: XJ13084
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: WX11793
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: ST52943
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: JF99545
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: SV47237
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: JS59612
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS59612%27 HTTP/1.1" 200 None
2026-03-28 12:04:00 [auto1.it] INFO: Scrape type for JS59612: 0
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: JC86695
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC86695%27 HTTP/1.1" 200 None
2026-03-28 12:04:00 [auto1.it] INFO: Scrape type for JC86695: 0
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: HU75847
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU75847%27 HTTP/1.1" 200 None
2026-03-28 12:04:00 [auto1.it] INFO: Scrape type for HU75847: 0
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: SS52204
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: NF28136
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF28136%27 HTTP/1.1" 200 None
2026-03-28 12:04:00 [auto1.it] INFO: Scrape type for NF28136: 0
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: AX14141
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX14141%27 HTTP/1.1" 200 None
2026-03-28 12:04:00 [auto1.it] INFO: Scrape type for AX14141: 0
2026-03-28 12:04:00 [auto1.it] INFO: Found listing with ID: AM53032
2026-03-28 12:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:04:01 [auto1.it] INFO: Channel: 24h | Page: 51 | totalHits: 3673 | hits on page: 40
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: MY48140
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: MK51639
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: TP30919
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: AA66716
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: PZ55071
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: HX67406
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: LT18779
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: KZ33139
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: EC20535
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC20535%27 HTTP/1.1" 200 None
2026-03-28 12:04:01 [auto1.it] INFO: Scrape type for EC20535: 0
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: PG53512
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: ZB38211
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB38211%27 HTTP/1.1" 200 None
2026-03-28 12:04:01 [auto1.it] INFO: Scrape type for ZB38211: 0
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: GX99306
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX99306%27 HTTP/1.1" 200 None
2026-03-28 12:04:01 [auto1.it] INFO: Scrape type for GX99306: 0
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: DX18897
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: DA44533
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: YW84907
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: TZ66413
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: HE47711
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: WD11743
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: AE90071
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: YJ19643
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ19643%27 HTTP/1.1" 200 None
2026-03-28 12:04:01 [auto1.it] INFO: Scrape type for YJ19643: 0
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: TH56934
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: AH91466
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH91466%27 HTTP/1.1" 200 None
2026-03-28 12:04:01 [auto1.it] INFO: Scrape type for AH91466: 0
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: NE50995
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE50995%27 HTTP/1.1" 200 None
2026-03-28 12:04:01 [auto1.it] INFO: Scrape type for NE50995: 0
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: AU71506
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: NX21307
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX21307%27 HTTP/1.1" 200 None
2026-03-28 12:04:01 [auto1.it] INFO: Scrape type for NX21307: 0
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: KW35256
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: DL15591
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL15591%27 HTTP/1.1" 200 None
2026-03-28 12:04:01 [auto1.it] INFO: Scrape type for DL15591: 0
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: SF57726
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF57726%27 HTTP/1.1" 200 None
2026-03-28 12:04:01 [auto1.it] INFO: Scrape type for SF57726: 0
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: MU47199
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU47199%27 HTTP/1.1" 200 None
2026-03-28 12:04:01 [auto1.it] INFO: Scrape type for MU47199: 0
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: YZ06179
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: TU42208
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: KJ92535
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ92535%27 HTTP/1.1" 200 None
2026-03-28 12:04:01 [auto1.it] INFO: Scrape type for KJ92535: 0
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: KV45254
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: FU36287
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU36287%27 HTTP/1.1" 200 None
2026-03-28 12:04:01 [auto1.it] INFO: Scrape type for FU36287: 0
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: WL38186
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: HW99269
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: WS00889
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: RK73921
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: HC70741
2026-03-28 12:04:01 [auto1.it] INFO: Found listing with ID: YY30219
2026-03-28 12:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:04:02 [auto1.it] INFO: Channel: 24h | Page: 52 | totalHits: 3673 | hits on page: 40
2026-03-28 12:04:02 [auto1.it] INFO: Found listing with ID: TD76554
2026-03-28 12:04:02 [auto1.it] INFO: Found listing with ID: VM87489
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM87489%27 HTTP/1.1" 200 None
2026-03-28 12:04:02 [auto1.it] INFO: Scrape type for VM87489: 0
2026-03-28 12:04:02 [auto1.it] INFO: Found listing with ID: AC54661
2026-03-28 12:04:02 [auto1.it] INFO: Found listing with ID: PP18921
2026-03-28 12:04:02 [auto1.it] INFO: Found listing with ID: PV19108
2026-03-28 12:04:02 [auto1.it] INFO: Found listing with ID: FF63562
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF63562%27 HTTP/1.1" 200 None
2026-03-28 12:04:02 [auto1.it] INFO: Scrape type for FF63562: 0
2026-03-28 12:04:02 [auto1.it] INFO: Found listing with ID: AV53481
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV53481%27 HTTP/1.1" 200 None
2026-03-28 12:04:02 [auto1.it] INFO: Scrape type for AV53481: 0
2026-03-28 12:04:02 [auto1.it] INFO: Found listing with ID: CB62098
2026-03-28 12:04:02 [auto1.it] INFO: Found listing with ID: KS79524
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS79524%27 HTTP/1.1" 200 None
2026-03-28 12:04:02 [auto1.it] INFO: Scrape type for KS79524: 0
2026-03-28 12:04:02 [auto1.it] INFO: Found listing with ID: HM03162
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM03162%27 HTTP/1.1" 200 None
2026-03-28 12:04:02 [auto1.it] INFO: Scrape type for HM03162: 0
2026-03-28 12:04:02 [auto1.it] INFO: Found listing with ID: FT78551
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT78551%27 HTTP/1.1" 200 None
2026-03-28 12:04:02 [auto1.it] INFO: Scrape type for FT78551: 0
2026-03-28 12:04:02 [auto1.it] INFO: Found listing with ID: SD84714
2026-03-28 12:04:02 [auto1.it] INFO: Found listing with ID: KE13415
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE13415%27 HTTP/1.1" 200 None
2026-03-28 12:04:02 [auto1.it] INFO: Scrape type for KE13415: 0
2026-03-28 12:04:02 [auto1.it] INFO: Found listing with ID: TZ72536
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ72536%27 HTTP/1.1" 200 None
2026-03-28 12:04:02 [auto1.it] INFO: Scrape type for TZ72536: 0
2026-03-28 12:04:02 [auto1.it] INFO: Found listing with ID: SV52525
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV52525%27 HTTP/1.1" 200 None
2026-03-28 12:04:02 [auto1.it] INFO: Scrape type for SV52525: 2
2026-03-28 12:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02b13429-f916-5615-b266-fa27796b196b with identifier: SV52525
2026-03-28 12:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02b13429-f916-5615-b266-fa27796b196b with scrape type 2
2026-03-28 12:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02b13429-f916-5615-b266-fa27796b196b with scrape type 2
2026-03-28 12:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 02b13429-f916-5615-b266-fa27796b196b, identifier: SV52525
2026-03-28 12:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 02b13429-f916-5615-b266-fa27796b196b with identifier: SV52525
2026-03-28 12:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 02b13429-f916-5615-b266-fa27796b196b with identifier: SV52525
2026-03-28 12:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 02b13429-f916-5615-b266-fa27796b196b with identifier: SV52525 to the API
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:49:18Z',
'fuel_type': 'diesel',
'id': '02b13429-f916-5615-b266-fa27796b196b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV52525',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 366092,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-11',
'seller_name': None,
'title': 'Seat Leon 1.6 TDI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2014}
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV52525%27 HTTP/1.1" 200 None
2026-03-28 12:04:03 [auto1.it] INFO: Saving data for SV52525: {'auction_closing_time': 1774716558.0, 'created_time': 1774515656.956556, 'last_price_update_time': 1774699443.382187}
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SV52525') HTTP/1.1" 204 0
2026-03-28 12:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:04:03 [auto1.it] INFO: Found listing with ID: UH63202
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH63202%27 HTTP/1.1" 200 None
2026-03-28 12:04:03 [auto1.it] INFO: Scrape type for UH63202: 0
2026-03-28 12:04:03 [auto1.it] INFO: Found listing with ID: YA96146
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA96146%27 HTTP/1.1" 200 None
2026-03-28 12:04:03 [auto1.it] INFO: Scrape type for YA96146: 0
2026-03-28 12:04:03 [auto1.it] INFO: Found listing with ID: SH06277
2026-03-28 12:04:03 [auto1.it] INFO: Found listing with ID: UR19142
2026-03-28 12:04:03 [auto1.it] INFO: Found listing with ID: XJ75320
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ75320%27 HTTP/1.1" 200 None
2026-03-28 12:04:03 [auto1.it] INFO: Scrape type for XJ75320: 0
2026-03-28 12:04:03 [auto1.it] INFO: Found listing with ID: WK82863
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK82863%27 HTTP/1.1" 200 None
2026-03-28 12:04:03 [auto1.it] INFO: Scrape type for WK82863: 0
2026-03-28 12:04:03 [auto1.it] INFO: Found listing with ID: JU95085
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU95085%27 HTTP/1.1" 200 None
2026-03-28 12:04:03 [auto1.it] INFO: Scrape type for JU95085: 0
2026-03-28 12:04:03 [auto1.it] INFO: Found listing with ID: NJ20872
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ20872%27 HTTP/1.1" 200 None
2026-03-28 12:04:03 [auto1.it] INFO: Scrape type for NJ20872: 0
2026-03-28 12:04:03 [auto1.it] INFO: Found listing with ID: VE89845
2026-03-28 12:04:03 [auto1.it] INFO: Found listing with ID: RJ89863
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ89863%27 HTTP/1.1" 200 None
2026-03-28 12:04:03 [auto1.it] INFO: Scrape type for RJ89863: 0
2026-03-28 12:04:03 [auto1.it] INFO: Found listing with ID: VN35608
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN35608%27 HTTP/1.1" 200 None
2026-03-28 12:04:03 [auto1.it] INFO: Scrape type for VN35608: 2
2026-03-28 12:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 262cbd88-90d5-5884-9953-b430e803fb4a with identifier: VN35608
2026-03-28 12:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 262cbd88-90d5-5884-9953-b430e803fb4a with scrape type 2
2026-03-28 12:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 262cbd88-90d5-5884-9953-b430e803fb4a with scrape type 2
2026-03-28 12:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 262cbd88-90d5-5884-9953-b430e803fb4a, identifier: VN35608
2026-03-28 12:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 262cbd88-90d5-5884-9953-b430e803fb4a with identifier: VN35608
2026-03-28 12:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 262cbd88-90d5-5884-9953-b430e803fb4a with identifier: VN35608
2026-03-28 12:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 262cbd88-90d5-5884-9953-b430e803fb4a with identifier: VN35608 to the API
2026-03-28 12:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:44:37Z',
'fuel_type': 'gas',
'id': '262cbd88-90d5-5884-9953-b430e803fb4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN35608',
'listing': 'auction',
'make': 'Nissan',
'model': 'Micra',
'odometer': 150545,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-12',
'seller_name': None,
'title': 'Nissan Micra 1.0 IG-T LPG N-Design',
'transmission': 'manual',
'trim': 'N-Design',
'year': 2021}
2026-03-28 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN35608%27 HTTP/1.1" 200 None
2026-03-28 12:04:04 [auto1.it] INFO: Saving data for VN35608: {'auction_closing_time': 1774716277.0, 'created_time': 1774094543.176704, 'last_price_update_time': 1774699444.131026}
2026-03-28 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VN35608') HTTP/1.1" 204 0
2026-03-28 12:04:04 [auto1.it] INFO: Found listing with ID: US42109
2026-03-28 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US42109%27 HTTP/1.1" 200 None
2026-03-28 12:04:04 [auto1.it] INFO: Scrape type for US42109: 0
2026-03-28 12:04:04 [auto1.it] INFO: Found listing with ID: JL30882
2026-03-28 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL30882%27 HTTP/1.1" 200 None
2026-03-28 12:04:04 [auto1.it] INFO: Scrape type for JL30882: 0
2026-03-28 12:04:04 [auto1.it] INFO: Found listing with ID: AP78180
2026-03-28 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP78180%27 HTTP/1.1" 200 None
2026-03-28 12:04:04 [auto1.it] INFO: Scrape type for AP78180: 0
2026-03-28 12:04:04 [auto1.it] INFO: Found listing with ID: DC69304
2026-03-28 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC69304%27 HTTP/1.1" 200 None
2026-03-28 12:04:04 [auto1.it] INFO: Scrape type for DC69304: 0
2026-03-28 12:04:04 [auto1.it] INFO: Found listing with ID: JE58875
2026-03-28 12:04:04 [auto1.it] INFO: Found listing with ID: GC49019
2026-03-28 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC49019%27 HTTP/1.1" 200 None
2026-03-28 12:04:04 [auto1.it] INFO: Scrape type for GC49019: 0
2026-03-28 12:04:04 [auto1.it] INFO: Found listing with ID: ZJ87043
2026-03-28 12:04:04 [auto1.it] INFO: Found listing with ID: BZ19379
2026-03-28 12:04:04 [auto1.it] INFO: Found listing with ID: MG94028
2026-03-28 12:04:04 [auto1.it] INFO: Found listing with ID: NG57771
2026-03-28 12:04:04 [auto1.it] INFO: Found listing with ID: LT57228
2026-03-28 12:04:04 [auto1.it] INFO: Found listing with ID: CF86558
2026-03-28 12:04:04 [auto1.it] INFO: Found listing with ID: JN49587
2026-03-28 12:04:04 [auto1.it] INFO: Found listing with ID: PG13965
2026-03-28 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG13965%27 HTTP/1.1" 200 None
2026-03-28 12:04:04 [auto1.it] INFO: Scrape type for PG13965: 0
2026-03-28 12:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:04:05 [auto1.it] INFO: Channel: 24h | Page: 53 | totalHits: 3673 | hits on page: 40
2026-03-28 12:04:05 [auto1.it] INFO: Found listing with ID: NL47700
2026-03-28 12:04:05 [auto1.it] INFO: Found listing with ID: JU28739
2026-03-28 12:04:05 [auto1.it] INFO: Found listing with ID: ZC80598
2026-03-28 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC80598%27 HTTP/1.1" 200 None
2026-03-28 12:04:05 [auto1.it] INFO: Scrape type for ZC80598: 2
2026-03-28 12:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec1077e9-ec86-5ca3-b06b-52a23cf93661 with identifier: ZC80598
2026-03-28 12:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec1077e9-ec86-5ca3-b06b-52a23cf93661 with scrape type 2
2026-03-28 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec1077e9-ec86-5ca3-b06b-52a23cf93661 with scrape type 2
2026-03-28 12:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ec1077e9-ec86-5ca3-b06b-52a23cf93661, identifier: ZC80598
2026-03-28 12:04:05 [scrapy.extensions.logstats] INFO: Crawled 251 pages (at 26 pages/min), scraped 192 items (at 42 items/min)
2026-03-28 12:04:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-28 12:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ec1077e9-ec86-5ca3-b06b-52a23cf93661 with identifier: ZC80598
2026-03-28 12:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ec1077e9-ec86-5ca3-b06b-52a23cf93661 with identifier: ZC80598
2026-03-28 12:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ec1077e9-ec86-5ca3-b06b-52a23cf93661 with identifier: ZC80598 to the API
2026-03-28 12:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:52:11Z',
'fuel_type': 'petrol',
'id': 'ec1077e9-ec86-5ca3-b06b-52a23cf93661',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC80598',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 111465,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-29',
'seller_name': None,
'title': 'Alfa Romeo Giulietta 1.4 Turbo Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2016}
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC80598%27 HTTP/1.1" 200 None
2026-03-28 12:04:06 [auto1.it] INFO: Saving data for ZC80598: {'auction_closing_time': 1774716731.0, 'created_time': 1774515632.974285, 'last_price_update_time': 1774699446.131036}
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZC80598') HTTP/1.1" 204 0
2026-03-28 12:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: YW38439
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW38439%27 HTTP/1.1" 200 None
2026-03-28 12:04:06 [auto1.it] INFO: Scrape type for YW38439: 0
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: ZT67877
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: HT64034
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT64034%27 HTTP/1.1" 200 None
2026-03-28 12:04:06 [auto1.it] INFO: Scrape type for HT64034: 0
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: RV54155
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: FH96840
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH96840%27 HTTP/1.1" 200 None
2026-03-28 12:04:06 [auto1.it] INFO: Scrape type for FH96840: 0
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: EF61328
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF61328%27 HTTP/1.1" 200 None
2026-03-28 12:04:06 [auto1.it] INFO: Scrape type for EF61328: 0
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: JK09197
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: YE07599
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: WH56731
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: ST27095
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST27095%27 HTTP/1.1" 200 None
2026-03-28 12:04:06 [auto1.it] INFO: Scrape type for ST27095: 0
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: LA78712
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: FA49150
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA49150%27 HTTP/1.1" 200 None
2026-03-28 12:04:06 [auto1.it] INFO: Scrape type for FA49150: 0
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: BG04687
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: TJ80617
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ80617%27 HTTP/1.1" 200 None
2026-03-28 12:04:06 [auto1.it] INFO: Scrape type for TJ80617: 0
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: MG40784
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG40784%27 HTTP/1.1" 200 None
2026-03-28 12:04:06 [auto1.it] INFO: Scrape type for MG40784: 0
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: SN49105
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: SK14741
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK14741%27 HTTP/1.1" 200 None
2026-03-28 12:04:06 [auto1.it] INFO: Scrape type for SK14741: 0
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: VB21565
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB21565%27 HTTP/1.1" 200 None
2026-03-28 12:04:06 [auto1.it] INFO: Scrape type for VB21565: 0
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: LC83851
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: HL58093
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL58093%27 HTTP/1.1" 200 None
2026-03-28 12:04:06 [auto1.it] INFO: Scrape type for HL58093: 0
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: KC12001
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC12001%27 HTTP/1.1" 200 None
2026-03-28 12:04:06 [auto1.it] INFO: Scrape type for KC12001: 0
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: BF03826
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: CT12062
2026-03-28 12:04:06 [auto1.it] INFO: Found listing with ID: WH54468
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH54468%27 HTTP/1.1" 200 None
2026-03-28 12:04:06 [auto1.it] INFO: Scrape type for WH54468: 2
2026-03-28 12:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d721193-a6a5-5744-919b-e5e3025654e0 with identifier: WH54468
2026-03-28 12:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d721193-a6a5-5744-919b-e5e3025654e0 with scrape type 2
2026-03-28 12:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d721193-a6a5-5744-919b-e5e3025654e0 with scrape type 2
2026-03-28 12:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5d721193-a6a5-5744-919b-e5e3025654e0, identifier: WH54468
2026-03-28 12:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5d721193-a6a5-5744-919b-e5e3025654e0 with identifier: WH54468
2026-03-28 12:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5d721193-a6a5-5744-919b-e5e3025654e0 with identifier: WH54468
2026-03-28 12:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5d721193-a6a5-5744-919b-e5e3025654e0 with identifier: WH54468 to the API
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:08:15Z',
'fuel_type': 'diesel',
'id': '5d721193-a6a5-5744-919b-e5e3025654e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH54468',
'listing': 'auction',
'make': 'Ford',
'model': 'EcoSport',
'odometer': 167397,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-07',
'seller_name': None,
'title': 'Ford EcoSport 1.5 TDCi Plus',
'transmission': 'manual',
'trim': 'Plus',
'year': 2016}
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH54468%27 HTTP/1.1" 200 None
2026-03-28 12:04:06 [auto1.it] INFO: Saving data for WH54468: {'auction_closing_time': 1774714095.0, 'created_time': 1774515662.368184, 'last_price_update_time': 1774699446.918874}
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WH54468') HTTP/1.1" 204 0
2026-03-28 12:04:07 [auto1.it] INFO: Found listing with ID: LK23524
2026-03-28 12:04:07 [auto1.it] INFO: Found listing with ID: WS49358
2026-03-28 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS49358%27 HTTP/1.1" 200 None
2026-03-28 12:04:07 [auto1.it] INFO: Scrape type for WS49358: 0
2026-03-28 12:04:07 [auto1.it] INFO: Found listing with ID: ED17590
2026-03-28 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED17590%27 HTTP/1.1" 200 None
2026-03-28 12:04:07 [auto1.it] INFO: Scrape type for ED17590: 0
2026-03-28 12:04:07 [auto1.it] INFO: Found listing with ID: FB83790
2026-03-28 12:04:07 [auto1.it] INFO: Found listing with ID: FP39081
2026-03-28 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP39081%27 HTTP/1.1" 200 None
2026-03-28 12:04:07 [auto1.it] INFO: Scrape type for FP39081: 0
2026-03-28 12:04:07 [auto1.it] INFO: Found listing with ID: KC49805
2026-03-28 12:04:07 [auto1.it] INFO: Found listing with ID: DU03202
2026-03-28 12:04:07 [auto1.it] INFO: Found listing with ID: HK89247
2026-03-28 12:04:07 [auto1.it] INFO: Found listing with ID: CW79165
2026-03-28 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW79165%27 HTTP/1.1" 200 None
2026-03-28 12:04:07 [auto1.it] INFO: Scrape type for CW79165: 0
2026-03-28 12:04:07 [auto1.it] INFO: Found listing with ID: JE99705
2026-03-28 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE99705%27 HTTP/1.1" 200 None
2026-03-28 12:04:07 [auto1.it] INFO: Scrape type for JE99705: 0
2026-03-28 12:04:07 [auto1.it] INFO: Found listing with ID: LU55329
2026-03-28 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU55329%27 HTTP/1.1" 200 None
2026-03-28 12:04:07 [auto1.it] INFO: Scrape type for LU55329: 0
2026-03-28 12:04:07 [auto1.it] INFO: Found listing with ID: YD85432
2026-03-28 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD85432%27 HTTP/1.1" 200 None
2026-03-28 12:04:07 [auto1.it] INFO: Scrape type for YD85432: 0
2026-03-28 12:04:07 [auto1.it] INFO: Found listing with ID: GJ95983
2026-03-28 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ95983%27 HTTP/1.1" 200 None
2026-03-28 12:04:07 [auto1.it] INFO: Scrape type for GJ95983: 0
2026-03-28 12:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:04:09 [auto1.it] INFO: Channel: 24h | Page: 54 | totalHits: 3673 | hits on page: 40
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: SP63067
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP63067%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for SP63067: 0
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: KJ50164
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: VU48365
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: RS99601
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS99601%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for RS99601: 0
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: HS43445
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: KL91026
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: KP30696
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP30696%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for KP30696: 0
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: LL54959
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL54959%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for LL54959: 0
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: MX03417
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX03417%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for MX03417: 0
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: HY79670
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: BC39052
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC39052%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for BC39052: 0
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: TR00137
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR00137%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for TR00137: 2
2026-03-28 12:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f76ce59d-c3f1-506f-8588-98d7ea04e6fd with identifier: TR00137
2026-03-28 12:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f76ce59d-c3f1-506f-8588-98d7ea04e6fd with scrape type 2
2026-03-28 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f76ce59d-c3f1-506f-8588-98d7ea04e6fd with scrape type 2
2026-03-28 12:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f76ce59d-c3f1-506f-8588-98d7ea04e6fd, identifier: TR00137
2026-03-28 12:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f76ce59d-c3f1-506f-8588-98d7ea04e6fd with identifier: TR00137
2026-03-28 12:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f76ce59d-c3f1-506f-8588-98d7ea04e6fd with identifier: TR00137
2026-03-28 12:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f76ce59d-c3f1-506f-8588-98d7ea04e6fd with identifier: TR00137 to the API
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:55:33Z',
'fuel_type': 'diesel',
'id': 'f76ce59d-c3f1-506f-8588-98d7ea04e6fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR00137',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 64516,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-26',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
'transmission': 'automatic',
'trim': 'Allure Pack',
'year': 2022}
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR00137%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Saving data for TR00137: {'auction_closing_time': 1774716933.0, 'created_time': 1774515730.342753, 'last_price_update_time': 1774699449.690107}
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TR00137') HTTP/1.1" 204 0
2026-03-28 12:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: WU76177
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: DF56056
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF56056%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for DF56056: 0
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: YV46524
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV46524%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for YV46524: 0
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: GJ72408
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ72408%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for GJ72408: 0
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: ZR61375
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR61375%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for ZR61375: 0
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: GT16147
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: ZB49687
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: EL74502
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL74502%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for EL74502: 0
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: HH94865
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: PT71441
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: TT80777
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT80777%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for TT80777: 0
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: XX06910
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: ZN78264
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: HS52325
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: HL91811
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL91811%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for HL91811: 0
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: FS39333
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: NT76067
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT76067%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for NT76067: 0
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: EN82101
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN82101%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for EN82101: 0
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: TU90316
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU90316%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for TU90316: 0
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: CF98226
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF98226%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for CF98226: 0
2026-03-28 12:04:09 [auto1.it] INFO: Found listing with ID: PZ28359
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ28359%27 HTTP/1.1" 200 None
2026-03-28 12:04:09 [auto1.it] INFO: Scrape type for PZ28359: 2
2026-03-28 12:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 541f9e52-6c53-54b7-bbad-4822c03ff5ab with identifier: PZ28359
2026-03-28 12:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 541f9e52-6c53-54b7-bbad-4822c03ff5ab with scrape type 2
2026-03-28 12:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 541f9e52-6c53-54b7-bbad-4822c03ff5ab with scrape type 2
2026-03-28 12:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 541f9e52-6c53-54b7-bbad-4822c03ff5ab, identifier: PZ28359
2026-03-28 12:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 541f9e52-6c53-54b7-bbad-4822c03ff5ab with identifier: PZ28359
2026-03-28 12:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 541f9e52-6c53-54b7-bbad-4822c03ff5ab with identifier: PZ28359
2026-03-28 12:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 541f9e52-6c53-54b7-bbad-4822c03ff5ab with identifier: PZ28359 to the API
2026-03-28 12:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:57:47Z',
'fuel_type': 'petrol',
'id': '541f9e52-6c53-54b7-bbad-4822c03ff5ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ28359',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 132259,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-03',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2013}
2026-03-28 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ28359%27 HTTP/1.1" 200 None
2026-03-28 12:04:10 [auto1.it] INFO: Saving data for PZ28359: {'auction_closing_time': 1774717067.0, 'created_time': 1773921644.328993, 'last_price_update_time': 1774699450.394441}
2026-03-28 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ28359') HTTP/1.1" 204 0
2026-03-28 12:04:10 [auto1.it] INFO: Found listing with ID: TY75037
2026-03-28 12:04:10 [auto1.it] INFO: Found listing with ID: HY43750
2026-03-28 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY43750%27 HTTP/1.1" 200 None
2026-03-28 12:04:10 [auto1.it] INFO: Scrape type for HY43750: 0
2026-03-28 12:04:10 [auto1.it] INFO: Found listing with ID: JV69341
2026-03-28 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV69341%27 HTTP/1.1" 200 None
2026-03-28 12:04:10 [auto1.it] INFO: Scrape type for JV69341: 0
2026-03-28 12:04:10 [auto1.it] INFO: Found listing with ID: HZ77474
2026-03-28 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ77474%27 HTTP/1.1" 200 None
2026-03-28 12:04:10 [auto1.it] INFO: Scrape type for HZ77474: 0
2026-03-28 12:04:10 [auto1.it] INFO: Found listing with ID: TN35413
2026-03-28 12:04:10 [auto1.it] INFO: Found listing with ID: KD77242
2026-03-28 12:04:10 [auto1.it] INFO: Found listing with ID: UD21419
2026-03-28 12:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:04:11 [auto1.it] INFO: Channel: 24h | Page: 55 | totalHits: 3673 | hits on page: 40
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: MD54154
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: DS64702
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS64702%27 HTTP/1.1" 200 None
2026-03-28 12:04:11 [auto1.it] INFO: Scrape type for DS64702: 0
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: RU70753
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: FB74710
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: FB96198
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB96198%27 HTTP/1.1" 200 None
2026-03-28 12:04:11 [auto1.it] INFO: Scrape type for FB96198: 0
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: NN66692
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: YS70370
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: YJ87795
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ87795%27 HTTP/1.1" 200 None
2026-03-28 12:04:11 [auto1.it] INFO: Scrape type for YJ87795: 0
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: MR40406
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: WA35829
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: HF95426
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: FB12726
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB12726%27 HTTP/1.1" 200 None
2026-03-28 12:04:11 [auto1.it] INFO: Scrape type for FB12726: 0
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: YT69462
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: UU91583
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: XU63603
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: EK49781
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK49781%27 HTTP/1.1" 200 None
2026-03-28 12:04:11 [auto1.it] INFO: Scrape type for EK49781: 0
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: MT13401
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: YT05499
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT05499%27 HTTP/1.1" 200 None
2026-03-28 12:04:11 [auto1.it] INFO: Scrape type for YT05499: 0
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: ZR58855
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: VV47439
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV47439%27 HTTP/1.1" 200 None
2026-03-28 12:04:11 [auto1.it] INFO: Scrape type for VV47439: 0
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: NF80846
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: SJ84275
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ84275%27 HTTP/1.1" 200 None
2026-03-28 12:04:11 [auto1.it] INFO: Scrape type for SJ84275: 0
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: HY53959
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY53959%27 HTTP/1.1" 200 None
2026-03-28 12:04:11 [auto1.it] INFO: Scrape type for HY53959: 0
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: WB22440
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: ME40395
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: ZU26854
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU26854%27 HTTP/1.1" 200 None
2026-03-28 12:04:11 [auto1.it] INFO: Scrape type for ZU26854: 0
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: JJ73686
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ73686%27 HTTP/1.1" 200 None
2026-03-28 12:04:11 [auto1.it] INFO: Scrape type for JJ73686: 0
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: ZZ72466
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ72466%27 HTTP/1.1" 200 None
2026-03-28 12:04:11 [auto1.it] INFO: Scrape type for ZZ72466: 0
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: PZ93737
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: EU94181
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: MP71804
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP71804%27 HTTP/1.1" 200 None
2026-03-28 12:04:11 [auto1.it] INFO: Scrape type for MP71804: 0
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: VM11321
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: SC36800
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: JR97776
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: TD68261
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD68261%27 HTTP/1.1" 200 None
2026-03-28 12:04:11 [auto1.it] INFO: Scrape type for TD68261: 0
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: BX49691
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: RZ83260
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: XW05686
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: XW18282
2026-03-28 12:04:11 [auto1.it] INFO: Found listing with ID: TZ10866
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ10866%27 HTTP/1.1" 200 None
2026-03-28 12:04:11 [auto1.it] INFO: Scrape type for TZ10866: 0
2026-03-28 12:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:04:12 [auto1.it] INFO: Channel: 24h | Page: 56 | totalHits: 3673 | hits on page: 40
2026-03-28 12:04:12 [auto1.it] INFO: Found listing with ID: KZ85828
2026-03-28 12:04:12 [auto1.it] INFO: Found listing with ID: BN48518
2026-03-28 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN48518%27 HTTP/1.1" 200 None
2026-03-28 12:04:12 [auto1.it] INFO: Scrape type for BN48518: 0
2026-03-28 12:04:12 [auto1.it] INFO: Found listing with ID: UV86108
2026-03-28 12:04:12 [auto1.it] INFO: Found listing with ID: RM97748
2026-03-28 12:04:12 [auto1.it] INFO: Found listing with ID: BG14963
2026-03-28 12:04:12 [auto1.it] INFO: Found listing with ID: KF47739
2026-03-28 12:04:12 [auto1.it] INFO: Found listing with ID: KD47428
2026-03-28 12:04:12 [auto1.it] INFO: Found listing with ID: MN95731
2026-03-28 12:04:12 [auto1.it] INFO: Found listing with ID: BV54558
2026-03-28 12:04:12 [auto1.it] INFO: Found listing with ID: ZD60941
2026-03-28 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD60941%27 HTTP/1.1" 200 None
2026-03-28 12:04:12 [auto1.it] INFO: Scrape type for ZD60941: 0
2026-03-28 12:04:12 [auto1.it] INFO: Found listing with ID: ZF37954
2026-03-28 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF37954%27 HTTP/1.1" 200 None
2026-03-28 12:04:12 [auto1.it] INFO: Scrape type for ZF37954: 2
2026-03-28 12:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f444f9bf-3af3-5a71-85fd-788f5024a3ad with identifier: ZF37954
2026-03-28 12:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f444f9bf-3af3-5a71-85fd-788f5024a3ad with scrape type 2
2026-03-28 12:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f444f9bf-3af3-5a71-85fd-788f5024a3ad with scrape type 2
2026-03-28 12:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f444f9bf-3af3-5a71-85fd-788f5024a3ad, identifier: ZF37954
2026-03-28 12:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f444f9bf-3af3-5a71-85fd-788f5024a3ad with identifier: ZF37954
2026-03-28 12:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f444f9bf-3af3-5a71-85fd-788f5024a3ad with identifier: ZF37954
2026-03-28 12:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f444f9bf-3af3-5a71-85fd-788f5024a3ad with identifier: ZF37954 to the API
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 235,
'expiration_date': '2026-03-28T16:35:20Z',
'fuel_type': 'diesel',
'id': 'f444f9bf-3af3-5a71-85fd-788f5024a3ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF37954',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 237500,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-09-19',
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 320 CDI L',
'transmission': 'automatic',
'trim': 'L',
'year': 2006}
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF37954%27 HTTP/1.1" 200 None
2026-03-28 12:04:13 [auto1.it] INFO: Saving data for ZF37954: {'auction_closing_time': 1774715720.0, 'created_time': 1774515700.294613, 'last_price_update_time': 1774699453.401792}
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZF37954') HTTP/1.1" 204 0
2026-03-28 12:04:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:04:13 [auto1.it] INFO: Found listing with ID: BL12911
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL12911%27 HTTP/1.1" 200 None
2026-03-28 12:04:13 [auto1.it] INFO: Scrape type for BL12911: 0
2026-03-28 12:04:13 [auto1.it] INFO: Found listing with ID: NE73775
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE73775%27 HTTP/1.1" 200 None
2026-03-28 12:04:13 [auto1.it] INFO: Scrape type for NE73775: 0
2026-03-28 12:04:13 [auto1.it] INFO: Found listing with ID: BJ73113
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ73113%27 HTTP/1.1" 200 None
2026-03-28 12:04:13 [auto1.it] INFO: Scrape type for BJ73113: 0
2026-03-28 12:04:13 [auto1.it] INFO: Found listing with ID: UG81579
2026-03-28 12:04:13 [auto1.it] INFO: Found listing with ID: ZD82029
2026-03-28 12:04:13 [auto1.it] INFO: Found listing with ID: NE01926
2026-03-28 12:04:13 [auto1.it] INFO: Found listing with ID: PM63773
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM63773%27 HTTP/1.1" 200 None
2026-03-28 12:04:13 [auto1.it] INFO: Scrape type for PM63773: 0
2026-03-28 12:04:13 [auto1.it] INFO: Found listing with ID: YS46999
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS46999%27 HTTP/1.1" 200 None
2026-03-28 12:04:13 [auto1.it] INFO: Scrape type for YS46999: 0
2026-03-28 12:04:13 [auto1.it] INFO: Found listing with ID: NH03785
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH03785%27 HTTP/1.1" 200 None
2026-03-28 12:04:13 [auto1.it] INFO: Scrape type for NH03785: 2
2026-03-28 12:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7861e75f-5f1e-5812-8ca1-f69c2553218c with identifier: NH03785
2026-03-28 12:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7861e75f-5f1e-5812-8ca1-f69c2553218c with scrape type 2
2026-03-28 12:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7861e75f-5f1e-5812-8ca1-f69c2553218c with scrape type 2
2026-03-28 12:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7861e75f-5f1e-5812-8ca1-f69c2553218c, identifier: NH03785
2026-03-28 12:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7861e75f-5f1e-5812-8ca1-f69c2553218c with identifier: NH03785
2026-03-28 12:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7861e75f-5f1e-5812-8ca1-f69c2553218c with identifier: NH03785
2026-03-28 12:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7861e75f-5f1e-5812-8ca1-f69c2553218c with identifier: NH03785 to the API
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 82,
'expiration_date': '2026-03-28T16:39:24Z',
'fuel_type': 'diesel',
'id': '7861e75f-5f1e-5812-8ca1-f69c2553218c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH03785',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 145052,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-07-27',
'seller_name': None,
'title': 'Renault Kangoo 1.5 dCi Privilege',
'transmission': 'manual',
'trim': 'Privilege',
'year': 2004}
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH03785%27 HTTP/1.1" 200 None
2026-03-28 12:04:14 [auto1.it] INFO: Saving data for NH03785: {'auction_closing_time': 1774715964.0, 'created_time': 1774515735.694818, 'last_price_update_time': 1774699454.016541}
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NH03785') HTTP/1.1" 204 0
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: DF59331
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: PB31965
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: BU54586
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: YA22905
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: LT75746
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT75746%27 HTTP/1.1" 200 None
2026-03-28 12:04:14 [auto1.it] INFO: Scrape type for LT75746: 2
2026-03-28 12:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5468f62-70e1-5445-ad50-a9832ba71165 with identifier: LT75746
2026-03-28 12:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5468f62-70e1-5445-ad50-a9832ba71165 with scrape type 2
2026-03-28 12:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5468f62-70e1-5445-ad50-a9832ba71165 with scrape type 2
2026-03-28 12:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c5468f62-70e1-5445-ad50-a9832ba71165, identifier: LT75746
2026-03-28 12:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c5468f62-70e1-5445-ad50-a9832ba71165 with identifier: LT75746
2026-03-28 12:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c5468f62-70e1-5445-ad50-a9832ba71165 with identifier: LT75746
2026-03-28 12:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c5468f62-70e1-5445-ad50-a9832ba71165 with identifier: LT75746 to the API
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:34:20Z',
'fuel_type': 'diesel',
'id': 'c5468f62-70e1-5445-ad50-a9832ba71165',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT75746',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 298594,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-07',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2009}
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT75746%27 HTTP/1.1" 200 None
2026-03-28 12:04:14 [auto1.it] INFO: Saving data for LT75746: {'auction_closing_time': 1774715660.0, 'created_time': 1774101660.670698, 'last_price_update_time': 1774699454.45545}
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LT75746') HTTP/1.1" 204 0
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: XC67854
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: HT94696
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT94696%27 HTTP/1.1" 200 None
2026-03-28 12:04:14 [auto1.it] INFO: Scrape type for HT94696: 0
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: LV20949
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: JM05776
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM05776%27 HTTP/1.1" 200 None
2026-03-28 12:04:14 [auto1.it] INFO: Scrape type for JM05776: 0
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: RB00475
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: BL94999
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL94999%27 HTTP/1.1" 200 None
2026-03-28 12:04:14 [auto1.it] INFO: Scrape type for BL94999: 0
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: NL09316
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: TK94629
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: TD66065
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD66065%27 HTTP/1.1" 200 None
2026-03-28 12:04:14 [auto1.it] INFO: Scrape type for TD66065: 0
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: KZ84746
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ84746%27 HTTP/1.1" 200 None
2026-03-28 12:04:14 [auto1.it] INFO: Scrape type for KZ84746: 0
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: KU78765
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: SC05628
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: AS40947
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS40947%27 HTTP/1.1" 200 None
2026-03-28 12:04:14 [auto1.it] INFO: Scrape type for AS40947: 0
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: JK70304
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK70304%27 HTTP/1.1" 200 None
2026-03-28 12:04:14 [auto1.it] INFO: Scrape type for JK70304: 0
2026-03-28 12:04:14 [auto1.it] INFO: Found listing with ID: ZJ10623
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ10623%27 HTTP/1.1" 200 None
2026-03-28 12:04:14 [auto1.it] INFO: Scrape type for ZJ10623: 0
2026-03-28 12:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:04:15 [auto1.it] INFO: Channel: 24h | Page: 57 | totalHits: 3673 | hits on page: 40
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: AY88271
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY88271%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for AY88271: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: FA14531
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA14531%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for FA14531: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: VX65874
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: LY05485
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: UT39332
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT39332%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for UT39332: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: RN93859
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: YB60466
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB60466%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for YB60466: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: YV65594
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: MB50671
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: HB16965
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB16965%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for HB16965: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: LN12916
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: CT16450
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: NT40514
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT40514%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for NT40514: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: XL03216
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL03216%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for XL03216: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: YM68683
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: RS48404
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS48404%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for RS48404: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: FN49181
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN49181%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for FN49181: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: LA93311
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA93311%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for LA93311: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: CL54955
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL54955%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for CL54955: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: KY00124
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: MW20525
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: FM16184
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM16184%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for FM16184: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: BY67467
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY67467%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for BY67467: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: ST73163
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: DV99228
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV99228%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for DV99228: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: UZ46554
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ46554%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for UZ46554: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: KM32276
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM32276%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for KM32276: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: KF21230
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: KJ44926
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: KE56728
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: JN46164
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN46164%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for JN46164: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: NG42330
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG42330%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for NG42330: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: DJ11873
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ11873%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for DJ11873: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: UH02752
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: TA27022
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA27022%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for TA27022: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: EE25529
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: AK59444
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK59444%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for AK59444: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: MR66716
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR66716%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for MR66716: 0
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: PA42280
2026-03-28 12:04:15 [auto1.it] INFO: Found listing with ID: GW20648
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW20648%27 HTTP/1.1" 200 None
2026-03-28 12:04:15 [auto1.it] INFO: Scrape type for GW20648: 0
2026-03-28 12:04:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:04:16 [auto1.it] INFO: Channel: 24h | Page: 58 | totalHits: 3673 | hits on page: 40
2026-03-28 12:04:16 [auto1.it] INFO: Found listing with ID: JR22558
2026-03-28 12:04:16 [auto1.it] INFO: Found listing with ID: NZ11107
2026-03-28 12:04:16 [auto1.it] INFO: Found listing with ID: WN42286
2026-03-28 12:04:16 [auto1.it] INFO: Found listing with ID: KM60643
2026-03-28 12:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM60643%27 HTTP/1.1" 200 None
2026-03-28 12:04:16 [auto1.it] INFO: Scrape type for KM60643: 0
2026-03-28 12:04:16 [auto1.it] INFO: Found listing with ID: LA47308
2026-03-28 12:04:16 [auto1.it] INFO: Found listing with ID: WG64225
2026-03-28 12:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG64225%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for WG64225: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: HD23157
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD23157%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for HD23157: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: FM38716
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM38716%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for FM38716: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: LG11183
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG11183%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for LG11183: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: FT05147
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT05147%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for FT05147: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: LC01017
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: MV39692
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV39692%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for MV39692: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: DA96064
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: NJ11800
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ11800%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for NJ11800: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: CD95874
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD95874%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for CD95874: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: DT73051
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: PK63277
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK63277%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for PK63277: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: FK85417
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: TF37027
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: UU36082
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: NS61318
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS61318%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for NS61318: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: WA05631
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: MK47318
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK47318%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for MK47318: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: SR34135
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: PC99456
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: PF34434
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF34434%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for PF34434: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: UY73261
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY73261%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for UY73261: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: DM22709
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: FC30574
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC30574%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for FC30574: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: ND56106
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: JC04494
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC04494%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for JC04494: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: LC40122
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC40122%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for LC40122: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: SU89902
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: VD81489
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: AY85424
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: MF53034
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MF53034%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for MF53034: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: AU72091
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU72091%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for AU72091: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: EZ36845
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: FR71474
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR71474%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for FR71474: 0
2026-03-28 12:04:17 [auto1.it] INFO: Found listing with ID: NR76329
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR76329%27 HTTP/1.1" 200 None
2026-03-28 12:04:17 [auto1.it] INFO: Scrape type for NR76329: 0
2026-03-28 12:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:04:18 [auto1.it] INFO: Channel: 24h | Page: 59 | totalHits: 3673 | hits on page: 40
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: EV83401
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV83401%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for EV83401: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: DJ42894
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ42894%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for DJ42894: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: TM24531
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM24531%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for TM24531: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: CW41374
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW41374%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for CW41374: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: UW33297
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: DR27432
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR27432%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for DR27432: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: JJ70536
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ70536%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for JJ70536: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: WC74031
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC74031%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for WC74031: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: FH60242
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH60242%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for FH60242: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: HJ29626
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: ZN12664
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: TW11966
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: FL85946
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: VJ53947
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ53947%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for VJ53947: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: DA24771
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA24771%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for DA24771: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: RW18979
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: YF61167
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: GJ41533
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ41533%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for GJ41533: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: PK33563
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK33563%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for PK33563: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: WG29768
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG29768%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for WG29768: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: EA21058
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: VX99971
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: BP79618
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP79618%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for BP79618: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: WG71791
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: ZY63215
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: EH99264
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH99264%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for EH99264: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: LB86726
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB86726%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for LB86726: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: XN70596
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN70596%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for XN70596: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: PZ92590
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: CM44345
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM44345%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for CM44345: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: YW27369
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: SH22668
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: PU31383
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU31383%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for PU31383: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: SM10455
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM10455%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for SM10455: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: ZY20684
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY20684%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for ZY20684: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: XY06195
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY06195%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for XY06195: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: VR30636
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: CK65162
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK65162%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for CK65162: 0
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: AP21705
2026-03-28 12:04:18 [auto1.it] INFO: Found listing with ID: VH38350
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH38350%27 HTTP/1.1" 200 None
2026-03-28 12:04:18 [auto1.it] INFO: Scrape type for VH38350: 0
2026-03-28 12:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:04:19 [auto1.it] INFO: Channel: 24h | Page: 60 | totalHits: 3673 | hits on page: 40
2026-03-28 12:04:19 [auto1.it] INFO: Found listing with ID: XC86223
2026-03-28 12:04:19 [auto1.it] INFO: Found listing with ID: XU45966
2026-03-28 12:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU45966%27 HTTP/1.1" 200 None
2026-03-28 12:04:19 [auto1.it] INFO: Scrape type for XU45966: 0
2026-03-28 12:04:19 [auto1.it] INFO: Found listing with ID: NY71286
2026-03-28 12:04:19 [auto1.it] INFO: Found listing with ID: RD78006
2026-03-28 12:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD78006%27 HTTP/1.1" 200 None
2026-03-28 12:04:19 [auto1.it] INFO: Scrape type for RD78006: 0
2026-03-28 12:04:19 [auto1.it] INFO: Found listing with ID: CF61926
2026-03-28 12:04:19 [auto1.it] INFO: Found listing with ID: SL28261
2026-03-28 12:04:19 [auto1.it] INFO: Found listing with ID: XZ72452
2026-03-28 12:04:19 [auto1.it] INFO: Found listing with ID: CT62115
2026-03-28 12:04:19 [auto1.it] INFO: Found listing with ID: NA19420
2026-03-28 12:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA19420%27 HTTP/1.1" 200 None
2026-03-28 12:04:19 [auto1.it] INFO: Scrape type for NA19420: 0
2026-03-28 12:04:19 [auto1.it] INFO: Found listing with ID: UH10100
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH10100%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for UH10100: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: DW12777
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW12777%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for DW12777: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: PW61851
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: LK86303
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK86303%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for LK86303: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: YU91907
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU91907%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for YU91907: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: FR09226
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: TZ10573
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ10573%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for TZ10573: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: DP88225
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP88225%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for DP88225: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: LL55379
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: EP71722
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: RS77350
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: DN48840
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN48840%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for DN48840: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: SG58934
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG58934%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for SG58934: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: FK20941
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK20941%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for FK20941: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: XN27965
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN27965%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for XN27965: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: JZ39412
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ39412%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for JZ39412: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: XM00417
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM00417%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for XM00417: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: DT20429
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT20429%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for DT20429: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: WY52867
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY52867%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for WY52867: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: RK63045
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: AN53744
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN53744%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for AN53744: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: ZL03111
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL03111%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for ZL03111: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: CR51689
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR51689%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for CR51689: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: GJ25112
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ25112%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for GJ25112: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: LP93747
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP93747%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for LP93747: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: PE19282
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE19282%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for PE19282: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: CL45076
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL45076%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for CL45076: 0
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: PG35916
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: ZU55509
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: EC84941
2026-03-28 12:04:20 [auto1.it] INFO: Found listing with ID: ZN80284
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN80284%27 HTTP/1.1" 200 None
2026-03-28 12:04:20 [auto1.it] INFO: Scrape type for ZN80284: 0
2026-03-28 12:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:04:21 [auto1.it] INFO: Channel: 24h | Page: 61 | totalHits: 3673 | hits on page: 40
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: ZL81271
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: RV64842
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV64842%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for RV64842: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: XW64768
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW64768%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for XW64768: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: GY24745
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: WG32639
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: KA78119
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: KT00361
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: DB99572
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: ZS75876
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: XR19887
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: UW96033
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW96033%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for UW96033: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: UN43339
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: DM22162
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM22162%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for DM22162: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: VF71012
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF71012%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for VF71012: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: DT03603
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: AN46326
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN46326%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for AN46326: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: ZT86767
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT86767%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for ZT86767: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: DB04877
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB04877%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for DB04877: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: CE88274
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: GY86444
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY86444%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for GY86444: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: LB78723
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB78723%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for LB78723: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: KB64117
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB64117%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for KB64117: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: HB85992
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB85992%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for HB85992: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: WP02751
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP02751%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for WP02751: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: KB32662
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: CM16503
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM16503%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for CM16503: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: CV26562
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: LV27017
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV27017%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for LV27017: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: PW98934
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: PZ48613
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: MR45258
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR45258%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for MR45258: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: WG08894
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: HF76476
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: TY18364
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: NK56802
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK56802%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for NK56802: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: NV82845
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV82845%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for NV82845: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: PM77932
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: NC51724
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC51724%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for NC51724: 0
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: GZ60590
2026-03-28 12:04:21 [auto1.it] INFO: Found listing with ID: UA61069
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA61069%27 HTTP/1.1" 200 None
2026-03-28 12:04:21 [auto1.it] INFO: Scrape type for UA61069: 0
2026-03-28 12:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:04:22 [auto1.it] INFO: Channel: 24h | Page: 62 | totalHits: 3673 | hits on page: 40
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: PB72674
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: GS07587
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: VJ15717
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ15717%27 HTTP/1.1" 200 None
2026-03-28 12:04:22 [auto1.it] INFO: Scrape type for VJ15717: 0
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: FA85590
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: DW71358
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW71358%27 HTTP/1.1" 200 None
2026-03-28 12:04:22 [auto1.it] INFO: Scrape type for DW71358: 0
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: VC28082
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC28082%27 HTTP/1.1" 200 None
2026-03-28 12:04:22 [auto1.it] INFO: Scrape type for VC28082: 0
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: MA80694
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA80694%27 HTTP/1.1" 200 None
2026-03-28 12:04:22 [auto1.it] INFO: Scrape type for MA80694: 0
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: JP88345
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP88345%27 HTTP/1.1" 200 None
2026-03-28 12:04:22 [auto1.it] INFO: Scrape type for JP88345: 0
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: HM97674
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: UF13738
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: RP10798
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: NK13523
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK13523%27 HTTP/1.1" 200 None
2026-03-28 12:04:22 [auto1.it] INFO: Scrape type for NK13523: 0
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: DF73154
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: BH85641
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH85641%27 HTTP/1.1" 200 None
2026-03-28 12:04:22 [auto1.it] INFO: Scrape type for BH85641: 0
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: JH70368
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: RF82114
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: YS98054
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS98054%27 HTTP/1.1" 200 None
2026-03-28 12:04:22 [auto1.it] INFO: Scrape type for YS98054: 0
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: TD98171
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD98171%27 HTTP/1.1" 200 None
2026-03-28 12:04:22 [auto1.it] INFO: Scrape type for TD98171: 0
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: RG82226
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: HS01763
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: HS85648
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS85648%27 HTTP/1.1" 200 None
2026-03-28 12:04:22 [auto1.it] INFO: Scrape type for HS85648: 0
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: UC01773
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC01773%27 HTTP/1.1" 200 None
2026-03-28 12:04:22 [auto1.it] INFO: Scrape type for UC01773: 0
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: ZV58496
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: ZE54964
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: TG01095
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG01095%27 HTTP/1.1" 200 None
2026-03-28 12:04:22 [auto1.it] INFO: Scrape type for TG01095: 0
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: BL33415
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL33415%27 HTTP/1.1" 200 None
2026-03-28 12:04:22 [auto1.it] INFO: Scrape type for BL33415: 0
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: FG93356
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG93356%27 HTTP/1.1" 200 None
2026-03-28 12:04:22 [auto1.it] INFO: Scrape type for FG93356: 0
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: LD09745
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD09745%27 HTTP/1.1" 200 None
2026-03-28 12:04:22 [auto1.it] INFO: Scrape type for LD09745: 0
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: FZ53517
2026-03-28 12:04:22 [auto1.it] INFO: Found listing with ID: ED44758
2026-03-28 12:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED44758%27 HTTP/1.1" 200 None
2026-03-28 12:04:23 [auto1.it] INFO: Scrape type for ED44758: 0
2026-03-28 12:04:23 [auto1.it] INFO: Found listing with ID: FM26794
2026-03-28 12:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM26794%27 HTTP/1.1" 200 None
2026-03-28 12:04:23 [auto1.it] INFO: Scrape type for FM26794: 0
2026-03-28 12:04:23 [auto1.it] INFO: Found listing with ID: MA29879
2026-03-28 12:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA29879%27 HTTP/1.1" 200 None
2026-03-28 12:04:23 [auto1.it] INFO: Scrape type for MA29879: 0
2026-03-28 12:04:23 [auto1.it] INFO: Found listing with ID: RP11137
2026-03-28 12:04:23 [auto1.it] INFO: Found listing with ID: YU18545
2026-03-28 12:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU18545%27 HTTP/1.1" 200 None
2026-03-28 12:04:23 [auto1.it] INFO: Scrape type for YU18545: 0
2026-03-28 12:04:23 [auto1.it] INFO: Found listing with ID: BT34353
2026-03-28 12:04:23 [auto1.it] INFO: Found listing with ID: MV84060
2026-03-28 12:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV84060%27 HTTP/1.1" 200 None
2026-03-28 12:04:23 [auto1.it] INFO: Scrape type for MV84060: 0
2026-03-28 12:04:23 [auto1.it] INFO: Found listing with ID: XH21917
2026-03-28 12:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH21917%27 HTTP/1.1" 200 None
2026-03-28 12:04:23 [auto1.it] INFO: Scrape type for XH21917: 0
2026-03-28 12:04:23 [auto1.it] INFO: Found listing with ID: CV60051
2026-03-28 12:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV60051%27 HTTP/1.1" 200 None
2026-03-28 12:04:23 [auto1.it] INFO: Scrape type for CV60051: 0
2026-03-28 12:04:23 [auto1.it] INFO: Found listing with ID: BN63914
2026-03-28 12:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN63914%27 HTTP/1.1" 200 None
2026-03-28 12:04:23 [auto1.it] INFO: Scrape type for BN63914: 0
2026-03-28 12:04:23 [auto1.it] INFO: Found listing with ID: RM66243
2026-03-28 12:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:04:24 [auto1.it] INFO: Channel: 24h | Page: 63 | totalHits: 3673 | hits on page: 40
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: XF07692
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: FC82856
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: LH93951
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: YL53737
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL53737%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for YL53737: 0
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: BW34835
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW34835%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for BW34835: 0
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: NC75436
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: ZZ37301
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: ED49512
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: PP30320
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: GU13900
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU13900%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for GU13900: 0
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: LX88559
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX88559%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for LX88559: 0
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: DR08334
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: JL50472
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL50472%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for JL50472: 0
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: PA95874
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: KW91343
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW91343%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for KW91343: 0
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: MG56824
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: ZC61191
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC61191%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for ZC61191: 0
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: BE98345
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE98345%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for BE98345: 0
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: KF16617
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: CF46707
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF46707%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for CF46707: 0
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: PW55510
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW55510%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for PW55510: 0
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: HH63511
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: XB83607
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB83607%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for XB83607: 0
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: TX19342
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX19342%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for TX19342: 0
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: FG48164
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: WD01397
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD01397%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for WD01397: 0
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: MZ58050
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ58050%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for MZ58050: 0
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: PT91804
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: WA90639
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: WT06044
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT06044%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for WT06044: 0
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: RW29335
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: LL12083
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: RV05928
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: TH12767
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: PM18246
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: WD56351
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: JT98079
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT98079%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for JT98079: 0
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: CC30639
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC30639%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for CC30639: 0
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: HX11977
2026-03-28 12:04:24 [auto1.it] INFO: Found listing with ID: DP76328
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP76328%27 HTTP/1.1" 200 None
2026-03-28 12:04:24 [auto1.it] INFO: Scrape type for DP76328: 0
2026-03-28 12:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:04:26 [auto1.it] INFO: Channel: 24h | Page: 64 | totalHits: 3673 | hits on page: 40
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: AW58556
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: PV15987
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: CL12006
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: JF71307
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: DZ84756
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: MS56995
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: GL66582
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: CY86412
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY86412%27 HTTP/1.1" 200 None
2026-03-28 12:04:26 [auto1.it] INFO: Scrape type for CY86412: 0
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: UF72432
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF72432%27 HTTP/1.1" 200 None
2026-03-28 12:04:26 [auto1.it] INFO: Scrape type for UF72432: 0
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: MY33245
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: AJ60776
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: TY10894
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY10894%27 HTTP/1.1" 200 None
2026-03-28 12:04:26 [auto1.it] INFO: Scrape type for TY10894: 0
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: XE78357
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: JK74619
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK74619%27 HTTP/1.1" 200 None
2026-03-28 12:04:26 [auto1.it] INFO: Scrape type for JK74619: 0
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: MP43347
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: PW94321
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW94321%27 HTTP/1.1" 200 None
2026-03-28 12:04:26 [auto1.it] INFO: Scrape type for PW94321: 0
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: TW74539
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: VA19442
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA19442%27 HTTP/1.1" 200 None
2026-03-28 12:04:26 [auto1.it] INFO: Scrape type for VA19442: 0
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: TE58119
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: JE47359
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE47359%27 HTTP/1.1" 200 None
2026-03-28 12:04:26 [auto1.it] INFO: Scrape type for JE47359: 0
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: UN82812
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: AG84200
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG84200%27 HTTP/1.1" 200 None
2026-03-28 12:04:26 [auto1.it] INFO: Scrape type for AG84200: 0
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: NY32354
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY32354%27 HTTP/1.1" 200 None
2026-03-28 12:04:26 [auto1.it] INFO: Scrape type for NY32354: 0
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: SJ01004
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ01004%27 HTTP/1.1" 200 None
2026-03-28 12:04:26 [auto1.it] INFO: Scrape type for SJ01004: 0
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: LT40503
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: WM11657
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: UE69721
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: RU03062
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU03062%27 HTTP/1.1" 200 None
2026-03-28 12:04:26 [auto1.it] INFO: Scrape type for RU03062: 0
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: JM45525
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: LK41226
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: PY67809
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY67809%27 HTTP/1.1" 200 None
2026-03-28 12:04:26 [auto1.it] INFO: Scrape type for PY67809: 0
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: AR75288
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: CC38262
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: ZJ87985
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ87985%27 HTTP/1.1" 200 None
2026-03-28 12:04:26 [auto1.it] INFO: Scrape type for ZJ87985: 0
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: MK10556
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK10556%27 HTTP/1.1" 200 None
2026-03-28 12:04:26 [auto1.it] INFO: Scrape type for MK10556: 0
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: YD65738
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: TK22539
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK22539%27 HTTP/1.1" 200 None
2026-03-28 12:04:26 [auto1.it] INFO: Scrape type for TK22539: 0
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: GM28799
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: WL47610
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL47610%27 HTTP/1.1" 200 None
2026-03-28 12:04:26 [auto1.it] INFO: Scrape type for WL47610: 0
2026-03-28 12:04:26 [auto1.it] INFO: Found listing with ID: NP40750
2026-03-28 12:04:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:04:28 [auto1.it] INFO: Channel: 24h | Page: 65 | totalHits: 3673 | hits on page: 40
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: AA65111
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA65111%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for AA65111: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: RG08940
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG08940%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for RG08940: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: FL08980
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL08980%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for FL08980: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: DU09881
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU09881%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for DU09881: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: FL90232
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: DD75867
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD75867%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for DD75867: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: SK41395
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK41395%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for SK41395: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: TU59296
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: PR98561
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: AY33190
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY33190%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for AY33190: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: CN85628
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN85628%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for CN85628: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: AA13192
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: BX20882
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: SD99760
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD99760%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for SD99760: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: UZ55357
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ55357%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for UZ55357: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: CD59978
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD59978%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for CD59978: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: TY61219
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY61219%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for TY61219: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: UT42979
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: EZ12960
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ12960%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for EZ12960: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: HY18936
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY18936%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for HY18936: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: CV95594
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: LG34418
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG34418%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for LG34418: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: AY77506
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: KH49254
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: RM05411
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM05411%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for RM05411: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: PW10693
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: DC13549
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC13549%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for DC13549: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: WX66376
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX66376%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for WX66376: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: SY39981
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY39981%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for SY39981: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: MD08971
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: ZW42216
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: BX71767
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: GP73012
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GP73012%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for GP73012: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: XG67662
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XG67662%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for XG67662: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: EJ77874
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ77874%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for EJ77874: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: VX04337
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX04337%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for VX04337: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: BK28378
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: JC85025
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC85025%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for JC85025: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: YD48620
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD48620%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for YD48620: 0
2026-03-28 12:04:28 [auto1.it] INFO: Found listing with ID: WZ23561
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ23561%27 HTTP/1.1" 200 None
2026-03-28 12:04:28 [auto1.it] INFO: Scrape type for WZ23561: 0
2026-03-28 12:04:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:04:29 [auto1.it] INFO: Channel: 24h | Page: 66 | totalHits: 3673 | hits on page: 40
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: CA31078
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: DX25254
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: RN28631
2026-03-28 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN28631%27 HTTP/1.1" 200 None
2026-03-28 12:04:29 [auto1.it] INFO: Scrape type for RN28631: 0
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: KD79727
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: GV78603
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: JD36680
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: HB10468
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: RA38886
2026-03-28 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA38886%27 HTTP/1.1" 200 None
2026-03-28 12:04:29 [auto1.it] INFO: Scrape type for RA38886: 0
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: EH45262
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: SK02509
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: RJ33574
2026-03-28 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ33574%27 HTTP/1.1" 200 None
2026-03-28 12:04:29 [auto1.it] INFO: Scrape type for RJ33574: 0
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: YX30570
2026-03-28 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX30570%27 HTTP/1.1" 200 None
2026-03-28 12:04:29 [auto1.it] INFO: Scrape type for YX30570: 0
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: WP88184
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: ZG90138
2026-03-28 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG90138%27 HTTP/1.1" 200 None
2026-03-28 12:04:29 [auto1.it] INFO: Scrape type for ZG90138: 0
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: TM53494
2026-03-28 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM53494%27 HTTP/1.1" 200 None
2026-03-28 12:04:29 [auto1.it] INFO: Scrape type for TM53494: 0
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: BZ06099
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: KB16454
2026-03-28 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB16454%27 HTTP/1.1" 200 None
2026-03-28 12:04:29 [auto1.it] INFO: Scrape type for KB16454: 0
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: FE09970
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: XW11641
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: PK37829
2026-03-28 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK37829%27 HTTP/1.1" 200 None
2026-03-28 12:04:29 [auto1.it] INFO: Scrape type for PK37829: 0
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: LA07616
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: VJ93406
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: SG11242
2026-03-28 12:04:29 [auto1.it] INFO: Found listing with ID: DM40972
2026-03-28 12:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM40972%27 HTTP/1.1" 200 None
2026-03-28 12:04:30 [auto1.it] INFO: Scrape type for DM40972: 0
2026-03-28 12:04:30 [auto1.it] INFO: Found listing with ID: ZX94133
2026-03-28 12:04:30 [auto1.it] INFO: Found listing with ID: VE23835
2026-03-28 12:04:30 [auto1.it] INFO: Found listing with ID: NW58325
2026-03-28 12:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW58325%27 HTTP/1.1" 200 None
2026-03-28 12:04:30 [auto1.it] INFO: Scrape type for NW58325: 0
2026-03-28 12:04:30 [auto1.it] INFO: Found listing with ID: MN82158
2026-03-28 12:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN82158%27 HTTP/1.1" 200 None
2026-03-28 12:04:30 [auto1.it] INFO: Scrape type for MN82158: 0
2026-03-28 12:04:30 [auto1.it] INFO: Found listing with ID: ZC19416
2026-03-28 12:04:30 [auto1.it] INFO: Found listing with ID: DL31507
2026-03-28 12:04:30 [auto1.it] INFO: Found listing with ID: KT77401
2026-03-28 12:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT77401%27 HTTP/1.1" 200 None
2026-03-28 12:04:30 [auto1.it] INFO: Scrape type for KT77401: 0
2026-03-28 12:04:30 [auto1.it] INFO: Found listing with ID: XX72612
2026-03-28 12:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX72612%27 HTTP/1.1" 200 None
2026-03-28 12:04:30 [auto1.it] INFO: Scrape type for XX72612: 0
2026-03-28 12:04:30 [auto1.it] INFO: Found listing with ID: HE91199
2026-03-28 12:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE91199%27 HTTP/1.1" 200 None
2026-03-28 12:04:30 [auto1.it] INFO: Scrape type for HE91199: 0
2026-03-28 12:04:30 [auto1.it] INFO: Found listing with ID: CW11593
2026-03-28 12:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW11593%27 HTTP/1.1" 200 None
2026-03-28 12:04:30 [auto1.it] INFO: Scrape type for CW11593: 0
2026-03-28 12:04:30 [auto1.it] INFO: Found listing with ID: DW16027
2026-03-28 12:04:30 [auto1.it] INFO: Found listing with ID: NC12493
2026-03-28 12:04:30 [auto1.it] INFO: Found listing with ID: GD15248
2026-03-28 12:04:30 [auto1.it] INFO: Found listing with ID: TH28502
2026-03-28 12:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH28502%27 HTTP/1.1" 200 None
2026-03-28 12:04:30 [auto1.it] INFO: Scrape type for TH28502: 0
2026-03-28 12:04:30 [auto1.it] INFO: Found listing with ID: RJ37840
2026-03-28 12:04:30 [auto1.it] INFO: Found listing with ID: EC99785
2026-03-28 12:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:01 [auto1.it] INFO: Channel: 24h | Page: 67 | totalHits: 3673 | hits on page: 40
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: ZZ86621
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: VT42510
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: LN57194
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: PZ63395
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: LG36476
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG36476%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for LG36476: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: DV58522
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: YH05705
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH05705%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for YH05705: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: GH85070
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: MN32437
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN32437%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for MN32437: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: UV23225
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV23225%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for UV23225: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: SE74727
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE74727%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for SE74727: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: AY40178
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: JD45338
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD45338%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for JD45338: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: MT71865
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT71865%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for MT71865: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: FN81856
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN81856%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for FN81856: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: PH50557
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH50557%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for PH50557: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: GZ99467
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: GN89134
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN89134%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for GN89134: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: FT00845
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT00845%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for FT00845: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: ZU32516
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: HK76451
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: VG48139
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: CY33103
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY33103%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for CY33103: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: WH17825
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: JT23346
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: RF43689
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: FK45797
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: GW83806
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: PH45617
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH45617%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for PH45617: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: XT40512
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT40512%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for XT40512: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: CM50151
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM50151%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for CM50151: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: KL55117
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL55117%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for KL55117: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: KD38461
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: XU37749
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU37749%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for XU37749: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: WV44347
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV44347%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for WV44347: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: YG18020
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: HW85888
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: HA44632
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: KT79218
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT79218%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for KT79218: 0
2026-03-28 12:05:01 [auto1.it] INFO: Found listing with ID: KD49699
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD49699%27 HTTP/1.1" 200 None
2026-03-28 12:05:01 [auto1.it] INFO: Scrape type for KD49699: 0
2026-03-28 12:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:02 [auto1.it] INFO: Channel: 24h | Page: 68 | totalHits: 3673 | hits on page: 40
2026-03-28 12:05:02 [auto1.it] INFO: Found listing with ID: ZE21394
2026-03-28 12:05:02 [auto1.it] INFO: Found listing with ID: NB15044
2026-03-28 12:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB15044%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for NB15044: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: YA54300
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: NX73202
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX73202%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for NX73202: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: BG55667
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: SA71650
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA71650%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for SA71650: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: TN53037
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN53037%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for TN53037: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: TG42626
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: LL94615
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: YD47870
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: RS41050
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: ET57280
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: BW44627
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW44627%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for BW44627: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: JX68223
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX68223%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for JX68223: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: ZW92714
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW92714%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for ZW92714: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: UP17064
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP17064%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for UP17064: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: NN80859
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN80859%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for NN80859: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: UB21320
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB21320%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for UB21320: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: NJ83998
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ83998%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for NJ83998: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: MN68461
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN68461%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for MN68461: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: CH31271
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH31271%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for CH31271: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: XX37698
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX37698%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for XX37698: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: FX50490
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX50490%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for FX50490: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: RN44276
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: ST06974
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: TJ46359
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ46359%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for TJ46359: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: FA93618
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: KS43685
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: GX83807
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX83807%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for GX83807: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: YG30728
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG30728%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for YG30728: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: GF63115
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF63115%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for GF63115: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: JB43722
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB43722%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for JB43722: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: PP68116
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP68116%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for PP68116: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: SE79185
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: TT81235
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT81235%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for TT81235: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: CK25903
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK25903%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for CK25903: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: JF07503
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: RV62579
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: RL62360
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL62360%27 HTTP/1.1" 200 None
2026-03-28 12:05:03 [auto1.it] INFO: Scrape type for RL62360: 0
2026-03-28 12:05:03 [auto1.it] INFO: Found listing with ID: FD53627
2026-03-28 12:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:04 [auto1.it] INFO: Channel: 24h | Page: 69 | totalHits: 3673 | hits on page: 40
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: DL97052
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL97052%27 HTTP/1.1" 200 None
2026-03-28 12:05:04 [auto1.it] INFO: Scrape type for DL97052: 0
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: VT42722
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: AG54549
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: EP88995
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP88995%27 HTTP/1.1" 200 None
2026-03-28 12:05:04 [auto1.it] INFO: Scrape type for EP88995: 0
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: WK88793
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK88793%27 HTTP/1.1" 200 None
2026-03-28 12:05:04 [auto1.it] INFO: Scrape type for WK88793: 0
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: FR03346
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: UY39151
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: SP41813
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: VM78443
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: DV39460
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV39460%27 HTTP/1.1" 200 None
2026-03-28 12:05:04 [auto1.it] INFO: Scrape type for DV39460: 0
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: KE11189
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE11189%27 HTTP/1.1" 200 None
2026-03-28 12:05:04 [auto1.it] INFO: Scrape type for KE11189: 0
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: EY33952
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY33952%27 HTTP/1.1" 200 None
2026-03-28 12:05:04 [auto1.it] INFO: Scrape type for EY33952: 0
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: DU17366
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU17366%27 HTTP/1.1" 200 None
2026-03-28 12:05:04 [auto1.it] INFO: Scrape type for DU17366: 0
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: YB63473
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: SJ00829
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ00829%27 HTTP/1.1" 200 None
2026-03-28 12:05:04 [auto1.it] INFO: Scrape type for SJ00829: 0
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: FY46493
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: GN74108
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: GF01079
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: XV16730
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: PV94920
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV94920%27 HTTP/1.1" 200 None
2026-03-28 12:05:04 [auto1.it] INFO: Scrape type for PV94920: 0
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: ZJ21397
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ21397%27 HTTP/1.1" 200 None
2026-03-28 12:05:04 [auto1.it] INFO: Scrape type for ZJ21397: 0
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: CH52447
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: UA89499
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: WU80477
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: YK06699
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: DK87302
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: RF27989
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: TV99764
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: SG31590
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG31590%27 HTTP/1.1" 200 None
2026-03-28 12:05:04 [auto1.it] INFO: Scrape type for SG31590: 0
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: EA08863
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA08863%27 HTTP/1.1" 200 None
2026-03-28 12:05:04 [auto1.it] INFO: Scrape type for EA08863: 0
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: HD82423
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: NW60366
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: UC47461
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC47461%27 HTTP/1.1" 200 None
2026-03-28 12:05:04 [auto1.it] INFO: Scrape type for UC47461: 0
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: NP37024
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP37024%27 HTTP/1.1" 200 None
2026-03-28 12:05:04 [auto1.it] INFO: Scrape type for NP37024: 0
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: WV72590
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV72590%27 HTTP/1.1" 200 None
2026-03-28 12:05:04 [auto1.it] INFO: Scrape type for WV72590: 0
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: DB68692
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB68692%27 HTTP/1.1" 200 None
2026-03-28 12:05:04 [auto1.it] INFO: Scrape type for DB68692: 0
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: FP20263
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: WM78801
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: BR67394
2026-03-28 12:05:04 [auto1.it] INFO: Found listing with ID: KP12391
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP12391%27 HTTP/1.1" 200 None
2026-03-28 12:05:04 [auto1.it] INFO: Scrape type for KP12391: 0
2026-03-28 12:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:05 [scrapy.extensions.logstats] INFO: Crawled 267 pages (at 16 pages/min), scraped 199 items (at 7 items/min)
2026-03-28 12:05:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-28 12:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:06 [auto1.it] INFO: Channel: 24h | Page: 70 | totalHits: 3673 | hits on page: 40
2026-03-28 12:05:06 [auto1.it] INFO: Found listing with ID: JU67462
2026-03-28 12:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU67462%27 HTTP/1.1" 200 None
2026-03-28 12:05:06 [auto1.it] INFO: Scrape type for JU67462: 0
2026-03-28 12:05:06 [auto1.it] INFO: Found listing with ID: WE55630
2026-03-28 12:05:06 [auto1.it] INFO: Found listing with ID: VB70261
2026-03-28 12:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB70261%27 HTTP/1.1" 200 None
2026-03-28 12:05:06 [auto1.it] INFO: Scrape type for VB70261: 2
2026-03-28 12:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af1baea2-cc44-5fe3-b568-db8907fb1052 with identifier: VB70261
2026-03-28 12:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af1baea2-cc44-5fe3-b568-db8907fb1052 with scrape type 2
2026-03-28 12:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af1baea2-cc44-5fe3-b568-db8907fb1052 with scrape type 2
2026-03-28 12:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af1baea2-cc44-5fe3-b568-db8907fb1052, identifier: VB70261
2026-03-28 12:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af1baea2-cc44-5fe3-b568-db8907fb1052 with identifier: VB70261
2026-03-28 12:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af1baea2-cc44-5fe3-b568-db8907fb1052 with identifier: VB70261
2026-03-28 12:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af1baea2-cc44-5fe3-b568-db8907fb1052 with identifier: VB70261 to the API
2026-03-28 12:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:41:39Z',
'fuel_type': 'diesel',
'id': 'af1baea2-cc44-5fe3-b568-db8907fb1052',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB70261',
'listing': 'auction',
'make': 'Volvo',
'model': 'V60',
'odometer': 147410,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-26',
'seller_name': None,
'title': 'Volvo V60 2.0 D3 Dynamic Edition',
'transmission': 'automatic',
'trim': 'Dynamic Edition',
'year': 2017}
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB70261%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Saving data for VB70261: {'auction_closing_time': 1774716099.0, 'created_time': 1774515719.380678, 'last_price_update_time': 1774699507.038506}
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VB70261') HTTP/1.1" 204 0
2026-03-28 12:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: UX28393
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX28393%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for UX28393: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: JY35916
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: KZ49625
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: BA15195
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: FN78187
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: CT25036
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT25036%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for CT25036: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: CV79259
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV79259%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for CV79259: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: WH70643
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH70643%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for WH70643: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: BE00528
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE00528%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for BE00528: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: AD01687
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD01687%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for AD01687: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: YT67370
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT67370%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for YT67370: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: HX75119
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX75119%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for HX75119: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: RU27646
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: CW11036
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW11036%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for CW11036: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: WS86957
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS86957%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for WS86957: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: DN99534
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: FN89798
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: JL83365
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL83365%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for JL83365: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: WH55866
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: AE85133
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE85133%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for AE85133: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: DN08813
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN08813%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for DN08813: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: GP15834
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GP15834%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for GP15834: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: YH14903
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: BJ71456
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ71456%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for BJ71456: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: HC78855
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: GM03670
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: WY72750
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY72750%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for WY72750: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: ZF40554
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF40554%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for ZF40554: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: XY26314
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY26314%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for XY26314: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: PD07113
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: NP01679
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP01679%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for NP01679: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: PN01400
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: HM54008
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM54008%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for HM54008: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: SP76824
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: KM59258
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: EK35642
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK35642%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for EK35642: 0
2026-03-28 12:05:07 [auto1.it] INFO: Found listing with ID: TS59592
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS59592%27 HTTP/1.1" 200 None
2026-03-28 12:05:07 [auto1.it] INFO: Scrape type for TS59592: 0
2026-03-28 12:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:08 [auto1.it] INFO: Channel: 24h | Page: 71 | totalHits: 3673 | hits on page: 40
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: GL53946
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: TL14575
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL14575%27 HTTP/1.1" 200 None
2026-03-28 12:05:08 [auto1.it] INFO: Scrape type for TL14575: 0
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: DC79490
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: KH25019
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH25019%27 HTTP/1.1" 200 None
2026-03-28 12:05:08 [auto1.it] INFO: Scrape type for KH25019: 0
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: ES64600
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: FL80724
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: KL25988
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL25988%27 HTTP/1.1" 200 None
2026-03-28 12:05:08 [auto1.it] INFO: Scrape type for KL25988: 0
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: WF71586
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF71586%27 HTTP/1.1" 200 None
2026-03-28 12:05:08 [auto1.it] INFO: Scrape type for WF71586: 0
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: ZV13161
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: WX88611
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: DX82404
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: SC24442
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: JT68367
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT68367%27 HTTP/1.1" 200 None
2026-03-28 12:05:08 [auto1.it] INFO: Scrape type for JT68367: 0
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: HZ95408
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: KT12037
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT12037%27 HTTP/1.1" 200 None
2026-03-28 12:05:08 [auto1.it] INFO: Scrape type for KT12037: 0
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: TV86323
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: JJ76443
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: YW35893
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: LU63066
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU63066%27 HTTP/1.1" 200 None
2026-03-28 12:05:08 [auto1.it] INFO: Scrape type for LU63066: 0
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: JG85699
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: HU57000
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: HG91847
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: TM20698
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: UP03227
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP03227%27 HTTP/1.1" 200 None
2026-03-28 12:05:08 [auto1.it] INFO: Scrape type for UP03227: 0
2026-03-28 12:05:08 [auto1.it] INFO: Found listing with ID: KA22424
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA22424%27 HTTP/1.1" 200 None
2026-03-28 12:05:08 [auto1.it] INFO: Scrape type for KA22424: 2
2026-03-28 12:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11176cc6-a1eb-57e4-a0a8-d0fb45fc64f4 with identifier: KA22424
2026-03-28 12:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11176cc6-a1eb-57e4-a0a8-d0fb45fc64f4 with scrape type 2
2026-03-28 12:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11176cc6-a1eb-57e4-a0a8-d0fb45fc64f4 with scrape type 2
2026-03-28 12:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 11176cc6-a1eb-57e4-a0a8-d0fb45fc64f4, identifier: KA22424
2026-03-28 12:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 11176cc6-a1eb-57e4-a0a8-d0fb45fc64f4 with identifier: KA22424
2026-03-28 12:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 11176cc6-a1eb-57e4-a0a8-d0fb45fc64f4 with identifier: KA22424
2026-03-28 12:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 11176cc6-a1eb-57e4-a0a8-d0fb45fc64f4 with identifier: KA22424 to the API
2026-03-28 12:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:36:27Z',
'fuel_type': 'diesel',
'id': '11176cc6-a1eb-57e4-a0a8-d0fb45fc64f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA22424',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 148175,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-29',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2014}
2026-03-28 12:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA22424%27 HTTP/1.1" 200 None
2026-03-28 12:05:09 [auto1.it] INFO: Saving data for KA22424: {'auction_closing_time': 1774715787.0, 'created_time': 1772785281.211038, 'last_price_update_time': 1774699509.234598}
2026-03-28 12:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KA22424') HTTP/1.1" 204 0
2026-03-28 12:05:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:09 [auto1.it] INFO: Found listing with ID: JW95602
2026-03-28 12:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW95602%27 HTTP/1.1" 200 None
2026-03-28 12:05:09 [auto1.it] INFO: Scrape type for JW95602: 2
2026-03-28 12:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3218e2a7-5209-5eba-a49a-eae17b285a74 with identifier: JW95602
2026-03-28 12:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3218e2a7-5209-5eba-a49a-eae17b285a74 with scrape type 2
2026-03-28 12:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3218e2a7-5209-5eba-a49a-eae17b285a74 with scrape type 2
2026-03-28 12:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3218e2a7-5209-5eba-a49a-eae17b285a74, identifier: JW95602
2026-03-28 12:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3218e2a7-5209-5eba-a49a-eae17b285a74 with identifier: JW95602
2026-03-28 12:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3218e2a7-5209-5eba-a49a-eae17b285a74 with identifier: JW95602
2026-03-28 12:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3218e2a7-5209-5eba-a49a-eae17b285a74 with identifier: JW95602 to the API
2026-03-28 12:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 225,
'expiration_date': '2026-03-28T16:13:31Z',
'fuel_type': 'diesel',
'id': '3218e2a7-5209-5eba-a49a-eae17b285a74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW95602',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLK-Klasse',
'odometer': 87455,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-04-26',
'seller_name': None,
'title': 'Mercedes-Benz CLK-Klasse CLK 320 CDI Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2007}
2026-03-28 12:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW95602%27 HTTP/1.1" 200 None
2026-03-28 12:05:09 [auto1.it] INFO: Saving data for JW95602: {'auction_closing_time': 1774714411.0, 'created_time': 1774612859.985929, 'last_price_update_time': 1774699509.702294}
2026-03-28 12:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JW95602') HTTP/1.1" 204 0
2026-03-28 12:05:09 [auto1.it] INFO: Found listing with ID: FG41149
2026-03-28 12:05:09 [auto1.it] INFO: Found listing with ID: HA39708
2026-03-28 12:05:09 [auto1.it] INFO: Found listing with ID: FH51436
2026-03-28 12:05:09 [auto1.it] INFO: Found listing with ID: EH34312
2026-03-28 12:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH34312%27 HTTP/1.1" 200 None
2026-03-28 12:05:09 [auto1.it] INFO: Scrape type for EH34312: 2
2026-03-28 12:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ac6ee82-95d3-5761-9e61-f044300f6eb1 with identifier: EH34312
2026-03-28 12:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ac6ee82-95d3-5761-9e61-f044300f6eb1 with scrape type 2
2026-03-28 12:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ac6ee82-95d3-5761-9e61-f044300f6eb1 with scrape type 2
2026-03-28 12:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9ac6ee82-95d3-5761-9e61-f044300f6eb1, identifier: EH34312
2026-03-28 12:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9ac6ee82-95d3-5761-9e61-f044300f6eb1 with identifier: EH34312
2026-03-28 12:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9ac6ee82-95d3-5761-9e61-f044300f6eb1 with identifier: EH34312
2026-03-28 12:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9ac6ee82-95d3-5761-9e61-f044300f6eb1 with identifier: EH34312 to the API
2026-03-28 12:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-28T16:10:43Z',
'fuel_type': 'hybrid',
'id': '9ac6ee82-95d3-5761-9e61-f044300f6eb1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH34312',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 113009,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-09',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.4 eHybrid Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2021}
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH34312%27 HTTP/1.1" 200 None
2026-03-28 12:05:10 [auto1.it] INFO: Saving data for EH34312: {'auction_closing_time': 1774714243.0, 'created_time': 1774613006.515695, 'last_price_update_time': 1774699510.074612}
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EH34312') HTTP/1.1" 204 0
2026-03-28 12:05:10 [auto1.it] INFO: Found listing with ID: AR14989
2026-03-28 12:05:10 [auto1.it] INFO: Found listing with ID: YC82026
2026-03-28 12:05:10 [auto1.it] INFO: Found listing with ID: XD81326
2026-03-28 12:05:10 [auto1.it] INFO: Found listing with ID: JN59652
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN59652%27 HTTP/1.1" 200 None
2026-03-28 12:05:10 [auto1.it] INFO: Scrape type for JN59652: 2
2026-03-28 12:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 043252ec-569c-5351-b7cc-3d9dcd5b7a57 with identifier: JN59652
2026-03-28 12:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 043252ec-569c-5351-b7cc-3d9dcd5b7a57 with scrape type 2
2026-03-28 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 043252ec-569c-5351-b7cc-3d9dcd5b7a57 with scrape type 2
2026-03-28 12:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 043252ec-569c-5351-b7cc-3d9dcd5b7a57, identifier: JN59652
2026-03-28 12:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 043252ec-569c-5351-b7cc-3d9dcd5b7a57 with identifier: JN59652
2026-03-28 12:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 043252ec-569c-5351-b7cc-3d9dcd5b7a57 with identifier: JN59652
2026-03-28 12:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 043252ec-569c-5351-b7cc-3d9dcd5b7a57 with identifier: JN59652 to the API
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-28T16:42:55Z',
'fuel_type': 'diesel',
'id': '043252ec-569c-5351-b7cc-3d9dcd5b7a57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN59652',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 307396,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-26',
'seller_name': None,
'title': 'BMW 5er 525d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2014}
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN59652%27 HTTP/1.1" 200 None
2026-03-28 12:05:10 [auto1.it] INFO: Saving data for JN59652: {'auction_closing_time': 1774716175.0, 'created_time': 1774612998.709229, 'last_price_update_time': 1774699510.470847}
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JN59652') HTTP/1.1" 204 0
2026-03-28 12:05:10 [auto1.it] INFO: Found listing with ID: TJ64738
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ64738%27 HTTP/1.1" 200 None
2026-03-28 12:05:10 [auto1.it] INFO: Scrape type for TJ64738: 2
2026-03-28 12:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f105712a-6c11-56df-a35e-c0d8fbf10d2d with identifier: TJ64738
2026-03-28 12:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f105712a-6c11-56df-a35e-c0d8fbf10d2d with scrape type 2
2026-03-28 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f105712a-6c11-56df-a35e-c0d8fbf10d2d with scrape type 2
2026-03-28 12:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f105712a-6c11-56df-a35e-c0d8fbf10d2d, identifier: TJ64738
2026-03-28 12:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f105712a-6c11-56df-a35e-c0d8fbf10d2d with identifier: TJ64738
2026-03-28 12:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f105712a-6c11-56df-a35e-c0d8fbf10d2d with identifier: TJ64738
2026-03-28 12:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f105712a-6c11-56df-a35e-c0d8fbf10d2d with identifier: TJ64738 to the API
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 232,
'expiration_date': '2026-03-28T16:12:37Z',
'fuel_type': 'diesel',
'id': 'f105712a-6c11-56df-a35e-c0d8fbf10d2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ64738',
'listing': 'auction',
'make': 'Audi',
'model': 'A8',
'odometer': 156991,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-10',
'seller_name': None,
'title': 'Audi A8 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2009}
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ64738%27 HTTP/1.1" 200 None
2026-03-28 12:05:10 [auto1.it] INFO: Saving data for TJ64738: {'auction_closing_time': 1774714357.0, 'created_time': 1774613009.212914, 'last_price_update_time': 1774699510.89013}
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TJ64738') HTTP/1.1" 204 0
2026-03-28 12:05:10 [auto1.it] INFO: Found listing with ID: JK90392
2026-03-28 12:05:10 [auto1.it] INFO: Found listing with ID: JZ41811
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ41811%27 HTTP/1.1" 200 None
2026-03-28 12:05:10 [auto1.it] INFO: Scrape type for JZ41811: 2
2026-03-28 12:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e98cc8b9-e741-567e-ac03-c1020933e1f6 with identifier: JZ41811
2026-03-28 12:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e98cc8b9-e741-567e-ac03-c1020933e1f6 with scrape type 2
2026-03-28 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e98cc8b9-e741-567e-ac03-c1020933e1f6 with scrape type 2
2026-03-28 12:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e98cc8b9-e741-567e-ac03-c1020933e1f6, identifier: JZ41811
2026-03-28 12:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e98cc8b9-e741-567e-ac03-c1020933e1f6 with identifier: JZ41811
2026-03-28 12:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e98cc8b9-e741-567e-ac03-c1020933e1f6 with identifier: JZ41811
2026-03-28 12:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e98cc8b9-e741-567e-ac03-c1020933e1f6 with identifier: JZ41811 to the API
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 173,
'expiration_date': '2026-03-28T16:01:03Z',
'fuel_type': 'diesel',
'id': 'e98cc8b9-e741-567e-ac03-c1020933e1f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ41811',
'listing': 'auction',
'make': 'Toyota',
'model': 'Land Cruiser',
'odometer': 144652,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-26',
'seller_name': None,
'title': 'Toyota Land Cruiser 3.0 D-4D C',
'transmission': 'manual',
'trim': 'C',
'year': 2009}
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ41811%27 HTTP/1.1" 200 None
2026-03-28 12:05:11 [auto1.it] INFO: Saving data for JZ41811: {'auction_closing_time': 1774713663.0, 'created_time': 1774613003.857546, 'last_price_update_time': 1774699511.281781}
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JZ41811') HTTP/1.1" 204 0
2026-03-28 12:05:11 [auto1.it] INFO: Found listing with ID: AR28136
2026-03-28 12:05:11 [auto1.it] INFO: Found listing with ID: UA91591
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA91591%27 HTTP/1.1" 200 None
2026-03-28 12:05:11 [auto1.it] INFO: Scrape type for UA91591: 2
2026-03-28 12:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a603feea-eaf5-5efb-b049-d84747fcc10c with identifier: UA91591
2026-03-28 12:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a603feea-eaf5-5efb-b049-d84747fcc10c with scrape type 2
2026-03-28 12:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a603feea-eaf5-5efb-b049-d84747fcc10c with scrape type 2
2026-03-28 12:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a603feea-eaf5-5efb-b049-d84747fcc10c, identifier: UA91591
2026-03-28 12:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a603feea-eaf5-5efb-b049-d84747fcc10c with identifier: UA91591
2026-03-28 12:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a603feea-eaf5-5efb-b049-d84747fcc10c with identifier: UA91591
2026-03-28 12:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a603feea-eaf5-5efb-b049-d84747fcc10c with identifier: UA91591 to the API
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:25:42Z',
'fuel_type': 'petrol',
'id': 'a603feea-eaf5-5efb-b049-d84747fcc10c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA91591',
'listing': 'auction',
'make': 'Jeep',
'model': 'Avenger',
'odometer': 49928,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-18',
'seller_name': None,
'title': 'Jeep Avenger 1.2 T-GDI Altitude',
'transmission': 'manual',
'trim': 'Altitude',
'year': 2024}
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA91591%27 HTTP/1.1" 200 None
2026-03-28 12:05:11 [auto1.it] INFO: Saving data for UA91591: {'auction_closing_time': 1774715142.0, 'created_time': 1774613008.582093, 'last_price_update_time': 1774699511.80391}
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UA91591') HTTP/1.1" 204 0
2026-03-28 12:05:11 [auto1.it] INFO: Found listing with ID: FF45161
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF45161%27 HTTP/1.1" 200 None
2026-03-28 12:05:11 [auto1.it] INFO: Scrape type for FF45161: 0
2026-03-28 12:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:11 [auto1.it] INFO: Channel: 24h | Page: 72 | totalHits: 3673 | hits on page: 40
2026-03-28 12:05:11 [auto1.it] INFO: Found listing with ID: RZ15516
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ15516%27 HTTP/1.1" 200 None
2026-03-28 12:05:11 [auto1.it] INFO: Scrape type for RZ15516: 2
2026-03-28 12:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f761ff46-df89-57cc-84b2-124154e3e11c with identifier: RZ15516
2026-03-28 12:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f761ff46-df89-57cc-84b2-124154e3e11c with scrape type 2
2026-03-28 12:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f761ff46-df89-57cc-84b2-124154e3e11c with scrape type 2
2026-03-28 12:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f761ff46-df89-57cc-84b2-124154e3e11c, identifier: RZ15516
2026-03-28 12:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f761ff46-df89-57cc-84b2-124154e3e11c with identifier: RZ15516
2026-03-28 12:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f761ff46-df89-57cc-84b2-124154e3e11c with identifier: RZ15516
2026-03-28 12:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f761ff46-df89-57cc-84b2-124154e3e11c with identifier: RZ15516 to the API
2026-03-28 12:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:33:48Z',
'fuel_type': 'petrol',
'id': 'f761ff46-df89-57cc-84b2-124154e3e11c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ15516',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris Verso',
'odometer': 151369,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-05-28',
'seller_name': None,
'title': 'Toyota Yaris Verso 1.3 VVT-i Sol',
'transmission': 'manual',
'trim': 'Sol',
'year': 2002}
2026-03-28 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ15516%27 HTTP/1.1" 200 None
2026-03-28 12:05:12 [auto1.it] INFO: Saving data for RZ15516: {'auction_closing_time': 1774715628.0, 'created_time': 1772655255.391358, 'last_price_update_time': 1774699512.40191}
2026-03-28 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RZ15516') HTTP/1.1" 204 0
2026-03-28 12:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:12 [auto1.it] INFO: Found listing with ID: GN36205
2026-03-28 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN36205%27 HTTP/1.1" 200 None
2026-03-28 12:05:12 [auto1.it] INFO: Scrape type for GN36205: 2
2026-03-28 12:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 188b6a13-6543-5217-80d2-79fbaf174b34 with identifier: GN36205
2026-03-28 12:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 188b6a13-6543-5217-80d2-79fbaf174b34 with scrape type 2
2026-03-28 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 188b6a13-6543-5217-80d2-79fbaf174b34 with scrape type 2
2026-03-28 12:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 188b6a13-6543-5217-80d2-79fbaf174b34, identifier: GN36205
2026-03-28 12:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 188b6a13-6543-5217-80d2-79fbaf174b34 with identifier: GN36205
2026-03-28 12:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 188b6a13-6543-5217-80d2-79fbaf174b34 with identifier: GN36205
2026-03-28 12:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 188b6a13-6543-5217-80d2-79fbaf174b34 with identifier: GN36205 to the API
2026-03-28 12:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:21:43Z',
'fuel_type': 'petrol',
'id': '188b6a13-6543-5217-80d2-79fbaf174b34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN36205',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 72471,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-26',
'seller_name': None,
'title': 'Opel Corsa 1.2 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2011}
2026-03-28 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN36205%27 HTTP/1.1" 200 None
2026-03-28 12:05:12 [auto1.it] INFO: Saving data for GN36205: {'auction_closing_time': 1774714903.0, 'created_time': 1774613004.956877, 'last_price_update_time': 1774699512.789314}
2026-03-28 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GN36205') HTTP/1.1" 204 0
2026-03-28 12:05:12 [auto1.it] INFO: Found listing with ID: LH69939
2026-03-28 12:05:12 [auto1.it] INFO: Found listing with ID: LM72883
2026-03-28 12:05:12 [auto1.it] INFO: Found listing with ID: KB99828
2026-03-28 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB99828%27 HTTP/1.1" 200 None
2026-03-28 12:05:12 [auto1.it] INFO: Scrape type for KB99828: 2
2026-03-28 12:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dc5cf7a-66cf-54dc-a02b-a1b21dfa919b with identifier: KB99828
2026-03-28 12:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dc5cf7a-66cf-54dc-a02b-a1b21dfa919b with scrape type 2
2026-03-28 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8dc5cf7a-66cf-54dc-a02b-a1b21dfa919b with scrape type 2
2026-03-28 12:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8dc5cf7a-66cf-54dc-a02b-a1b21dfa919b, identifier: KB99828
2026-03-28 12:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8dc5cf7a-66cf-54dc-a02b-a1b21dfa919b with identifier: KB99828
2026-03-28 12:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8dc5cf7a-66cf-54dc-a02b-a1b21dfa919b with identifier: KB99828
2026-03-28 12:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8dc5cf7a-66cf-54dc-a02b-a1b21dfa919b with identifier: KB99828 to the API
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:04:19Z',
'fuel_type': 'petrol',
'id': '8dc5cf7a-66cf-54dc-a02b-a1b21dfa919b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB99828',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 74710,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-29',
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2019}
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB99828%27 HTTP/1.1" 200 None
2026-03-28 12:05:13 [auto1.it] INFO: Saving data for KB99828: {'auction_closing_time': 1774713859.0, 'created_time': 1774612866.033907, 'last_price_update_time': 1774699513.189841}
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KB99828') HTTP/1.1" 204 0
2026-03-28 12:05:13 [auto1.it] INFO: Found listing with ID: PA21374
2026-03-28 12:05:13 [auto1.it] INFO: Found listing with ID: LV04843
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV04843%27 HTTP/1.1" 200 None
2026-03-28 12:05:13 [auto1.it] INFO: Scrape type for LV04843: 2
2026-03-28 12:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ef1da43-5d89-51ee-b97a-8c539f040ca0 with identifier: LV04843
2026-03-28 12:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ef1da43-5d89-51ee-b97a-8c539f040ca0 with scrape type 2
2026-03-28 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ef1da43-5d89-51ee-b97a-8c539f040ca0 with scrape type 2
2026-03-28 12:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5ef1da43-5d89-51ee-b97a-8c539f040ca0, identifier: LV04843
2026-03-28 12:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5ef1da43-5d89-51ee-b97a-8c539f040ca0 with identifier: LV04843
2026-03-28 12:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5ef1da43-5d89-51ee-b97a-8c539f040ca0 with identifier: LV04843
2026-03-28 12:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5ef1da43-5d89-51ee-b97a-8c539f040ca0 with identifier: LV04843 to the API
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 250,
'expiration_date': '2026-03-28T16:12:01Z',
'fuel_type': 'diesel',
'id': '5ef1da43-5d89-51ee-b97a-8c539f040ca0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV04843',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 212913,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-17',
'seller_name': None,
'title': 'Land Rover Range Rover Sport 3.0 V6 TDI SDV6 SE',
'transmission': 'automatic',
'trim': 'SDV6 SE',
'year': 2013}
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV04843%27 HTTP/1.1" 200 None
2026-03-28 12:05:13 [auto1.it] INFO: Saving data for LV04843: {'auction_closing_time': 1774714321.0, 'created_time': 1772626029.984157, 'last_price_update_time': 1774699513.583495}
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LV04843') HTTP/1.1" 204 0
2026-03-28 12:05:13 [auto1.it] INFO: Found listing with ID: KP29994
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP29994%27 HTTP/1.1" 200 None
2026-03-28 12:05:13 [auto1.it] INFO: Scrape type for KP29994: 2
2026-03-28 12:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0778f63-e1a1-52d0-9eb1-218c3c783cd6 with identifier: KP29994
2026-03-28 12:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0778f63-e1a1-52d0-9eb1-218c3c783cd6 with scrape type 2
2026-03-28 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0778f63-e1a1-52d0-9eb1-218c3c783cd6 with scrape type 2
2026-03-28 12:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c0778f63-e1a1-52d0-9eb1-218c3c783cd6, identifier: KP29994
2026-03-28 12:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c0778f63-e1a1-52d0-9eb1-218c3c783cd6 with identifier: KP29994
2026-03-28 12:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c0778f63-e1a1-52d0-9eb1-218c3c783cd6 with identifier: KP29994
2026-03-28 12:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c0778f63-e1a1-52d0-9eb1-218c3c783cd6 with identifier: KP29994 to the API
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:37:45Z',
'fuel_type': 'petrol',
'id': 'c0778f63-e1a1-52d0-9eb1-218c3c783cd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP29994',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 85156,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-30',
'seller_name': None,
'title': 'Jeep Renegade 1.0 TGDi Longitude 4x2',
'transmission': 'manual',
'trim': 'Longitude 4x2',
'year': 2019}
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP29994%27 HTTP/1.1" 200 None
2026-03-28 12:05:13 [auto1.it] INFO: Saving data for KP29994: {'auction_closing_time': 1774715865.0, 'created_time': 1774612863.912573, 'last_price_update_time': 1774699513.958996}
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KP29994') HTTP/1.1" 204 0
2026-03-28 12:05:14 [auto1.it] INFO: Found listing with ID: BV21704
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV21704%27 HTTP/1.1" 200 None
2026-03-28 12:05:14 [auto1.it] INFO: Scrape type for BV21704: 2
2026-03-28 12:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80f91e3e-2130-51b3-be17-75dfac3fa42a with identifier: BV21704
2026-03-28 12:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80f91e3e-2130-51b3-be17-75dfac3fa42a with scrape type 2
2026-03-28 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80f91e3e-2130-51b3-be17-75dfac3fa42a with scrape type 2
2026-03-28 12:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 80f91e3e-2130-51b3-be17-75dfac3fa42a, identifier: BV21704
2026-03-28 12:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 80f91e3e-2130-51b3-be17-75dfac3fa42a with identifier: BV21704
2026-03-28 12:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 80f91e3e-2130-51b3-be17-75dfac3fa42a with identifier: BV21704
2026-03-28 12:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 80f91e3e-2130-51b3-be17-75dfac3fa42a with identifier: BV21704 to the API
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:39:50Z',
'fuel_type': 'diesel',
'id': '80f91e3e-2130-51b3-be17-75dfac3fa42a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV21704',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 212694,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-29',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Shooting Brake Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2016}
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV21704%27 HTTP/1.1" 200 None
2026-03-28 12:05:14 [auto1.it] INFO: Saving data for BV21704: {'auction_closing_time': 1774715990.0, 'created_time': 1774612900.603358, 'last_price_update_time': 1774699514.435665}
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BV21704') HTTP/1.1" 204 0
2026-03-28 12:05:14 [auto1.it] INFO: Found listing with ID: ZC10752
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC10752%27 HTTP/1.1" 200 None
2026-03-28 12:05:14 [auto1.it] INFO: Scrape type for ZC10752: 2
2026-03-28 12:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 160fdb7a-2cc0-5e88-bc0a-4bb3b653ca79 with identifier: ZC10752
2026-03-28 12:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 160fdb7a-2cc0-5e88-bc0a-4bb3b653ca79 with scrape type 2
2026-03-28 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 160fdb7a-2cc0-5e88-bc0a-4bb3b653ca79 with scrape type 2
2026-03-28 12:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 160fdb7a-2cc0-5e88-bc0a-4bb3b653ca79, identifier: ZC10752
2026-03-28 12:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 160fdb7a-2cc0-5e88-bc0a-4bb3b653ca79 with identifier: ZC10752
2026-03-28 12:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 160fdb7a-2cc0-5e88-bc0a-4bb3b653ca79 with identifier: ZC10752
2026-03-28 12:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 160fdb7a-2cc0-5e88-bc0a-4bb3b653ca79 with identifier: ZC10752 to the API
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:47:23Z',
'fuel_type': 'petrol',
'id': '160fdb7a-2cc0-5e88-bc0a-4bb3b653ca79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC10752',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 117307,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-27',
'seller_name': None,
'title': 'Fiat 500 0.9 Twin Air Plus',
'transmission': 'manual',
'trim': 'Twin Air Plus',
'year': 2011}
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC10752%27 HTTP/1.1" 200 None
2026-03-28 12:05:14 [auto1.it] INFO: Saving data for ZC10752: {'auction_closing_time': 1774716443.0, 'created_time': 1774613002.243406, 'last_price_update_time': 1774699514.844876}
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZC10752') HTTP/1.1" 204 0
2026-03-28 12:05:14 [auto1.it] INFO: Found listing with ID: BR63865
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR63865%27 HTTP/1.1" 200 None
2026-03-28 12:05:14 [auto1.it] INFO: Scrape type for BR63865: 2
2026-03-28 12:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 233c6b8c-4122-5edc-ac63-f2c8951201e6 with identifier: BR63865
2026-03-28 12:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 233c6b8c-4122-5edc-ac63-f2c8951201e6 with scrape type 2
2026-03-28 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 233c6b8c-4122-5edc-ac63-f2c8951201e6 with scrape type 2
2026-03-28 12:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 233c6b8c-4122-5edc-ac63-f2c8951201e6, identifier: BR63865
2026-03-28 12:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 233c6b8c-4122-5edc-ac63-f2c8951201e6 with identifier: BR63865
2026-03-28 12:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 233c6b8c-4122-5edc-ac63-f2c8951201e6 with identifier: BR63865
2026-03-28 12:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 233c6b8c-4122-5edc-ac63-f2c8951201e6 with identifier: BR63865 to the API
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:53:12Z',
'fuel_type': 'diesel',
'id': '233c6b8c-4122-5edc-ac63-f2c8951201e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR63865',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 137332,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-06',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2017}
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR63865%27 HTTP/1.1" 200 None
2026-03-28 12:05:15 [auto1.it] INFO: Saving data for BR63865: {'auction_closing_time': 1774716792.0, 'created_time': 1774612997.349692, 'last_price_update_time': 1774699515.313561}
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BR63865') HTTP/1.1" 204 0
2026-03-28 12:05:15 [auto1.it] INFO: Found listing with ID: DB81041
2026-03-28 12:05:15 [auto1.it] INFO: Found listing with ID: BM64259
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM64259%27 HTTP/1.1" 200 None
2026-03-28 12:05:15 [auto1.it] INFO: Scrape type for BM64259: 2
2026-03-28 12:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0455ead5-3723-5f68-88df-254f04b833b0 with identifier: BM64259
2026-03-28 12:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0455ead5-3723-5f68-88df-254f04b833b0 with scrape type 2
2026-03-28 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0455ead5-3723-5f68-88df-254f04b833b0 with scrape type 2
2026-03-28 12:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0455ead5-3723-5f68-88df-254f04b833b0, identifier: BM64259
2026-03-28 12:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0455ead5-3723-5f68-88df-254f04b833b0 with identifier: BM64259
2026-03-28 12:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0455ead5-3723-5f68-88df-254f04b833b0 with identifier: BM64259
2026-03-28 12:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0455ead5-3723-5f68-88df-254f04b833b0 with identifier: BM64259 to the API
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-28T16:31:24Z',
'fuel_type': 'diesel',
'id': '0455ead5-3723-5f68-88df-254f04b833b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM64259',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 37982,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-08',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d Mild-Hybrid 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2023}
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM64259%27 HTTP/1.1" 200 None
2026-03-28 12:05:15 [auto1.it] INFO: Saving data for BM64259: {'auction_closing_time': 1774715484.0, 'created_time': 1774612998.085741, 'last_price_update_time': 1774699515.703464}
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BM64259') HTTP/1.1" 204 0
2026-03-28 12:05:15 [auto1.it] INFO: Found listing with ID: AJ89778
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ89778%27 HTTP/1.1" 200 None
2026-03-28 12:05:15 [auto1.it] INFO: Scrape type for AJ89778: 2
2026-03-28 12:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18b85124-b37d-5d98-9344-ff012112814c with identifier: AJ89778
2026-03-28 12:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18b85124-b37d-5d98-9344-ff012112814c with scrape type 2
2026-03-28 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18b85124-b37d-5d98-9344-ff012112814c with scrape type 2
2026-03-28 12:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 18b85124-b37d-5d98-9344-ff012112814c, identifier: AJ89778
2026-03-28 12:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 18b85124-b37d-5d98-9344-ff012112814c with identifier: AJ89778
2026-03-28 12:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 18b85124-b37d-5d98-9344-ff012112814c with identifier: AJ89778
2026-03-28 12:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 18b85124-b37d-5d98-9344-ff012112814c with identifier: AJ89778 to the API
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:39:53Z',
'fuel_type': 'petrol',
'id': '18b85124-b37d-5d98-9344-ff012112814c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ89778',
'listing': 'auction',
'make': 'Jeep',
'model': 'Avenger',
'odometer': 28275,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-24',
'seller_name': None,
'title': 'Jeep Avenger 1.2 T-GDI Summit',
'transmission': 'manual',
'trim': 'Summit',
'year': 2023}
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ89778%27 HTTP/1.1" 200 None
2026-03-28 12:05:16 [auto1.it] INFO: Saving data for AJ89778: {'auction_closing_time': 1774715993.0, 'created_time': 1774612864.961213, 'last_price_update_time': 1774699516.102612}
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AJ89778') HTTP/1.1" 204 0
2026-03-28 12:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:16 [auto1.it] INFO: Found listing with ID: LX11958
2026-03-28 12:05:16 [auto1.it] INFO: Found listing with ID: CH57446
2026-03-28 12:05:16 [auto1.it] INFO: Found listing with ID: AR03634
2026-03-28 12:05:16 [auto1.it] INFO: Found listing with ID: GB22303
2026-03-28 12:05:16 [auto1.it] INFO: Found listing with ID: PT53216
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT53216%27 HTTP/1.1" 200 None
2026-03-28 12:05:16 [auto1.it] INFO: Scrape type for PT53216: 0
2026-03-28 12:05:16 [auto1.it] INFO: Found listing with ID: XX29767
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX29767%27 HTTP/1.1" 200 None
2026-03-28 12:05:16 [auto1.it] INFO: Scrape type for XX29767: 2
2026-03-28 12:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e092b911-602c-591d-9627-8308b9ce963d with identifier: XX29767
2026-03-28 12:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e092b911-602c-591d-9627-8308b9ce963d with scrape type 2
2026-03-28 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e092b911-602c-591d-9627-8308b9ce963d with scrape type 2
2026-03-28 12:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e092b911-602c-591d-9627-8308b9ce963d, identifier: XX29767
2026-03-28 12:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e092b911-602c-591d-9627-8308b9ce963d with identifier: XX29767
2026-03-28 12:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e092b911-602c-591d-9627-8308b9ce963d with identifier: XX29767
2026-03-28 12:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e092b911-602c-591d-9627-8308b9ce963d with identifier: XX29767 to the API
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:47:08Z',
'fuel_type': 'diesel',
'id': 'e092b911-602c-591d-9627-8308b9ce963d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX29767',
'listing': 'auction',
'make': 'Ford',
'model': 'Ranger',
'odometer': 33982,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-12',
'seller_name': None,
'title': 'Ford Ranger 2.0 TDCi EcoBlue XLT 4WD Doppelkabine',
'transmission': 'manual',
'trim': 'XLT 4WD Doppelkabine',
'year': 2023}
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX29767%27 HTTP/1.1" 200 None
2026-03-28 12:05:16 [auto1.it] INFO: Saving data for XX29767: {'auction_closing_time': 1774716428.0, 'created_time': 1774612933.074527, 'last_price_update_time': 1774699516.513518}
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XX29767') HTTP/1.1" 204 0
2026-03-28 12:05:16 [auto1.it] INFO: Found listing with ID: SV71044
2026-03-28 12:05:16 [auto1.it] INFO: Found listing with ID: EP62214
2026-03-28 12:05:16 [auto1.it] INFO: Found listing with ID: WW47132
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW47132%27 HTTP/1.1" 200 None
2026-03-28 12:05:16 [auto1.it] INFO: Scrape type for WW47132: 2
2026-03-28 12:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a028170f-4a57-51b6-a4cc-502c326753c8 with identifier: WW47132
2026-03-28 12:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a028170f-4a57-51b6-a4cc-502c326753c8 with scrape type 2
2026-03-28 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a028170f-4a57-51b6-a4cc-502c326753c8 with scrape type 2
2026-03-28 12:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a028170f-4a57-51b6-a4cc-502c326753c8, identifier: WW47132
2026-03-28 12:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a028170f-4a57-51b6-a4cc-502c326753c8 with identifier: WW47132
2026-03-28 12:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a028170f-4a57-51b6-a4cc-502c326753c8 with identifier: WW47132
2026-03-28 12:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a028170f-4a57-51b6-a4cc-502c326753c8 with identifier: WW47132 to the API
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:10:37Z',
'fuel_type': 'diesel',
'id': 'a028170f-4a57-51b6-a4cc-502c326753c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW47132',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 180677,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-28',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 2.0 Blue-HDi Business Class',
'transmission': 'automatic',
'trim': 'Business Class',
'year': 2014}
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW47132%27 HTTP/1.1" 200 None
2026-03-28 12:05:17 [auto1.it] INFO: Saving data for WW47132: {'auction_closing_time': 1774714237.0, 'created_time': 1774612867.817749, 'last_price_update_time': 1774699517.051227}
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WW47132') HTTP/1.1" 204 0
2026-03-28 12:05:17 [auto1.it] INFO: Channel: 24h | Page: 73 | totalHits: 3673 | hits on page: 40
2026-03-28 12:05:17 [auto1.it] INFO: Found listing with ID: BR31613
2026-03-28 12:05:17 [auto1.it] INFO: Found listing with ID: SG91000
2026-03-28 12:05:17 [auto1.it] INFO: Found listing with ID: SV61491
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV61491%27 HTTP/1.1" 200 None
2026-03-28 12:05:17 [auto1.it] INFO: Scrape type for SV61491: 2
2026-03-28 12:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb6b9b57-1721-571b-8922-eba0f943767c with identifier: SV61491
2026-03-28 12:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb6b9b57-1721-571b-8922-eba0f943767c with scrape type 2
2026-03-28 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb6b9b57-1721-571b-8922-eba0f943767c with scrape type 2
2026-03-28 12:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cb6b9b57-1721-571b-8922-eba0f943767c, identifier: SV61491
2026-03-28 12:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cb6b9b57-1721-571b-8922-eba0f943767c with identifier: SV61491
2026-03-28 12:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cb6b9b57-1721-571b-8922-eba0f943767c with identifier: SV61491
2026-03-28 12:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cb6b9b57-1721-571b-8922-eba0f943767c with identifier: SV61491 to the API
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-28T16:19:10Z',
'fuel_type': 'petrol',
'id': 'cb6b9b57-1721-571b-8922-eba0f943767c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV61491',
'listing': 'auction',
'make': 'Peugeot',
'model': '107',
'odometer': 80900,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-09',
'seller_name': None,
'title': 'Peugeot 107 1.0 Plasir',
'transmission': 'manual',
'trim': 'Plasir',
'year': 2009}
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV61491%27 HTTP/1.1" 200 None
2026-03-28 12:05:17 [auto1.it] INFO: Saving data for SV61491: {'auction_closing_time': 1774714750.0, 'created_time': 1774612928.502036, 'last_price_update_time': 1774699517.467118}
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SV61491') HTTP/1.1" 204 0
2026-03-28 12:05:17 [auto1.it] INFO: Found listing with ID: HZ92978
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ92978%27 HTTP/1.1" 200 None
2026-03-28 12:05:17 [auto1.it] INFO: Scrape type for HZ92978: 2
2026-03-28 12:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd542389-6f64-5744-8c6e-18b77cf82752 with identifier: HZ92978
2026-03-28 12:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd542389-6f64-5744-8c6e-18b77cf82752 with scrape type 2
2026-03-28 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd542389-6f64-5744-8c6e-18b77cf82752 with scrape type 2
2026-03-28 12:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bd542389-6f64-5744-8c6e-18b77cf82752, identifier: HZ92978
2026-03-28 12:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:17 [auto1.it] INFO: Found listing with ID: VF92770
2026-03-28 12:05:17 [auto1.it] INFO: Found listing with ID: AD83412
2026-03-28 12:05:17 [auto1.it] INFO: Found listing with ID: RF93024
2026-03-28 12:05:17 [auto1.it] INFO: Found listing with ID: PW70389
2026-03-28 12:05:17 [auto1.it] INFO: Found listing with ID: YD99116
2026-03-28 12:05:17 [auto1.it] INFO: Found listing with ID: HF24893
2026-03-28 12:05:17 [auto1.it] INFO: Found listing with ID: WP29588
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP29588%27 HTTP/1.1" 200 None
2026-03-28 12:05:17 [auto1.it] INFO: Scrape type for WP29588: 2
2026-03-28 12:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf2d018d-f89d-5855-8ead-76521d361513 with identifier: WP29588
2026-03-28 12:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf2d018d-f89d-5855-8ead-76521d361513 with scrape type 2
2026-03-28 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf2d018d-f89d-5855-8ead-76521d361513 with scrape type 2
2026-03-28 12:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf2d018d-f89d-5855-8ead-76521d361513, identifier: WP29588
2026-03-28 12:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bd542389-6f64-5744-8c6e-18b77cf82752 with identifier: HZ92978
2026-03-28 12:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bd542389-6f64-5744-8c6e-18b77cf82752 with identifier: HZ92978
2026-03-28 12:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bd542389-6f64-5744-8c6e-18b77cf82752 with identifier: HZ92978 to the API
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:32:17Z',
'fuel_type': 'diesel',
'id': 'bd542389-6f64-5744-8c6e-18b77cf82752',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ92978',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Range Rover Velar',
'odometer': 118476,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-23',
'seller_name': None,
'title': 'Land Rover Range Rover Velar 2.0 Diesel R-Dynamic S',
'transmission': 'automatic',
'trim': 'R-Dynamic S',
'year': 2019}
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ92978%27 HTTP/1.1" 200 None
2026-03-28 12:05:17 [auto1.it] INFO: Saving data for HZ92978: {'auction_closing_time': 1774715537.0, 'created_time': 1774613018.045045, 'last_price_update_time': 1774699517.956045}
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HZ92978') HTTP/1.1" 204 0
2026-03-28 12:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf2d018d-f89d-5855-8ead-76521d361513 with identifier: WP29588
2026-03-28 12:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf2d018d-f89d-5855-8ead-76521d361513 with identifier: WP29588
2026-03-28 12:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bf2d018d-f89d-5855-8ead-76521d361513 with identifier: WP29588 to the API
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:26:59Z',
'fuel_type': 'petrol',
'id': 'bf2d018d-f89d-5855-8ead-76521d361513',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP29588',
'listing': 'auction',
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 63682,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-31',
'seller_name': None,
'title': 'Lancia Ypsilon 1.2 Elefantino Blu',
'transmission': 'manual',
'trim': 'Elefantino Blu',
'year': 2019}
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP29588%27 HTTP/1.1" 200 None
2026-03-28 12:05:18 [auto1.it] INFO: Saving data for WP29588: {'auction_closing_time': 1774715219.0, 'created_time': 1774612870.35323, 'last_price_update_time': 1774699518.343532}
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WP29588') HTTP/1.1" 204 0
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: HZ65981
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ65981%27 HTTP/1.1" 200 None
2026-03-28 12:05:18 [auto1.it] INFO: Scrape type for HZ65981: 0
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: RT39388
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT39388%27 HTTP/1.1" 200 None
2026-03-28 12:05:18 [auto1.it] INFO: Scrape type for RT39388: 2
2026-03-28 12:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 997e1420-d6f0-502f-96ad-97d87b624304 with identifier: RT39388
2026-03-28 12:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 997e1420-d6f0-502f-96ad-97d87b624304 with scrape type 2
2026-03-28 12:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 997e1420-d6f0-502f-96ad-97d87b624304 with scrape type 2
2026-03-28 12:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 997e1420-d6f0-502f-96ad-97d87b624304, identifier: RT39388
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: VE26782
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: WL14524
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: PA28005
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA28005%27 HTTP/1.1" 200 None
2026-03-28 12:05:18 [auto1.it] INFO: Scrape type for PA28005: 2
2026-03-28 12:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b22f95a-a65a-5c28-9900-0055f8071fa3 with identifier: PA28005
2026-03-28 12:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b22f95a-a65a-5c28-9900-0055f8071fa3 with scrape type 2
2026-03-28 12:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b22f95a-a65a-5c28-9900-0055f8071fa3 with scrape type 2
2026-03-28 12:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2b22f95a-a65a-5c28-9900-0055f8071fa3, identifier: PA28005
2026-03-28 12:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 997e1420-d6f0-502f-96ad-97d87b624304 with identifier: RT39388
2026-03-28 12:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 997e1420-d6f0-502f-96ad-97d87b624304 with identifier: RT39388
2026-03-28 12:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 997e1420-d6f0-502f-96ad-97d87b624304 with identifier: RT39388 to the API
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-28T16:52:41Z',
'fuel_type': 'petrol',
'id': '997e1420-d6f0-502f-96ad-97d87b624304',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT39388',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 52456,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-09',
'seller_name': None,
'title': 'Citroen C3 1.2 e-VTi Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2015}
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT39388%27 HTTP/1.1" 200 None
2026-03-28 12:05:18 [auto1.it] INFO: Saving data for RT39388: {'auction_closing_time': 1774716761.0, 'created_time': 1774613019.391147, 'last_price_update_time': 1774699518.860898}
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT39388') HTTP/1.1" 204 0
2026-03-28 12:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2b22f95a-a65a-5c28-9900-0055f8071fa3 with identifier: PA28005
2026-03-28 12:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2b22f95a-a65a-5c28-9900-0055f8071fa3 with identifier: PA28005
2026-03-28 12:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2b22f95a-a65a-5c28-9900-0055f8071fa3 with identifier: PA28005 to the API
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:58:36Z',
'fuel_type': 'diesel',
'id': '2b22f95a-a65a-5c28-9900-0055f8071fa3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA28005',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 41448,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-22',
'seller_name': None,
'title': 'Dacia Duster 1.5 Blue dCi Extreme',
'transmission': 'manual',
'trim': 'Extreme',
'year': 2023}
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA28005%27 HTTP/1.1" 200 None
2026-03-28 12:05:19 [auto1.it] INFO: Saving data for PA28005: {'auction_closing_time': 1774717116.0, 'created_time': 1772626900.276114, 'last_price_update_time': 1774699519.847433}
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PA28005') HTTP/1.1" 204 0
2026-03-28 12:05:19 [auto1.it] INFO: Found listing with ID: SR58570
2026-03-28 12:05:19 [auto1.it] INFO: Found listing with ID: GJ43112
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ43112%27 HTTP/1.1" 200 None
2026-03-28 12:05:19 [auto1.it] INFO: Scrape type for GJ43112: 2
2026-03-28 12:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd3349f0-26aa-5d93-8a6f-612facbc600b with identifier: GJ43112
2026-03-28 12:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd3349f0-26aa-5d93-8a6f-612facbc600b with scrape type 2
2026-03-28 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd3349f0-26aa-5d93-8a6f-612facbc600b with scrape type 2
2026-03-28 12:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd3349f0-26aa-5d93-8a6f-612facbc600b, identifier: GJ43112
2026-03-28 12:05:19 [auto1.it] INFO: Found listing with ID: DN97608
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN97608%27 HTTP/1.1" 200 None
2026-03-28 12:05:19 [auto1.it] INFO: Scrape type for DN97608: 2
2026-03-28 12:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e77153e-36a7-5d80-8ced-435442c4b9f9 with identifier: DN97608
2026-03-28 12:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e77153e-36a7-5d80-8ced-435442c4b9f9 with scrape type 2
2026-03-28 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e77153e-36a7-5d80-8ced-435442c4b9f9 with scrape type 2
2026-03-28 12:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8e77153e-36a7-5d80-8ced-435442c4b9f9, identifier: DN97608
2026-03-28 12:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd3349f0-26aa-5d93-8a6f-612facbc600b with identifier: GJ43112
2026-03-28 12:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd3349f0-26aa-5d93-8a6f-612facbc600b with identifier: GJ43112
2026-03-28 12:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd3349f0-26aa-5d93-8a6f-612facbc600b with identifier: GJ43112 to the API
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:21:04Z',
'fuel_type': 'diesel',
'id': 'dd3349f0-26aa-5d93-8a6f-612facbc600b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ43112',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix35',
'odometer': 167350,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-27',
'seller_name': None,
'title': 'Hyundai ix35 1.7 CRDi XPossible 2WD',
'transmission': 'manual',
'trim': 'XPossible 2WD',
'year': 2014}
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ43112%27 HTTP/1.1" 200 None
2026-03-28 12:05:20 [auto1.it] INFO: Saving data for GJ43112: {'auction_closing_time': 1774714864.0, 'created_time': 1774613014.166777, 'last_price_update_time': 1774699520.536704}
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GJ43112') HTTP/1.1" 204 0
2026-03-28 12:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8e77153e-36a7-5d80-8ced-435442c4b9f9 with identifier: DN97608
2026-03-28 12:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8e77153e-36a7-5d80-8ced-435442c4b9f9 with identifier: DN97608
2026-03-28 12:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8e77153e-36a7-5d80-8ced-435442c4b9f9 with identifier: DN97608 to the API
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:28:33Z',
'fuel_type': 'diesel',
'id': '8e77153e-36a7-5d80-8ced-435442c4b9f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN97608',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 197683,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-23',
'seller_name': None,
'title': 'Renault Megane 1.9 dCi Luxe',
'transmission': 'manual',
'trim': 'Luxe',
'year': 2009}
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN97608%27 HTTP/1.1" 200 None
2026-03-28 12:05:20 [auto1.it] INFO: Saving data for DN97608: {'auction_closing_time': 1774715313.0, 'created_time': 1774612927.728241, 'last_price_update_time': 1774699520.948726}
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DN97608') HTTP/1.1" 204 0
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: PT96186
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT96186%27 HTTP/1.1" 200 None
2026-03-28 12:05:20 [auto1.it] INFO: Scrape type for PT96186: 2
2026-03-28 12:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0cbf325-20a1-52af-b345-6c3e1fa7a5d8 with identifier: PT96186
2026-03-28 12:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0cbf325-20a1-52af-b345-6c3e1fa7a5d8 with scrape type 2
2026-03-28 12:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0cbf325-20a1-52af-b345-6c3e1fa7a5d8 with scrape type 2
2026-03-28 12:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c0cbf325-20a1-52af-b345-6c3e1fa7a5d8, identifier: PT96186
2026-03-28 12:05:21 [auto1.it] INFO: Found listing with ID: JU37769
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU37769%27 HTTP/1.1" 200 None
2026-03-28 12:05:21 [auto1.it] INFO: Scrape type for JU37769: 2
2026-03-28 12:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce33f235-a8d9-5d74-b431-d4b0cac1c405 with identifier: JU37769
2026-03-28 12:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce33f235-a8d9-5d74-b431-d4b0cac1c405 with scrape type 2
2026-03-28 12:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce33f235-a8d9-5d74-b431-d4b0cac1c405 with scrape type 2
2026-03-28 12:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ce33f235-a8d9-5d74-b431-d4b0cac1c405, identifier: JU37769
2026-03-28 12:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c0cbf325-20a1-52af-b345-6c3e1fa7a5d8 with identifier: PT96186
2026-03-28 12:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c0cbf325-20a1-52af-b345-6c3e1fa7a5d8 with identifier: PT96186
2026-03-28 12:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c0cbf325-20a1-52af-b345-6c3e1fa7a5d8 with identifier: PT96186 to the API
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:58:36Z',
'fuel_type': 'diesel',
'id': 'c0cbf325-20a1-52af-b345-6c3e1fa7a5d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT96186',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 226099,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-10-31',
'seller_name': None,
'title': 'MINI Cooper D',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT96186%27 HTTP/1.1" 200 None
2026-03-28 12:05:21 [auto1.it] INFO: Saving data for PT96186: {'auction_closing_time': 1774717116.0, 'created_time': 1774613014.865094, 'last_price_update_time': 1774699521.440856}
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PT96186') HTTP/1.1" 204 0
2026-03-28 12:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ce33f235-a8d9-5d74-b431-d4b0cac1c405 with identifier: JU37769
2026-03-28 12:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ce33f235-a8d9-5d74-b431-d4b0cac1c405 with identifier: JU37769
2026-03-28 12:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ce33f235-a8d9-5d74-b431-d4b0cac1c405 with identifier: JU37769 to the API
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:56:17Z',
'fuel_type': 'petrol',
'id': 'ce33f235-a8d9-5d74-b431-d4b0cac1c405',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU37769',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 74247,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-26',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.0 eTSI Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2021}
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU37769%27 HTTP/1.1" 200 None
2026-03-28 12:05:21 [auto1.it] INFO: Saving data for JU37769: {'auction_closing_time': 1774716977.0, 'created_time': 1774612939.486404, 'last_price_update_time': 1774699521.725189}
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JU37769') HTTP/1.1" 204 0
2026-03-28 12:05:21 [auto1.it] INFO: Found listing with ID: ZS94509
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS94509%27 HTTP/1.1" 200 None
2026-03-28 12:05:21 [auto1.it] INFO: Scrape type for ZS94509: 2
2026-03-28 12:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82180cd6-b916-5eae-ada2-906dfca73674 with identifier: ZS94509
2026-03-28 12:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82180cd6-b916-5eae-ada2-906dfca73674 with scrape type 2
2026-03-28 12:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82180cd6-b916-5eae-ada2-906dfca73674 with scrape type 2
2026-03-28 12:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 82180cd6-b916-5eae-ada2-906dfca73674, identifier: ZS94509
2026-03-28 12:05:21 [auto1.it] INFO: Found listing with ID: EC29909
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC29909%27 HTTP/1.1" 200 None
2026-03-28 12:05:21 [auto1.it] INFO: Scrape type for EC29909: 2
2026-03-28 12:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30f8439d-540c-5362-ab07-d6b3da3c822b with identifier: EC29909
2026-03-28 12:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f8439d-540c-5362-ab07-d6b3da3c822b with scrape type 2
2026-03-28 12:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30f8439d-540c-5362-ab07-d6b3da3c822b with scrape type 2
2026-03-28 12:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 30f8439d-540c-5362-ab07-d6b3da3c822b, identifier: EC29909
2026-03-28 12:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 82180cd6-b916-5eae-ada2-906dfca73674 with identifier: ZS94509
2026-03-28 12:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 82180cd6-b916-5eae-ada2-906dfca73674 with identifier: ZS94509
2026-03-28 12:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 82180cd6-b916-5eae-ada2-906dfca73674 with identifier: ZS94509 to the API
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:32:01Z',
'fuel_type': 'diesel',
'id': '82180cd6-b916-5eae-ada2-906dfca73674',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS94509',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Freelander',
'odometer': 254458,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-16',
'seller_name': None,
'title': 'Land Rover Freelander 2.2 Sd4 SD4_SE_Experience',
'transmission': 'automatic',
'trim': 'SD4_SE_Experience',
'year': 2012}
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS94509%27 HTTP/1.1" 200 None
2026-03-28 12:05:22 [auto1.it] INFO: Saving data for ZS94509: {'auction_closing_time': 1774715521.0, 'created_time': 1772178961.561372, 'last_price_update_time': 1774699522.233828}
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZS94509') HTTP/1.1" 204 0
2026-03-28 12:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 30f8439d-540c-5362-ab07-d6b3da3c822b with identifier: EC29909
2026-03-28 12:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 30f8439d-540c-5362-ab07-d6b3da3c822b with identifier: EC29909
2026-03-28 12:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 30f8439d-540c-5362-ab07-d6b3da3c822b with identifier: EC29909 to the API
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:44:29Z',
'fuel_type': 'diesel',
'id': '30f8439d-540c-5362-ab07-d6b3da3c822b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC29909',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 265564,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-02',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2010}
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC29909%27 HTTP/1.1" 200 None
2026-03-28 12:05:22 [auto1.it] INFO: Saving data for EC29909: {'auction_closing_time': 1774716269.0, 'created_time': 1774613014.494298, 'last_price_update_time': 1774699522.618399}
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EC29909') HTTP/1.1" 204 0
2026-03-28 12:05:22 [auto1.it] INFO: Found listing with ID: XF95831
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF95831%27 HTTP/1.1" 200 None
2026-03-28 12:05:22 [auto1.it] INFO: Scrape type for XF95831: 2
2026-03-28 12:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cab0477e-97c6-5205-8a3a-67ba90f13207 with identifier: XF95831
2026-03-28 12:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cab0477e-97c6-5205-8a3a-67ba90f13207 with scrape type 2
2026-03-28 12:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cab0477e-97c6-5205-8a3a-67ba90f13207 with scrape type 2
2026-03-28 12:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cab0477e-97c6-5205-8a3a-67ba90f13207, identifier: XF95831
2026-03-28 12:05:22 [auto1.it] INFO: Found listing with ID: AU78491
2026-03-28 12:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cab0477e-97c6-5205-8a3a-67ba90f13207 with identifier: XF95831
2026-03-28 12:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cab0477e-97c6-5205-8a3a-67ba90f13207 with identifier: XF95831
2026-03-28 12:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cab0477e-97c6-5205-8a3a-67ba90f13207 with identifier: XF95831 to the API
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:36:22Z',
'fuel_type': 'petrol',
'id': 'cab0477e-97c6-5205-8a3a-67ba90f13207',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF95831',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 243158,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-07',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF95831%27 HTTP/1.1" 200 None
2026-03-28 12:05:23 [auto1.it] INFO: Saving data for XF95831: {'auction_closing_time': 1774715782.0, 'created_time': 1773130612.667234, 'last_price_update_time': 1774699523.037813}
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XF95831') HTTP/1.1" 204 0
2026-03-28 12:05:23 [auto1.it] INFO: Found listing with ID: HW38972
2026-03-28 12:05:23 [auto1.it] INFO: Found listing with ID: TX96321
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX96321%27 HTTP/1.1" 200 None
2026-03-28 12:05:23 [auto1.it] INFO: Scrape type for TX96321: 2
2026-03-28 12:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fcb0753-e489-551e-a1f4-a8e8141c4614 with identifier: TX96321
2026-03-28 12:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fcb0753-e489-551e-a1f4-a8e8141c4614 with scrape type 2
2026-03-28 12:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fcb0753-e489-551e-a1f4-a8e8141c4614 with scrape type 2
2026-03-28 12:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0fcb0753-e489-551e-a1f4-a8e8141c4614, identifier: TX96321
2026-03-28 12:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0fcb0753-e489-551e-a1f4-a8e8141c4614 with identifier: TX96321
2026-03-28 12:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0fcb0753-e489-551e-a1f4-a8e8141c4614 with identifier: TX96321
2026-03-28 12:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0fcb0753-e489-551e-a1f4-a8e8141c4614 with identifier: TX96321 to the API
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 250,
'expiration_date': '2026-03-28T16:05:44Z',
'fuel_type': 'diesel',
'id': '0fcb0753-e489-551e-a1f4-a8e8141c4614',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX96321',
'listing': 'auction',
'make': 'Maserati',
'model': 'Levante',
'odometer': 146126,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-31',
'seller_name': None,
'title': 'Maserati Levante 3.0 V6 Diesel',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX96321%27 HTTP/1.1" 200 None
2026-03-28 12:05:23 [auto1.it] INFO: Saving data for TX96321: {'auction_closing_time': 1774713944.0, 'created_time': 1772265705.696863, 'last_price_update_time': 1774699523.462223}
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TX96321') HTTP/1.1" 204 0
2026-03-28 12:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:23 [auto1.it] INFO: Found listing with ID: YD44226
2026-03-28 12:05:23 [auto1.it] INFO: Found listing with ID: RX07844
2026-03-28 12:05:23 [auto1.it] INFO: Found listing with ID: YS49191
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS49191%27 HTTP/1.1" 200 None
2026-03-28 12:05:23 [auto1.it] INFO: Scrape type for YS49191: 0
2026-03-28 12:05:23 [auto1.it] INFO: Found listing with ID: EF98667
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF98667%27 HTTP/1.1" 200 None
2026-03-28 12:05:23 [auto1.it] INFO: Scrape type for EF98667: 0
2026-03-28 12:05:23 [auto1.it] INFO: Found listing with ID: AR12639
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR12639%27 HTTP/1.1" 200 None
2026-03-28 12:05:23 [auto1.it] INFO: Scrape type for AR12639: 0
2026-03-28 12:05:23 [auto1.it] INFO: Found listing with ID: XC85106
2026-03-28 12:05:23 [auto1.it] INFO: Found listing with ID: GX81106
2026-03-28 12:05:23 [auto1.it] INFO: Found listing with ID: WM75200
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM75200%27 HTTP/1.1" 200 None
2026-03-28 12:05:23 [auto1.it] INFO: Scrape type for WM75200: 2
2026-03-28 12:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92c2d324-9e2b-5aee-842a-bb7be8a179df with identifier: WM75200
2026-03-28 12:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92c2d324-9e2b-5aee-842a-bb7be8a179df with scrape type 2
2026-03-28 12:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92c2d324-9e2b-5aee-842a-bb7be8a179df with scrape type 2
2026-03-28 12:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 92c2d324-9e2b-5aee-842a-bb7be8a179df, identifier: WM75200
2026-03-28 12:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 92c2d324-9e2b-5aee-842a-bb7be8a179df with identifier: WM75200
2026-03-28 12:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 92c2d324-9e2b-5aee-842a-bb7be8a179df with identifier: WM75200
2026-03-28 12:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 92c2d324-9e2b-5aee-842a-bb7be8a179df with identifier: WM75200 to the API
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:26:00Z',
'fuel_type': 'diesel',
'id': '92c2d324-9e2b-5aee-842a-bb7be8a179df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM75200',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 301025,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-11',
'seller_name': None,
'title': 'BMW X1 xDrive 18d Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2017}
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM75200%27 HTTP/1.1" 200 None
2026-03-28 12:05:23 [auto1.it] INFO: Saving data for WM75200: {'auction_closing_time': 1774715160.0, 'created_time': 1774613012.514717, 'last_price_update_time': 1774699523.916042}
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WM75200') HTTP/1.1" 204 0
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: WE98269
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE98269%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [auto1.it] INFO: Scrape type for WE98269: 2
2026-03-28 12:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7cab052-39ca-513d-b6e8-ecf98619f762 with identifier: WE98269
2026-03-28 12:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7cab052-39ca-513d-b6e8-ecf98619f762 with scrape type 2
2026-03-28 12:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7cab052-39ca-513d-b6e8-ecf98619f762 with scrape type 2
2026-03-28 12:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d7cab052-39ca-513d-b6e8-ecf98619f762, identifier: WE98269
2026-03-28 12:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d7cab052-39ca-513d-b6e8-ecf98619f762 with identifier: WE98269
2026-03-28 12:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d7cab052-39ca-513d-b6e8-ecf98619f762 with identifier: WE98269
2026-03-28 12:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d7cab052-39ca-513d-b6e8-ecf98619f762 with identifier: WE98269 to the API
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-28T16:14:44Z',
'fuel_type': 'hybrid',
'id': 'd7cab052-39ca-513d-b6e8-ecf98619f762',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE98269',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 43326,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-16',
'seller_name': None,
'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2023}
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE98269%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [auto1.it] INFO: Saving data for WE98269: {'auction_closing_time': 1774714484.0, 'created_time': 1774613016.168745, 'last_price_update_time': 1774699524.48476}
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WE98269') HTTP/1.1" 204 0
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: NH13553
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: CU15371
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: BN52557
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: EA61163
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA61163%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [auto1.it] INFO: Scrape type for EA61163: 2
2026-03-28 12:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afd87f77-ae0b-5c4d-96aa-296c1c3b520a with identifier: EA61163
2026-03-28 12:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afd87f77-ae0b-5c4d-96aa-296c1c3b520a with scrape type 2
2026-03-28 12:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afd87f77-ae0b-5c4d-96aa-296c1c3b520a with scrape type 2
2026-03-28 12:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: afd87f77-ae0b-5c4d-96aa-296c1c3b520a, identifier: EA61163
2026-03-28 12:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: afd87f77-ae0b-5c4d-96aa-296c1c3b520a with identifier: EA61163
2026-03-28 12:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: afd87f77-ae0b-5c4d-96aa-296c1c3b520a with identifier: EA61163
2026-03-28 12:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: afd87f77-ae0b-5c4d-96aa-296c1c3b520a with identifier: EA61163 to the API
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:54:04Z',
'fuel_type': 'diesel',
'id': 'afd87f77-ae0b-5c4d-96aa-296c1c3b520a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA61163',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 43773,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-29',
'seller_name': None,
'title': 'Peugeot 5008 1.5 Blue-HDi Allure Pack',
'transmission': 'automatic',
'trim': 'Allure Pack',
'year': 2021}
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA61163%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [auto1.it] INFO: Saving data for EA61163: {'auction_closing_time': 1774716844.0, 'created_time': 1773954506.181532, 'last_price_update_time': 1774699524.870885}
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EA61163') HTTP/1.1" 204 0
2026-03-28 12:05:24 [auto1.it] INFO: Channel: 24h | Page: 74 | totalHits: 3673 | hits on page: 40
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: PU90509
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU90509%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [auto1.it] INFO: Scrape type for PU90509: 2
2026-03-28 12:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fe2e5e3-5fa4-5968-9fd1-3fbbe45e5c3d with identifier: PU90509
2026-03-28 12:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fe2e5e3-5fa4-5968-9fd1-3fbbe45e5c3d with scrape type 2
2026-03-28 12:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fe2e5e3-5fa4-5968-9fd1-3fbbe45e5c3d with scrape type 2
2026-03-28 12:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7fe2e5e3-5fa4-5968-9fd1-3fbbe45e5c3d, identifier: PU90509
2026-03-28 12:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7fe2e5e3-5fa4-5968-9fd1-3fbbe45e5c3d with identifier: PU90509
2026-03-28 12:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7fe2e5e3-5fa4-5968-9fd1-3fbbe45e5c3d with identifier: PU90509
2026-03-28 12:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7fe2e5e3-5fa4-5968-9fd1-3fbbe45e5c3d with identifier: PU90509 to the API
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:47:04Z',
'fuel_type': 'diesel',
'id': '7fe2e5e3-5fa4-5968-9fd1-3fbbe45e5c3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU90509',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 242498,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-17',
'seller_name': None,
'title': 'Kia Sportage 2.0 CRDi Pure 4WD',
'transmission': 'manual',
'trim': 'Pure 4WD',
'year': 2015}
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU90509%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [auto1.it] INFO: Saving data for PU90509: {'auction_closing_time': 1774716424.0, 'created_time': 1774612878.153979, 'last_price_update_time': 1774699525.276707}
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PU90509') HTTP/1.1" 204 0
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: RA11036
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA11036%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [auto1.it] INFO: Scrape type for RA11036: 2
2026-03-28 12:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ea8154a-af00-5249-b9cb-f3bd3b74d58a with identifier: RA11036
2026-03-28 12:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea8154a-af00-5249-b9cb-f3bd3b74d58a with scrape type 2
2026-03-28 12:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ea8154a-af00-5249-b9cb-f3bd3b74d58a with scrape type 2
2026-03-28 12:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2ea8154a-af00-5249-b9cb-f3bd3b74d58a, identifier: RA11036
2026-03-28 12:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: RB23819
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB23819%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [auto1.it] INFO: Scrape type for RB23819: 2
2026-03-28 12:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d1ab6d0-2f08-527e-a6ef-3a2eb5f30631 with identifier: RB23819
2026-03-28 12:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d1ab6d0-2f08-527e-a6ef-3a2eb5f30631 with scrape type 2
2026-03-28 12:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d1ab6d0-2f08-527e-a6ef-3a2eb5f30631 with scrape type 2
2026-03-28 12:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2d1ab6d0-2f08-527e-a6ef-3a2eb5f30631, identifier: RB23819
2026-03-28 12:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2ea8154a-af00-5249-b9cb-f3bd3b74d58a with identifier: RA11036
2026-03-28 12:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2ea8154a-af00-5249-b9cb-f3bd3b74d58a with identifier: RA11036
2026-03-28 12:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2ea8154a-af00-5249-b9cb-f3bd3b74d58a with identifier: RA11036 to the API
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:07:35Z',
'fuel_type': 'diesel',
'id': '2ea8154a-af00-5249-b9cb-f3bd3b74d58a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA11036',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 136468,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-26',
'seller_name': None,
'title': 'Hyundai Kona 1.6 CRDi XTech 2WD',
'transmission': 'manual',
'trim': 'XTech 2WD',
'year': 2020}
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA11036%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [auto1.it] INFO: Saving data for RA11036: {'auction_closing_time': 1774714055.0, 'created_time': 1774612914.257906, 'last_price_update_time': 1774699525.777485}
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RA11036') HTTP/1.1" 204 0
2026-03-28 12:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2d1ab6d0-2f08-527e-a6ef-3a2eb5f30631 with identifier: RB23819
2026-03-28 12:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2d1ab6d0-2f08-527e-a6ef-3a2eb5f30631 with identifier: RB23819
2026-03-28 12:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2d1ab6d0-2f08-527e-a6ef-3a2eb5f30631 with identifier: RB23819 to the API
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:18:19Z',
'fuel_type': 'diesel',
'id': '2d1ab6d0-2f08-527e-a6ef-3a2eb5f30631',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB23819',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 154695,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-14',
'seller_name': None,
'title': 'MINI Countryman Cooper D',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB23819%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [auto1.it] INFO: Saving data for RB23819: {'auction_closing_time': 1774714699.0, 'created_time': 1774612921.157, 'last_price_update_time': 1774699526.053518}
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RB23819') HTTP/1.1" 204 0
2026-03-28 12:05:26 [auto1.it] INFO: Found listing with ID: YY46039
2026-03-28 12:05:26 [auto1.it] INFO: Found listing with ID: XX32057
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX32057%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [auto1.it] INFO: Scrape type for XX32057: 2
2026-03-28 12:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe381e94-c5f8-5f01-8ce9-cf3b407336b1 with identifier: XX32057
2026-03-28 12:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe381e94-c5f8-5f01-8ce9-cf3b407336b1 with scrape type 2
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe381e94-c5f8-5f01-8ce9-cf3b407336b1 with scrape type 2
2026-03-28 12:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fe381e94-c5f8-5f01-8ce9-cf3b407336b1, identifier: XX32057
2026-03-28 12:05:26 [auto1.it] INFO: Found listing with ID: HT95885
2026-03-28 12:05:26 [auto1.it] INFO: Found listing with ID: EA76192
2026-03-28 12:05:26 [auto1.it] INFO: Found listing with ID: HK62879
2026-03-28 12:05:26 [auto1.it] INFO: Found listing with ID: UW31013
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW31013%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [auto1.it] INFO: Scrape type for UW31013: 2
2026-03-28 12:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daf5df35-d378-5410-905d-7ac0947166a8 with identifier: UW31013
2026-03-28 12:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daf5df35-d378-5410-905d-7ac0947166a8 with scrape type 2
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daf5df35-d378-5410-905d-7ac0947166a8 with scrape type 2
2026-03-28 12:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: daf5df35-d378-5410-905d-7ac0947166a8, identifier: UW31013
2026-03-28 12:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fe381e94-c5f8-5f01-8ce9-cf3b407336b1 with identifier: XX32057
2026-03-28 12:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fe381e94-c5f8-5f01-8ce9-cf3b407336b1 with identifier: XX32057
2026-03-28 12:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fe381e94-c5f8-5f01-8ce9-cf3b407336b1 with identifier: XX32057 to the API
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 286,
'expiration_date': '2026-03-28T16:19:10Z',
'fuel_type': 'diesel',
'id': 'fe381e94-c5f8-5f01-8ce9-cf3b407336b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX32057',
'listing': 'auction',
'make': 'BMW',
'model': 'X6',
'odometer': 103052,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-22',
'seller_name': None,
'title': 'BMW X6 xDrive 30d Mild-Hybrid xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2020}
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX32057%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [auto1.it] INFO: Saving data for XX32057: {'auction_closing_time': 1774714750.0, 'created_time': 1774612885.492085, 'last_price_update_time': 1774699526.551534}
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XX32057') HTTP/1.1" 204 0
2026-03-28 12:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: daf5df35-d378-5410-905d-7ac0947166a8 with identifier: UW31013
2026-03-28 12:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: daf5df35-d378-5410-905d-7ac0947166a8 with identifier: UW31013
2026-03-28 12:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: daf5df35-d378-5410-905d-7ac0947166a8 with identifier: UW31013 to the API
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:20:43Z',
'fuel_type': 'diesel',
'id': 'daf5df35-d378-5410-905d-7ac0947166a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW31013',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 199328,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-26',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Style',
'transmission': 'manual',
'trim': 'BlueEfficiency Style',
'year': 2015}
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW31013%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [auto1.it] INFO: Saving data for UW31013: {'auction_closing_time': 1774714843.0, 'created_time': 1774612916.870548, 'last_price_update_time': 1774699526.935592}
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UW31013') HTTP/1.1" 204 0
2026-03-28 12:05:26 [auto1.it] INFO: Found listing with ID: YL89014
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL89014%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [auto1.it] INFO: Scrape type for YL89014: 2
2026-03-28 12:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1 with identifier: YL89014
2026-03-28 12:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1 with scrape type 2
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1 with scrape type 2
2026-03-28 12:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1, identifier: YL89014
2026-03-28 12:05:27 [auto1.it] INFO: Found listing with ID: MV48834
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV48834%27 HTTP/1.1" 200 None
2026-03-28 12:05:27 [auto1.it] INFO: Scrape type for MV48834: 2
2026-03-28 12:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9ff284a-47f8-5418-a9a2-608650acd42d with identifier: MV48834
2026-03-28 12:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9ff284a-47f8-5418-a9a2-608650acd42d with scrape type 2
2026-03-28 12:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9ff284a-47f8-5418-a9a2-608650acd42d with scrape type 2
2026-03-28 12:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f9ff284a-47f8-5418-a9a2-608650acd42d, identifier: MV48834
2026-03-28 12:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1 with identifier: YL89014
2026-03-28 12:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1 with identifier: YL89014
2026-03-28 12:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1 with identifier: YL89014 to the API
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:55:29Z',
'fuel_type': 'diesel',
'id': '40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL89014',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 143777,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-23',
'seller_name': None,
'title': 'Dacia Sandero 1.5 dCi La Gazzetta dello Sport',
'transmission': 'manual',
'trim': 'La Gazzetta dello Sport',
'year': 2016}
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL89014%27 HTTP/1.1" 200 None
2026-03-28 12:05:27 [auto1.it] INFO: Saving data for YL89014: {'auction_closing_time': 1774716929.0, 'created_time': 1774612907.082924, 'last_price_update_time': 1774699527.484931}
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YL89014') HTTP/1.1" 204 0
2026-03-28 12:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f9ff284a-47f8-5418-a9a2-608650acd42d with identifier: MV48834
2026-03-28 12:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f9ff284a-47f8-5418-a9a2-608650acd42d with identifier: MV48834
2026-03-28 12:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f9ff284a-47f8-5418-a9a2-608650acd42d with identifier: MV48834 to the API
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:35:43Z',
'fuel_type': 'petrol',
'id': 'f9ff284a-47f8-5418-a9a2-608650acd42d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV48834',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 151859,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-21',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2013}
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV48834%27 HTTP/1.1" 200 None
2026-03-28 12:05:27 [auto1.it] INFO: Saving data for MV48834: {'auction_closing_time': 1774715743.0, 'created_time': 1774612925.647068, 'last_price_update_time': 1774699527.783281}
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MV48834') HTTP/1.1" 204 0
2026-03-28 12:05:27 [auto1.it] INFO: Found listing with ID: HM08879
2026-03-28 12:05:27 [auto1.it] INFO: Found listing with ID: FP35914
2026-03-28 12:05:27 [auto1.it] INFO: Found listing with ID: GC53002
2026-03-28 12:05:27 [auto1.it] INFO: Found listing with ID: YB89619
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB89619%27 HTTP/1.1" 200 None
2026-03-28 12:05:27 [auto1.it] INFO: Scrape type for YB89619: 2
2026-03-28 12:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d86afe84-d81f-5ffa-aa63-e4e90d102dc2 with identifier: YB89619
2026-03-28 12:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d86afe84-d81f-5ffa-aa63-e4e90d102dc2 with scrape type 2
2026-03-28 12:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d86afe84-d81f-5ffa-aa63-e4e90d102dc2 with scrape type 2
2026-03-28 12:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d86afe84-d81f-5ffa-aa63-e4e90d102dc2, identifier: YB89619
2026-03-28 12:05:27 [auto1.it] INFO: Found listing with ID: LE49462
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE49462%27 HTTP/1.1" 200 None
2026-03-28 12:05:27 [auto1.it] INFO: Scrape type for LE49462: 2
2026-03-28 12:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7dbb56b-0c7d-5bd4-bd97-1cb360fe0169 with identifier: LE49462
2026-03-28 12:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7dbb56b-0c7d-5bd4-bd97-1cb360fe0169 with scrape type 2
2026-03-28 12:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7dbb56b-0c7d-5bd4-bd97-1cb360fe0169 with scrape type 2
2026-03-28 12:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f7dbb56b-0c7d-5bd4-bd97-1cb360fe0169, identifier: LE49462
2026-03-28 12:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d86afe84-d81f-5ffa-aa63-e4e90d102dc2 with identifier: YB89619
2026-03-28 12:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d86afe84-d81f-5ffa-aa63-e4e90d102dc2 with identifier: YB89619
2026-03-28 12:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d86afe84-d81f-5ffa-aa63-e4e90d102dc2 with identifier: YB89619 to the API
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:19:46Z',
'fuel_type': 'diesel',
'id': 'd86afe84-d81f-5ffa-aa63-e4e90d102dc2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB89619',
'listing': 'auction',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 228259,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-14',
'seller_name': None,
'title': 'Nissan X-Trail 2.0 dCi Tekna 4x4',
'transmission': 'automatic',
'trim': 'Tekna 4x4',
'year': 2017}
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB89619%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [auto1.it] INFO: Saving data for YB89619: {'auction_closing_time': 1774714786.0, 'created_time': 1774612882.827056, 'last_price_update_time': 1774699528.344124}
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YB89619') HTTP/1.1" 204 0
2026-03-28 12:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f7dbb56b-0c7d-5bd4-bd97-1cb360fe0169 with identifier: LE49462
2026-03-28 12:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f7dbb56b-0c7d-5bd4-bd97-1cb360fe0169 with identifier: LE49462
2026-03-28 12:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f7dbb56b-0c7d-5bd4-bd97-1cb360fe0169 with identifier: LE49462 to the API
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 107,
'expiration_date': '2026-03-28T16:52:32Z',
'fuel_type': 'petrol',
'id': 'f7dbb56b-0c7d-5bd4-bd97-1cb360fe0169',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE49462',
'listing': 'auction',
'make': 'Fiat',
'model': 'Sedici',
'odometer': 171752,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-30',
'seller_name': None,
'title': 'Fiat Sedici 1.6 Dynamic 4x4',
'transmission': 'manual',
'trim': 'Dynamic 4x4',
'year': 2008}
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE49462%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [auto1.it] INFO: Saving data for LE49462: {'auction_closing_time': 1774716752.0, 'created_time': 1772627786.95853, 'last_price_update_time': 1774699528.650859}
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LE49462') HTTP/1.1" 204 0
2026-03-28 12:05:28 [auto1.it] INFO: Found listing with ID: FV19054
2026-03-28 12:05:28 [auto1.it] INFO: Found listing with ID: CU49337
2026-03-28 12:05:28 [auto1.it] INFO: Found listing with ID: DK62006
2026-03-28 12:05:28 [auto1.it] INFO: Found listing with ID: SR32433
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR32433%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [auto1.it] INFO: Scrape type for SR32433: 2
2026-03-28 12:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf38b00d-17f6-5e02-80b6-657f3f670a50 with identifier: SR32433
2026-03-28 12:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf38b00d-17f6-5e02-80b6-657f3f670a50 with scrape type 2
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf38b00d-17f6-5e02-80b6-657f3f670a50 with scrape type 2
2026-03-28 12:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf38b00d-17f6-5e02-80b6-657f3f670a50, identifier: SR32433
2026-03-28 12:05:28 [auto1.it] INFO: Found listing with ID: TK35909
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK35909%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [auto1.it] INFO: Scrape type for TK35909: 0
2026-03-28 12:05:28 [auto1.it] INFO: Found listing with ID: CA37263
2026-03-28 12:05:28 [auto1.it] INFO: Found listing with ID: VY80184
2026-03-28 12:05:28 [auto1.it] INFO: Found listing with ID: CB33793
2026-03-28 12:05:28 [auto1.it] INFO: Found listing with ID: XV63353
2026-03-28 12:05:28 [auto1.it] INFO: Found listing with ID: VS63057
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS63057%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [auto1.it] INFO: Scrape type for VS63057: 2
2026-03-28 12:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec with identifier: VS63057
2026-03-28 12:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec with scrape type 2
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec with scrape type 2
2026-03-28 12:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec, identifier: VS63057
2026-03-28 12:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf38b00d-17f6-5e02-80b6-657f3f670a50 with identifier: SR32433
2026-03-28 12:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf38b00d-17f6-5e02-80b6-657f3f670a50 with identifier: SR32433
2026-03-28 12:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bf38b00d-17f6-5e02-80b6-657f3f670a50 with identifier: SR32433 to the API
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:22:19Z',
'fuel_type': 'diesel',
'id': 'bf38b00d-17f6-5e02-80b6-657f3f670a50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR32433',
'listing': 'auction',
'make': 'Honda',
'model': 'CR-V',
'odometer': 262411,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-31',
'seller_name': None,
'title': 'Honda CR-V 1.6 DTEC Lifestyle 4WD',
'transmission': 'manual',
'trim': 'Lifestyle 4WD',
'year': 2016}
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR32433%27 HTTP/1.1" 200 None
2026-03-28 12:05:29 [auto1.it] INFO: Saving data for SR32433: {'auction_closing_time': 1774714939.0, 'created_time': 1774612956.74362, 'last_price_update_time': 1774699529.359732}
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SR32433') HTTP/1.1" 204 0
2026-03-28 12:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec with identifier: VS63057
2026-03-28 12:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec with identifier: VS63057
2026-03-28 12:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec with identifier: VS63057 to the API
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:04:27Z',
'fuel_type': 'diesel',
'id': 'bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS63057',
'listing': 'auction',
'make': 'Fiat',
'model': '500L',
'odometer': 174647,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-04',
'seller_name': None,
'title': 'Fiat 500L 1.3 M-Jet Trekking',
'transmission': 'manual',
'trim': 'Trekking',
'year': 2017}
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS63057%27 HTTP/1.1" 200 None
2026-03-28 12:05:29 [auto1.it] INFO: Saving data for VS63057: {'auction_closing_time': 1774713867.0, 'created_time': 1774612897.013592, 'last_price_update_time': 1774699529.934408}
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VS63057') HTTP/1.1" 204 0
2026-03-28 12:05:29 [auto1.it] INFO: Found listing with ID: BA09093
2026-03-28 12:05:29 [auto1.it] INFO: Found listing with ID: BR57787
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR57787%27 HTTP/1.1" 200 None
2026-03-28 12:05:29 [auto1.it] INFO: Scrape type for BR57787: 0
2026-03-28 12:05:29 [auto1.it] INFO: Found listing with ID: TY97368
2026-03-28 12:05:29 [auto1.it] INFO: Found listing with ID: GV26258
2026-03-28 12:05:29 [auto1.it] INFO: Found listing with ID: VY84485
2026-03-28 12:05:29 [auto1.it] INFO: Found listing with ID: ZX85690
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX85690%27 HTTP/1.1" 200 None
2026-03-28 12:05:29 [auto1.it] INFO: Scrape type for ZX85690: 2
2026-03-28 12:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ede879e-c660-5a53-bb0e-c8982002976b with identifier: ZX85690
2026-03-28 12:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ede879e-c660-5a53-bb0e-c8982002976b with scrape type 2
2026-03-28 12:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ede879e-c660-5a53-bb0e-c8982002976b with scrape type 2
2026-03-28 12:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9ede879e-c660-5a53-bb0e-c8982002976b, identifier: ZX85690
2026-03-28 12:05:30 [auto1.it] INFO: Found listing with ID: KB12646
2026-03-28 12:05:30 [auto1.it] INFO: Found listing with ID: PX76093
2026-03-28 12:05:30 [auto1.it] INFO: Found listing with ID: VF62325
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF62325%27 HTTP/1.1" 200 None
2026-03-28 12:05:30 [auto1.it] INFO: Scrape type for VF62325: 2
2026-03-28 12:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a39db335-ea9c-5ca7-bda3-db6c2adce7ff with identifier: VF62325
2026-03-28 12:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a39db335-ea9c-5ca7-bda3-db6c2adce7ff with scrape type 2
2026-03-28 12:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a39db335-ea9c-5ca7-bda3-db6c2adce7ff with scrape type 2
2026-03-28 12:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a39db335-ea9c-5ca7-bda3-db6c2adce7ff, identifier: VF62325
2026-03-28 12:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9ede879e-c660-5a53-bb0e-c8982002976b with identifier: ZX85690
2026-03-28 12:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9ede879e-c660-5a53-bb0e-c8982002976b with identifier: ZX85690
2026-03-28 12:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9ede879e-c660-5a53-bb0e-c8982002976b with identifier: ZX85690 to the API
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:38:01Z',
'fuel_type': 'petrol',
'id': '9ede879e-c660-5a53-bb0e-c8982002976b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX85690',
'listing': 'auction',
'make': 'Mazda',
'model': '2',
'odometer': 69532,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-14',
'seller_name': None,
'title': 'Mazda 2 1.5 Evolve',
'transmission': 'manual',
'trim': 'Evolve',
'year': 2019}
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX85690%27 HTTP/1.1" 200 None
2026-03-28 12:05:30 [auto1.it] INFO: Saving data for ZX85690: {'auction_closing_time': 1774715881.0, 'created_time': 1772222511.831001, 'last_price_update_time': 1774699530.651255}
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZX85690') HTTP/1.1" 204 0
2026-03-28 12:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a39db335-ea9c-5ca7-bda3-db6c2adce7ff with identifier: VF62325
2026-03-28 12:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a39db335-ea9c-5ca7-bda3-db6c2adce7ff with identifier: VF62325
2026-03-28 12:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a39db335-ea9c-5ca7-bda3-db6c2adce7ff with identifier: VF62325 to the API
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:15:09Z',
'fuel_type': 'diesel',
'id': 'a39db335-ea9c-5ca7-bda3-db6c2adce7ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF62325',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 63758,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-31',
'seller_name': None,
'title': 'Toyota RAV 4 2.2 D-4D',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF62325%27 HTTP/1.1" 200 None
2026-03-28 12:05:30 [auto1.it] INFO: Saving data for VF62325: {'auction_closing_time': 1774714509.0, 'created_time': 1774612965.265133, 'last_price_update_time': 1774699530.942459}
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VF62325') HTTP/1.1" 204 0
2026-03-28 12:05:30 [auto1.it] INFO: Found listing with ID: TE87413
2026-03-28 12:05:30 [auto1.it] INFO: Found listing with ID: SY54924
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY54924%27 HTTP/1.1" 200 None
2026-03-28 12:05:30 [auto1.it] INFO: Scrape type for SY54924: 2
2026-03-28 12:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b36b969c-46b9-5132-9d38-3aa1eb38bf5e with identifier: SY54924
2026-03-28 12:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b36b969c-46b9-5132-9d38-3aa1eb38bf5e with scrape type 2
2026-03-28 12:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b36b969c-46b9-5132-9d38-3aa1eb38bf5e with scrape type 2
2026-03-28 12:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b36b969c-46b9-5132-9d38-3aa1eb38bf5e, identifier: SY54924
2026-03-28 12:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b36b969c-46b9-5132-9d38-3aa1eb38bf5e with identifier: SY54924
2026-03-28 12:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b36b969c-46b9-5132-9d38-3aa1eb38bf5e with identifier: SY54924
2026-03-28 12:05:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b36b969c-46b9-5132-9d38-3aa1eb38bf5e with identifier: SY54924 to the API
2026-03-28 12:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:38:42Z',
'fuel_type': 'diesel',
'id': 'b36b969c-46b9-5132-9d38-3aa1eb38bf5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY54924',
'listing': 'auction',
'make': 'Fiat',
'model': '500L',
'odometer': 191800,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-30',
'seller_name': None,
'title': 'Fiat 500L 1.3 JTD Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2016}
2026-03-28 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY54924%27 HTTP/1.1" 200 None
2026-03-28 12:05:31 [auto1.it] INFO: Saving data for SY54924: {'auction_closing_time': 1774715922.0, 'created_time': 1773824516.682948, 'last_price_update_time': 1774699531.742685}
2026-03-28 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SY54924') HTTP/1.1" 204 0
2026-03-28 12:05:31 [auto1.it] INFO: Found listing with ID: UD61425
2026-03-28 12:05:31 [auto1.it] INFO: Found listing with ID: UF75242
2026-03-28 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF75242%27 HTTP/1.1" 200 None
2026-03-28 12:05:31 [auto1.it] INFO: Scrape type for UF75242: 2
2026-03-28 12:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d203694-4df4-58b5-832f-1b13abb3121f with identifier: UF75242
2026-03-28 12:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d203694-4df4-58b5-832f-1b13abb3121f with scrape type 2
2026-03-28 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d203694-4df4-58b5-832f-1b13abb3121f with scrape type 2
2026-03-28 12:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6d203694-4df4-58b5-832f-1b13abb3121f, identifier: UF75242
2026-03-28 12:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6d203694-4df4-58b5-832f-1b13abb3121f with identifier: UF75242
2026-03-28 12:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6d203694-4df4-58b5-832f-1b13abb3121f with identifier: UF75242
2026-03-28 12:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6d203694-4df4-58b5-832f-1b13abb3121f with identifier: UF75242 to the API
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:44:31Z',
'fuel_type': 'diesel',
'id': '6d203694-4df4-58b5-832f-1b13abb3121f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF75242',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 190607,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-08',
'seller_name': None,
'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2011}
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF75242%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [auto1.it] INFO: Saving data for UF75242: {'auction_closing_time': 1774716271.0, 'created_time': 1774612935.735795, 'last_price_update_time': 1774699532.25102}
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UF75242') HTTP/1.1" 204 0
2026-03-28 12:05:32 [auto1.it] INFO: Found listing with ID: MG67619
2026-03-28 12:05:32 [auto1.it] INFO: Found listing with ID: VZ32715
2026-03-28 12:05:32 [auto1.it] INFO: Found listing with ID: AF86061
2026-03-28 12:05:32 [auto1.it] INFO: Found listing with ID: UK70353
2026-03-28 12:05:32 [auto1.it] INFO: Found listing with ID: GV49335
2026-03-28 12:05:32 [auto1.it] INFO: Found listing with ID: UU51056
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU51056%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [auto1.it] INFO: Scrape type for UU51056: 2
2026-03-28 12:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ceec2df3-46b3-5176-8fcb-0addd3ca8670 with identifier: UU51056
2026-03-28 12:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceec2df3-46b3-5176-8fcb-0addd3ca8670 with scrape type 2
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ceec2df3-46b3-5176-8fcb-0addd3ca8670 with scrape type 2
2026-03-28 12:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ceec2df3-46b3-5176-8fcb-0addd3ca8670, identifier: UU51056
2026-03-28 12:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ceec2df3-46b3-5176-8fcb-0addd3ca8670 with identifier: UU51056
2026-03-28 12:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ceec2df3-46b3-5176-8fcb-0addd3ca8670 with identifier: UU51056
2026-03-28 12:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ceec2df3-46b3-5176-8fcb-0addd3ca8670 with identifier: UU51056 to the API
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:30:35Z',
'fuel_type': 'diesel',
'id': 'ceec2df3-46b3-5176-8fcb-0addd3ca8670',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU51056',
'listing': 'auction',
'make': 'Fiat',
'model': '500L',
'odometer': 109604,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-31',
'seller_name': None,
'title': 'Fiat 500L 1.3 JTD Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2014}
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU51056%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [auto1.it] INFO: Saving data for UU51056: {'auction_closing_time': 1774715435.0, 'created_time': 1772222841.042035, 'last_price_update_time': 1774699532.657339}
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UU51056') HTTP/1.1" 204 0
2026-03-28 12:05:32 [auto1.it] INFO: Found listing with ID: WK74495
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK74495%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [auto1.it] INFO: Scrape type for WK74495: 2
2026-03-28 12:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 696ca54f-32c5-5cc5-ae43-47e29af4490a with identifier: WK74495
2026-03-28 12:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 696ca54f-32c5-5cc5-ae43-47e29af4490a with scrape type 2
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 696ca54f-32c5-5cc5-ae43-47e29af4490a with scrape type 2
2026-03-28 12:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 696ca54f-32c5-5cc5-ae43-47e29af4490a, identifier: WK74495
2026-03-28 12:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 696ca54f-32c5-5cc5-ae43-47e29af4490a with identifier: WK74495
2026-03-28 12:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 696ca54f-32c5-5cc5-ae43-47e29af4490a with identifier: WK74495
2026-03-28 12:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 696ca54f-32c5-5cc5-ae43-47e29af4490a with identifier: WK74495 to the API
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 72,
'expiration_date': '2026-03-28T16:17:35Z',
'fuel_type': 'petrol',
'id': '696ca54f-32c5-5cc5-ae43-47e29af4490a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK74495',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo X',
'odometer': 14976,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-17',
'seller_name': None,
'title': 'Toyota Aygo X 1.0 Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2022}
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK74495%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [auto1.it] INFO: Saving data for WK74495: {'auction_closing_time': 1774714655.0, 'created_time': 1773130782.201756, 'last_price_update_time': 1774699533.056976}
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WK74495') HTTP/1.1" 204 0
2026-03-28 12:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:33 [auto1.it] INFO: Found listing with ID: HP26181
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP26181%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [auto1.it] INFO: Scrape type for HP26181: 2
2026-03-28 12:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612c5b21-5819-558c-809c-91bafd337a8c with identifier: HP26181
2026-03-28 12:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612c5b21-5819-558c-809c-91bafd337a8c with scrape type 2
2026-03-28 12:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612c5b21-5819-558c-809c-91bafd337a8c with scrape type 2
2026-03-28 12:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 612c5b21-5819-558c-809c-91bafd337a8c, identifier: HP26181
2026-03-28 12:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 612c5b21-5819-558c-809c-91bafd337a8c with identifier: HP26181
2026-03-28 12:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 612c5b21-5819-558c-809c-91bafd337a8c with identifier: HP26181
2026-03-28 12:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 612c5b21-5819-558c-809c-91bafd337a8c with identifier: HP26181 to the API
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:26:34Z',
'fuel_type': 'diesel',
'id': '612c5b21-5819-558c-809c-91bafd337a8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP26181',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 171328,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-09-27',
'seller_name': None,
'title': 'Fiat 500 1.3 JTD Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2007}
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP26181%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [auto1.it] INFO: Saving data for HP26181: {'auction_closing_time': 1774715194.0, 'created_time': 1774612975.169872, 'last_price_update_time': 1774699533.429314}
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HP26181') HTTP/1.1" 204 0
2026-03-28 12:05:33 [auto1.it] INFO: Found listing with ID: FR70206
2026-03-28 12:05:33 [auto1.it] INFO: Found listing with ID: UX09906
2026-03-28 12:05:33 [auto1.it] INFO: Found listing with ID: EZ75087
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ75087%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [auto1.it] INFO: Scrape type for EZ75087: 2
2026-03-28 12:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8da8549-6441-56b8-bf14-eedd2d5bbb4e with identifier: EZ75087
2026-03-28 12:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8da8549-6441-56b8-bf14-eedd2d5bbb4e with scrape type 2
2026-03-28 12:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8da8549-6441-56b8-bf14-eedd2d5bbb4e with scrape type 2
2026-03-28 12:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c8da8549-6441-56b8-bf14-eedd2d5bbb4e, identifier: EZ75087
2026-03-28 12:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c8da8549-6441-56b8-bf14-eedd2d5bbb4e with identifier: EZ75087
2026-03-28 12:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c8da8549-6441-56b8-bf14-eedd2d5bbb4e with identifier: EZ75087
2026-03-28 12:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c8da8549-6441-56b8-bf14-eedd2d5bbb4e with identifier: EZ75087 to the API
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:50:21Z',
'fuel_type': 'diesel',
'id': 'c8da8549-6441-56b8-bf14-eedd2d5bbb4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ75087',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Limousine',
'odometer': 164712,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-29',
'seller_name': None,
'title': 'Audi A3 Limousine 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2014}
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ75087%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [auto1.it] INFO: Saving data for EZ75087: {'auction_closing_time': 1774716621.0, 'created_time': 1774612898.78617, 'last_price_update_time': 1774699533.838178}
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EZ75087') HTTP/1.1" 204 0
2026-03-28 12:05:33 [auto1.it] INFO: Channel: 24h | Page: 75 | totalHits: 3673 | hits on page: 40
2026-03-28 12:05:33 [auto1.it] INFO: Found listing with ID: YZ06369
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ06369%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [auto1.it] INFO: Scrape type for YZ06369: 2
2026-03-28 12:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adb6501d-405a-568e-b898-b05ee055829d with identifier: YZ06369
2026-03-28 12:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adb6501d-405a-568e-b898-b05ee055829d with scrape type 2
2026-03-28 12:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adb6501d-405a-568e-b898-b05ee055829d with scrape type 2
2026-03-28 12:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: adb6501d-405a-568e-b898-b05ee055829d, identifier: YZ06369
2026-03-28 12:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: adb6501d-405a-568e-b898-b05ee055829d with identifier: YZ06369
2026-03-28 12:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: adb6501d-405a-568e-b898-b05ee055829d with identifier: YZ06369
2026-03-28 12:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: adb6501d-405a-568e-b898-b05ee055829d with identifier: YZ06369 to the API
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:32:04Z',
'fuel_type': 'diesel',
'id': 'adb6501d-405a-568e-b898-b05ee055829d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ06369',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 268387,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-01',
'seller_name': None,
'title': 'Mazda 3 1.6 CD Diesel Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2013}
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ06369%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [auto1.it] INFO: Saving data for YZ06369: {'auction_closing_time': 1774715524.0, 'created_time': 1774612924.515908, 'last_price_update_time': 1774699534.356093}
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YZ06369') HTTP/1.1" 204 0
2026-03-28 12:05:34 [auto1.it] INFO: Found listing with ID: XW70858
2026-03-28 12:05:34 [auto1.it] INFO: Found listing with ID: RV11940
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV11940%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [auto1.it] INFO: Scrape type for RV11940: 2
2026-03-28 12:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd2abf88-c407-53cb-9783-d67e9103096e with identifier: RV11940
2026-03-28 12:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd2abf88-c407-53cb-9783-d67e9103096e with scrape type 2
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd2abf88-c407-53cb-9783-d67e9103096e with scrape type 2
2026-03-28 12:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd2abf88-c407-53cb-9783-d67e9103096e, identifier: RV11940
2026-03-28 12:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:34 [auto1.it] INFO: Found listing with ID: MJ31103
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ31103%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [auto1.it] INFO: Scrape type for MJ31103: 2
2026-03-28 12:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b4b18ed-ceca-5f01-9be9-1f5bcab843b6 with identifier: MJ31103
2026-03-28 12:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b4b18ed-ceca-5f01-9be9-1f5bcab843b6 with scrape type 2
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b4b18ed-ceca-5f01-9be9-1f5bcab843b6 with scrape type 2
2026-03-28 12:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3b4b18ed-ceca-5f01-9be9-1f5bcab843b6, identifier: MJ31103
2026-03-28 12:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd2abf88-c407-53cb-9783-d67e9103096e with identifier: RV11940
2026-03-28 12:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd2abf88-c407-53cb-9783-d67e9103096e with identifier: RV11940
2026-03-28 12:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd2abf88-c407-53cb-9783-d67e9103096e with identifier: RV11940 to the API
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:14:33Z',
'fuel_type': 'petrol',
'id': 'dd2abf88-c407-53cb-9783-d67e9103096e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV11940',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 108135,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-05',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2020}
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV11940%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [auto1.it] INFO: Saving data for RV11940: {'auction_closing_time': 1774714473.0, 'created_time': 1774612920.213652, 'last_price_update_time': 1774699534.857014}
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RV11940') HTTP/1.1" 204 0
2026-03-28 12:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3b4b18ed-ceca-5f01-9be9-1f5bcab843b6 with identifier: MJ31103
2026-03-28 12:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3b4b18ed-ceca-5f01-9be9-1f5bcab843b6 with identifier: MJ31103
2026-03-28 12:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3b4b18ed-ceca-5f01-9be9-1f5bcab843b6 with identifier: MJ31103 to the API
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 184,
'expiration_date': '2026-03-28T16:29:55Z',
'fuel_type': 'diesel',
'id': '3b4b18ed-ceca-5f01-9be9-1f5bcab843b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ31103',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 206527,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-17',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Executive 4Motion BMT',
'transmission': 'automatic',
'trim': 'Executive 4Motion BMT',
'year': 2016}
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ31103%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [auto1.it] INFO: Saving data for MJ31103: {'auction_closing_time': 1774715395.0, 'created_time': 1774612923.833739, 'last_price_update_time': 1774699535.156458}
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MJ31103') HTTP/1.1" 204 0
2026-03-28 12:05:35 [auto1.it] INFO: Found listing with ID: PN28374
2026-03-28 12:05:35 [auto1.it] INFO: Found listing with ID: KE46739
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE46739%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [auto1.it] INFO: Scrape type for KE46739: 2
2026-03-28 12:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bfdace1-0e1d-50d9-b726-8cd403f93757 with identifier: KE46739
2026-03-28 12:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bfdace1-0e1d-50d9-b726-8cd403f93757 with scrape type 2
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bfdace1-0e1d-50d9-b726-8cd403f93757 with scrape type 2
2026-03-28 12:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4bfdace1-0e1d-50d9-b726-8cd403f93757, identifier: KE46739
2026-03-28 12:05:35 [auto1.it] INFO: Found listing with ID: HJ18951
2026-03-28 12:05:35 [auto1.it] INFO: Found listing with ID: YM27608
2026-03-28 12:05:35 [auto1.it] INFO: Found listing with ID: ZF27085
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF27085%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [auto1.it] INFO: Scrape type for ZF27085: 2
2026-03-28 12:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eb31386-997a-5be2-9798-87a420bab9ec with identifier: ZF27085
2026-03-28 12:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eb31386-997a-5be2-9798-87a420bab9ec with scrape type 2
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4eb31386-997a-5be2-9798-87a420bab9ec with scrape type 2
2026-03-28 12:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4eb31386-997a-5be2-9798-87a420bab9ec, identifier: ZF27085
2026-03-28 12:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4bfdace1-0e1d-50d9-b726-8cd403f93757 with identifier: KE46739
2026-03-28 12:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4bfdace1-0e1d-50d9-b726-8cd403f93757 with identifier: KE46739
2026-03-28 12:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4bfdace1-0e1d-50d9-b726-8cd403f93757 with identifier: KE46739 to the API
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-28T16:56:12Z',
'fuel_type': 'hybrid',
'id': '4bfdace1-0e1d-50d9-b726-8cd403f93757',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE46739',
'listing': 'auction',
'make': 'MG',
'model': 'ZS',
'odometer': 38764,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-23',
'seller_name': None,
'title': 'MG ZS 1.5 T-GDI Plug-in Hybrid Luxury',
'transmission': 'automatic',
'trim': 'Luxury',
'year': 2025}
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE46739%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [auto1.it] INFO: Saving data for KE46739: {'auction_closing_time': 1774716972.0, 'created_time': 1774612905.52814, 'last_price_update_time': 1774699535.658761}
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KE46739') HTTP/1.1" 204 0
2026-03-28 12:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4eb31386-997a-5be2-9798-87a420bab9ec with identifier: ZF27085
2026-03-28 12:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4eb31386-997a-5be2-9798-87a420bab9ec with identifier: ZF27085
2026-03-28 12:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4eb31386-997a-5be2-9798-87a420bab9ec with identifier: ZF27085 to the API
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 162,
'expiration_date': '2026-03-28T16:54:33Z',
'fuel_type': 'petrol',
'id': '4eb31386-997a-5be2-9798-87a420bab9ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF27085',
'listing': 'auction',
'make': 'MG',
'model': 'HS',
'odometer': 57837,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-29',
'seller_name': None,
'title': 'MG HS 1.5 Luxury',
'transmission': 'automatic',
'trim': 'Luxury',
'year': 2024}
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF27085%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [auto1.it] INFO: Saving data for ZF27085: {'auction_closing_time': 1774716873.0, 'created_time': 1774612904.971477, 'last_price_update_time': 1774699535.928357}
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZF27085') HTTP/1.1" 204 0
2026-03-28 12:05:35 [auto1.it] INFO: Found listing with ID: JE85806
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE85806%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [auto1.it] INFO: Scrape type for JE85806: 2
2026-03-28 12:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfae9772-3c88-5b62-b4b1-89d86a565f56 with identifier: JE85806
2026-03-28 12:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfae9772-3c88-5b62-b4b1-89d86a565f56 with scrape type 2
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfae9772-3c88-5b62-b4b1-89d86a565f56 with scrape type 2
2026-03-28 12:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bfae9772-3c88-5b62-b4b1-89d86a565f56, identifier: JE85806
2026-03-28 12:05:36 [auto1.it] INFO: Found listing with ID: RF78298
2026-03-28 12:05:36 [auto1.it] INFO: Found listing with ID: VD83585
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VD83585%27 HTTP/1.1" 200 None
2026-03-28 12:05:36 [auto1.it] INFO: Scrape type for VD83585: 2
2026-03-28 12:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfd100bf-b93f-5d8d-a6b4-52d25cd9b4f5 with identifier: VD83585
2026-03-28 12:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfd100bf-b93f-5d8d-a6b4-52d25cd9b4f5 with scrape type 2
2026-03-28 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfd100bf-b93f-5d8d-a6b4-52d25cd9b4f5 with scrape type 2
2026-03-28 12:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cfd100bf-b93f-5d8d-a6b4-52d25cd9b4f5, identifier: VD83585
2026-03-28 12:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bfae9772-3c88-5b62-b4b1-89d86a565f56 with identifier: JE85806
2026-03-28 12:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bfae9772-3c88-5b62-b4b1-89d86a565f56 with identifier: JE85806
2026-03-28 12:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bfae9772-3c88-5b62-b4b1-89d86a565f56 with identifier: JE85806 to the API
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:53:54Z',
'fuel_type': 'diesel',
'id': 'bfae9772-3c88-5b62-b4b1-89d86a565f56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE85806',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 56383,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-22',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Comfortline',
'transmission': 'automatic',
'trim': 'Comfortline',
'year': 2020}
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE85806%27 HTTP/1.1" 200 None
2026-03-28 12:05:36 [auto1.it] INFO: Saving data for JE85806: {'auction_closing_time': 1774716834.0, 'created_time': 1774612909.145449, 'last_price_update_time': 1774699536.458524}
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JE85806') HTTP/1.1" 204 0
2026-03-28 12:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cfd100bf-b93f-5d8d-a6b4-52d25cd9b4f5 with identifier: VD83585
2026-03-28 12:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cfd100bf-b93f-5d8d-a6b4-52d25cd9b4f5 with identifier: VD83585
2026-03-28 12:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cfd100bf-b93f-5d8d-a6b4-52d25cd9b4f5 with identifier: VD83585 to the API
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 106,
'expiration_date': '2026-03-28T16:46:26Z',
'fuel_type': 'petrol',
'id': 'cfd100bf-b93f-5d8d-a6b4-52d25cd9b4f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD83585',
'listing': 'auction',
'make': 'MG',
'model': 'ZS',
'odometer': 65283,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-28',
'seller_name': None,
'title': 'MG ZS 1.5 VTi Luxury',
'transmission': 'manual',
'trim': 'Luxury',
'year': 2024}
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VD83585%27 HTTP/1.1" 200 None
2026-03-28 12:05:36 [auto1.it] INFO: Saving data for VD83585: {'auction_closing_time': 1774716386.0, 'created_time': 1774612901.530986, 'last_price_update_time': 1774699536.845409}
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VD83585') HTTP/1.1" 204 0
2026-03-28 12:05:36 [auto1.it] INFO: Found listing with ID: LS28867
2026-03-28 12:05:36 [auto1.it] INFO: Found listing with ID: TZ47815
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ47815%27 HTTP/1.1" 200 None
2026-03-28 12:05:36 [auto1.it] INFO: Scrape type for TZ47815: 2
2026-03-28 12:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 509a1f99-8ab4-5b07-928e-646a96f8f122 with identifier: TZ47815
2026-03-28 12:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 509a1f99-8ab4-5b07-928e-646a96f8f122 with scrape type 2
2026-03-28 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 509a1f99-8ab4-5b07-928e-646a96f8f122 with scrape type 2
2026-03-28 12:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 509a1f99-8ab4-5b07-928e-646a96f8f122, identifier: TZ47815
2026-03-28 12:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 509a1f99-8ab4-5b07-928e-646a96f8f122 with identifier: TZ47815
2026-03-28 12:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 509a1f99-8ab4-5b07-928e-646a96f8f122 with identifier: TZ47815
2026-03-28 12:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 509a1f99-8ab4-5b07-928e-646a96f8f122 with identifier: TZ47815 to the API
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-28T16:17:47Z',
'fuel_type': 'diesel',
'id': '509a1f99-8ab4-5b07-928e-646a96f8f122',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ47815',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 241725,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-06-29',
'seller_name': None,
'title': 'Opel Astra 1.7 CDTI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2004}
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ47815%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [auto1.it] INFO: Saving data for TZ47815: {'auction_closing_time': 1774714667.0, 'created_time': 1774612930.84597, 'last_price_update_time': 1774699537.210697}
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TZ47815') HTTP/1.1" 204 0
2026-03-28 12:05:37 [auto1.it] INFO: Found listing with ID: RL97939
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL97939%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [auto1.it] INFO: Scrape type for RL97939: 0
2026-03-28 12:05:37 [auto1.it] INFO: Found listing with ID: SC91639
2026-03-28 12:05:37 [auto1.it] INFO: Found listing with ID: RM66107
2026-03-28 12:05:37 [auto1.it] INFO: Found listing with ID: KH81346
2026-03-28 12:05:37 [auto1.it] INFO: Found listing with ID: HY77897
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY77897%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [auto1.it] INFO: Scrape type for HY77897: 2
2026-03-28 12:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef837ba3-d3d0-5b24-8226-d9c2699a8e2b with identifier: HY77897
2026-03-28 12:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef837ba3-d3d0-5b24-8226-d9c2699a8e2b with scrape type 2
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef837ba3-d3d0-5b24-8226-d9c2699a8e2b with scrape type 2
2026-03-28 12:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ef837ba3-d3d0-5b24-8226-d9c2699a8e2b, identifier: HY77897
2026-03-28 12:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ef837ba3-d3d0-5b24-8226-d9c2699a8e2b with identifier: HY77897
2026-03-28 12:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ef837ba3-d3d0-5b24-8226-d9c2699a8e2b with identifier: HY77897
2026-03-28 12:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ef837ba3-d3d0-5b24-8226-d9c2699a8e2b with identifier: HY77897 to the API
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:40:20Z',
'fuel_type': 'petrol',
'id': 'ef837ba3-d3d0-5b24-8226-d9c2699a8e2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY77897',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto Evo',
'odometer': 195419,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-31',
'seller_name': None,
'title': 'Fiat Punto Evo 1.2 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2012}
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY77897%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [auto1.it] INFO: Saving data for HY77897: {'auction_closing_time': 1774716020.0, 'created_time': 1774612899.639053, 'last_price_update_time': 1774699537.674511}
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HY77897') HTTP/1.1" 204 0
2026-03-28 12:05:37 [auto1.it] INFO: Found listing with ID: AZ70503
2026-03-28 12:05:37 [auto1.it] INFO: Found listing with ID: YS71318
2026-03-28 12:05:37 [auto1.it] INFO: Found listing with ID: NR25924
2026-03-28 12:05:37 [auto1.it] INFO: Found listing with ID: ND31908
2026-03-28 12:05:37 [auto1.it] INFO: Found listing with ID: ER28485
2026-03-28 12:05:37 [auto1.it] INFO: Found listing with ID: RP23530
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RP23530%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [auto1.it] INFO: Scrape type for RP23530: 2
2026-03-28 12:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d246258f-e721-5e6f-9c07-fcf8c3d859c9 with identifier: RP23530
2026-03-28 12:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d246258f-e721-5e6f-9c07-fcf8c3d859c9 with scrape type 2
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d246258f-e721-5e6f-9c07-fcf8c3d859c9 with scrape type 2
2026-03-28 12:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d246258f-e721-5e6f-9c07-fcf8c3d859c9, identifier: RP23530
2026-03-28 12:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d246258f-e721-5e6f-9c07-fcf8c3d859c9 with identifier: RP23530
2026-03-28 12:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d246258f-e721-5e6f-9c07-fcf8c3d859c9 with identifier: RP23530
2026-03-28 12:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d246258f-e721-5e6f-9c07-fcf8c3d859c9 with identifier: RP23530 to the API
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:05:42Z',
'fuel_type': 'diesel',
'id': 'd246258f-e721-5e6f-9c07-fcf8c3d859c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP23530',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 83975,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-29',
'seller_name': None,
'title': 'BMW X1 xDrive 18d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2020}
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RP23530%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [auto1.it] INFO: Saving data for RP23530: {'auction_closing_time': 1774713942.0, 'created_time': 1774612904.575312, 'last_price_update_time': 1774699538.067644}
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RP23530') HTTP/1.1" 204 0
2026-03-28 12:05:38 [auto1.it] INFO: Found listing with ID: HU57894
2026-03-28 12:05:38 [auto1.it] INFO: Found listing with ID: SN99997
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN99997%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [auto1.it] INFO: Scrape type for SN99997: 2
2026-03-28 12:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 472f00cf-ce76-52b2-a0da-591526c0ba70 with identifier: SN99997
2026-03-28 12:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 472f00cf-ce76-52b2-a0da-591526c0ba70 with scrape type 2
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 472f00cf-ce76-52b2-a0da-591526c0ba70 with scrape type 2
2026-03-28 12:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 472f00cf-ce76-52b2-a0da-591526c0ba70, identifier: SN99997
2026-03-28 12:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 472f00cf-ce76-52b2-a0da-591526c0ba70 with identifier: SN99997
2026-03-28 12:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 472f00cf-ce76-52b2-a0da-591526c0ba70 with identifier: SN99997
2026-03-28 12:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 472f00cf-ce76-52b2-a0da-591526c0ba70 with identifier: SN99997 to the API
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:47:23Z',
'fuel_type': 'petrol',
'id': '472f00cf-ce76-52b2-a0da-591526c0ba70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN99997',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 183624,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-08-21',
'seller_name': None,
'title': 'Skoda Octavia 1.6 Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2008}
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN99997%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [auto1.it] INFO: Saving data for SN99997: {'auction_closing_time': 1774716443.0, 'created_time': 1774612887.292278, 'last_price_update_time': 1774699538.553607}
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SN99997') HTTP/1.1" 204 0
2026-03-28 12:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:38 [auto1.it] INFO: Found listing with ID: BE36594
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE36594%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [auto1.it] INFO: Scrape type for BE36594: 2
2026-03-28 12:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13fc9cda-d90e-50d7-947d-2f4a155bf2ab with identifier: BE36594
2026-03-28 12:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13fc9cda-d90e-50d7-947d-2f4a155bf2ab with scrape type 2
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13fc9cda-d90e-50d7-947d-2f4a155bf2ab with scrape type 2
2026-03-28 12:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 13fc9cda-d90e-50d7-947d-2f4a155bf2ab, identifier: BE36594
2026-03-28 12:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 13fc9cda-d90e-50d7-947d-2f4a155bf2ab with identifier: BE36594
2026-03-28 12:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 13fc9cda-d90e-50d7-947d-2f4a155bf2ab with identifier: BE36594
2026-03-28 12:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 13fc9cda-d90e-50d7-947d-2f4a155bf2ab with identifier: BE36594 to the API
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 195,
'expiration_date': '2026-03-28T16:23:28Z',
'fuel_type': 'diesel',
'id': '13fc9cda-d90e-50d7-947d-2f4a155bf2ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE36594',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 195896,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-16',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2017}
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE36594%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [auto1.it] INFO: Saving data for BE36594: {'auction_closing_time': 1774715008.0, 'created_time': 1773824499.856795, 'last_price_update_time': 1774699539.016852}
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BE36594') HTTP/1.1" 204 0
2026-03-28 12:05:39 [auto1.it] INFO: Found listing with ID: UR23669
2026-03-28 12:05:39 [auto1.it] INFO: Found listing with ID: LR45419
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR45419%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [auto1.it] INFO: Scrape type for LR45419: 2
2026-03-28 12:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5197430f-9c0d-5391-b145-7a950a47ba9e with identifier: LR45419
2026-03-28 12:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5197430f-9c0d-5391-b145-7a950a47ba9e with scrape type 2
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5197430f-9c0d-5391-b145-7a950a47ba9e with scrape type 2
2026-03-28 12:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5197430f-9c0d-5391-b145-7a950a47ba9e, identifier: LR45419
2026-03-28 12:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5197430f-9c0d-5391-b145-7a950a47ba9e with identifier: LR45419
2026-03-28 12:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5197430f-9c0d-5391-b145-7a950a47ba9e with identifier: LR45419
2026-03-28 12:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5197430f-9c0d-5391-b145-7a950a47ba9e with identifier: LR45419 to the API
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-28T16:28:21Z',
'fuel_type': 'petrol',
'id': '5197430f-9c0d-5391-b145-7a950a47ba9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR45419',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 129722,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-29',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2016}
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR45419%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [auto1.it] INFO: Saving data for LR45419: {'auction_closing_time': 1774715301.0, 'created_time': 1774612910.205637, 'last_price_update_time': 1774699539.408527}
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LR45419') HTTP/1.1" 204 0
2026-03-28 12:05:39 [auto1.it] INFO: Channel: 24h | Page: 76 | totalHits: 3673 | hits on page: 40
2026-03-28 12:05:39 [auto1.it] INFO: Found listing with ID: XX72461
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX72461%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [auto1.it] INFO: Scrape type for XX72461: 2
2026-03-28 12:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e05f1fa7-636a-5d59-a26a-68568af1c1cd with identifier: XX72461
2026-03-28 12:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e05f1fa7-636a-5d59-a26a-68568af1c1cd with scrape type 2
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e05f1fa7-636a-5d59-a26a-68568af1c1cd with scrape type 2
2026-03-28 12:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e05f1fa7-636a-5d59-a26a-68568af1c1cd, identifier: XX72461
2026-03-28 12:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e05f1fa7-636a-5d59-a26a-68568af1c1cd with identifier: XX72461
2026-03-28 12:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e05f1fa7-636a-5d59-a26a-68568af1c1cd with identifier: XX72461
2026-03-28 12:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e05f1fa7-636a-5d59-a26a-68568af1c1cd with identifier: XX72461 to the API
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:05:38Z',
'fuel_type': 'diesel',
'id': 'e05f1fa7-636a-5d59-a26a-68568af1c1cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX72461',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 345462,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-08',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Executive 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Executive 4Motion BlueMotion',
'year': 2016}
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX72461%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [auto1.it] INFO: Saving data for XX72461: {'auction_closing_time': 1774713938.0, 'created_time': 1774612921.741772, 'last_price_update_time': 1774699539.801389}
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XX72461') HTTP/1.1" 204 0
2026-03-28 12:05:39 [auto1.it] INFO: Found listing with ID: MU30420
2026-03-28 12:05:39 [auto1.it] INFO: Found listing with ID: EJ86461
2026-03-28 12:05:39 [auto1.it] INFO: Found listing with ID: WA22264
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA22264%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [auto1.it] INFO: Scrape type for WA22264: 2
2026-03-28 12:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bb32b8f-3c10-5750-b1cc-e83a13a44387 with identifier: WA22264
2026-03-28 12:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bb32b8f-3c10-5750-b1cc-e83a13a44387 with scrape type 2
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bb32b8f-3c10-5750-b1cc-e83a13a44387 with scrape type 2
2026-03-28 12:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2bb32b8f-3c10-5750-b1cc-e83a13a44387, identifier: WA22264
2026-03-28 12:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:39 [auto1.it] INFO: Found listing with ID: RE68635
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE68635%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [auto1.it] INFO: Scrape type for RE68635: 2
2026-03-28 12:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a04feea-d384-5ce9-ac07-7d91a2e9d530 with identifier: RE68635
2026-03-28 12:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a04feea-d384-5ce9-ac07-7d91a2e9d530 with scrape type 2
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a04feea-d384-5ce9-ac07-7d91a2e9d530 with scrape type 2
2026-03-28 12:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9a04feea-d384-5ce9-ac07-7d91a2e9d530, identifier: RE68635
2026-03-28 12:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2bb32b8f-3c10-5750-b1cc-e83a13a44387 with identifier: WA22264
2026-03-28 12:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2bb32b8f-3c10-5750-b1cc-e83a13a44387 with identifier: WA22264
2026-03-28 12:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2bb32b8f-3c10-5750-b1cc-e83a13a44387 with identifier: WA22264 to the API
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 162,
'expiration_date': '2026-03-28T16:03:32Z',
'fuel_type': 'petrol',
'id': '2bb32b8f-3c10-5750-b1cc-e83a13a44387',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA22264',
'listing': 'auction',
'make': 'MG',
'model': 'HS',
'odometer': 60993,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-27',
'seller_name': None,
'title': 'MG HS 1.5 Luxury',
'transmission': 'automatic',
'trim': 'Luxury',
'year': 2024}
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA22264%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [auto1.it] INFO: Saving data for WA22264: {'auction_closing_time': 1774713812.0, 'created_time': 1774612888.663764, 'last_price_update_time': 1774699540.69201}
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WA22264') HTTP/1.1" 204 0
2026-03-28 12:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9a04feea-d384-5ce9-ac07-7d91a2e9d530 with identifier: RE68635
2026-03-28 12:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9a04feea-d384-5ce9-ac07-7d91a2e9d530 with identifier: RE68635
2026-03-28 12:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9a04feea-d384-5ce9-ac07-7d91a2e9d530 with identifier: RE68635 to the API
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:09:46Z',
'fuel_type': 'diesel',
'id': '9a04feea-d384-5ce9-ac07-7d91a2e9d530',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE68635',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 173477,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-15',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Executive 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Executive 4Motion BlueMotion',
'year': 2016}
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE68635%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [auto1.it] INFO: Saving data for RE68635: {'auction_closing_time': 1774714186.0, 'created_time': 1774612910.562366, 'last_price_update_time': 1774699541.191472}
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RE68635') HTTP/1.1" 204 0
2026-03-28 12:05:41 [auto1.it] INFO: Found listing with ID: ZL89240
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL89240%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [auto1.it] INFO: Scrape type for ZL89240: 2
2026-03-28 12:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3bd0d2a-0a1f-5cfe-b2cd-7180095ce8e9 with identifier: ZL89240
2026-03-28 12:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3bd0d2a-0a1f-5cfe-b2cd-7180095ce8e9 with scrape type 2
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3bd0d2a-0a1f-5cfe-b2cd-7180095ce8e9 with scrape type 2
2026-03-28 12:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e3bd0d2a-0a1f-5cfe-b2cd-7180095ce8e9, identifier: ZL89240
2026-03-28 12:05:41 [auto1.it] INFO: Found listing with ID: JT08977
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT08977%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [auto1.it] INFO: Scrape type for JT08977: 2
2026-03-28 12:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9678c286-d0c6-5dbf-aa29-65fe1a0cb500 with identifier: JT08977
2026-03-28 12:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9678c286-d0c6-5dbf-aa29-65fe1a0cb500 with scrape type 2
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9678c286-d0c6-5dbf-aa29-65fe1a0cb500 with scrape type 2
2026-03-28 12:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9678c286-d0c6-5dbf-aa29-65fe1a0cb500, identifier: JT08977
2026-03-28 12:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e3bd0d2a-0a1f-5cfe-b2cd-7180095ce8e9 with identifier: ZL89240
2026-03-28 12:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e3bd0d2a-0a1f-5cfe-b2cd-7180095ce8e9 with identifier: ZL89240
2026-03-28 12:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e3bd0d2a-0a1f-5cfe-b2cd-7180095ce8e9 with identifier: ZL89240 to the API
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 162,
'expiration_date': '2026-03-28T16:00:13Z',
'fuel_type': 'petrol',
'id': 'e3bd0d2a-0a1f-5cfe-b2cd-7180095ce8e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL89240',
'listing': 'auction',
'make': 'MG',
'model': 'HS',
'odometer': 59190,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-29',
'seller_name': None,
'title': 'MG HS 1.5 Luxury',
'transmission': 'automatic',
'trim': 'Luxury',
'year': 2024}
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL89240%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [auto1.it] INFO: Saving data for ZL89240: {'auction_closing_time': 1774713613.0, 'created_time': 1774612887.72226, 'last_price_update_time': 1774699542.198321}
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZL89240') HTTP/1.1" 204 0
2026-03-28 12:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9678c286-d0c6-5dbf-aa29-65fe1a0cb500 with identifier: JT08977
2026-03-28 12:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9678c286-d0c6-5dbf-aa29-65fe1a0cb500 with identifier: JT08977
2026-03-28 12:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9678c286-d0c6-5dbf-aa29-65fe1a0cb500 with identifier: JT08977 to the API
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:52:22Z',
'fuel_type': 'petrol',
'id': '9678c286-d0c6-5dbf-aa29-65fe1a0cb500',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT08977',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 74204,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-31',
'seller_name': None,
'title': 'Opel Astra 1.4 SIDI Turbo Innovation Start/Stop',
'transmission': 'manual',
'trim': 'Innovation Start/Stop',
'year': 2016}
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT08977%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [auto1.it] INFO: Saving data for JT08977: {'auction_closing_time': 1774716742.0, 'created_time': 1774612942.266412, 'last_price_update_time': 1774699542.585048}
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JT08977') HTTP/1.1" 204 0
2026-03-28 12:05:42 [auto1.it] INFO: Found listing with ID: SZ00349
2026-03-28 12:05:42 [auto1.it] INFO: Found listing with ID: LN67507
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN67507%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [auto1.it] INFO: Scrape type for LN67507: 2
2026-03-28 12:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8456b664-1404-5a86-b453-2b326deb4915 with identifier: LN67507
2026-03-28 12:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8456b664-1404-5a86-b453-2b326deb4915 with scrape type 2
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8456b664-1404-5a86-b453-2b326deb4915 with scrape type 2
2026-03-28 12:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8456b664-1404-5a86-b453-2b326deb4915, identifier: LN67507
2026-03-28 12:05:42 [auto1.it] INFO: Found listing with ID: HC78741
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC78741%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [auto1.it] INFO: Scrape type for HC78741: 2
2026-03-28 12:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d94632f-c34c-556a-950b-d8f7520e9767 with identifier: HC78741
2026-03-28 12:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d94632f-c34c-556a-950b-d8f7520e9767 with scrape type 2
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d94632f-c34c-556a-950b-d8f7520e9767 with scrape type 2
2026-03-28 12:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0d94632f-c34c-556a-950b-d8f7520e9767, identifier: HC78741
2026-03-28 12:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8456b664-1404-5a86-b453-2b326deb4915 with identifier: LN67507
2026-03-28 12:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8456b664-1404-5a86-b453-2b326deb4915 with identifier: LN67507
2026-03-28 12:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8456b664-1404-5a86-b453-2b326deb4915 with identifier: LN67507 to the API
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:00:11Z',
'fuel_type': 'petrol',
'id': '8456b664-1404-5a86-b453-2b326deb4915',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN67507',
'listing': 'auction',
'make': 'Audi',
'model': 'A3',
'odometer': 99851,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-23',
'seller_name': None,
'title': 'Audi A3 1.4 TFSI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2011}
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN67507%27 HTTP/1.1" 200 None
2026-03-28 12:05:43 [auto1.it] INFO: Saving data for LN67507: {'auction_closing_time': 1774713611.0, 'created_time': 1774612895.440458, 'last_price_update_time': 1774699543.094623}
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LN67507') HTTP/1.1" 204 0
2026-03-28 12:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0d94632f-c34c-556a-950b-d8f7520e9767 with identifier: HC78741
2026-03-28 12:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0d94632f-c34c-556a-950b-d8f7520e9767 with identifier: HC78741
2026-03-28 12:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0d94632f-c34c-556a-950b-d8f7520e9767 with identifier: HC78741 to the API
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:16:09Z',
'fuel_type': 'diesel',
'id': '0d94632f-c34c-556a-950b-d8f7520e9767',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC78741',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 298222,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-25',
'seller_name': None,
'title': 'Land Rover Evoque 2.2 Sd4 Pure',
'transmission': 'automatic',
'trim': 'Pure',
'year': 2012}
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC78741%27 HTTP/1.1" 200 None
2026-03-28 12:05:43 [auto1.it] INFO: Saving data for HC78741: {'auction_closing_time': 1774714569.0, 'created_time': 1774612896.621718, 'last_price_update_time': 1774699543.400773}
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HC78741') HTTP/1.1" 204 0
2026-03-28 12:05:43 [auto1.it] INFO: Found listing with ID: KR37794
2026-03-28 12:05:43 [auto1.it] INFO: Found listing with ID: NF87616
2026-03-28 12:05:43 [auto1.it] INFO: Found listing with ID: GC68104
2026-03-28 12:05:43 [auto1.it] INFO: Found listing with ID: AE34833
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE34833%27 HTTP/1.1" 200 None
2026-03-28 12:05:43 [auto1.it] INFO: Scrape type for AE34833: 0
2026-03-28 12:05:43 [auto1.it] INFO: Found listing with ID: HS60673
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS60673%27 HTTP/1.1" 200 None
2026-03-28 12:05:43 [auto1.it] INFO: Scrape type for HS60673: 2
2026-03-28 12:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 948f937e-5450-51a5-aae3-44955796b6dd with identifier: HS60673
2026-03-28 12:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 948f937e-5450-51a5-aae3-44955796b6dd with scrape type 2
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 948f937e-5450-51a5-aae3-44955796b6dd with scrape type 2
2026-03-28 12:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 948f937e-5450-51a5-aae3-44955796b6dd, identifier: HS60673
2026-03-28 12:05:43 [auto1.it] INFO: Found listing with ID: XC90090
2026-03-28 12:05:43 [auto1.it] INFO: Found listing with ID: JK13765
2026-03-28 12:05:43 [auto1.it] INFO: Found listing with ID: UD57618
2026-03-28 12:05:43 [auto1.it] INFO: Found listing with ID: FH81414
2026-03-28 12:05:43 [auto1.it] INFO: Found listing with ID: GT75186
2026-03-28 12:05:43 [auto1.it] INFO: Found listing with ID: ZY33580
2026-03-28 12:05:43 [auto1.it] INFO: Found listing with ID: FX08227
2026-03-28 12:05:43 [auto1.it] INFO: Found listing with ID: EC01464
2026-03-28 12:05:43 [auto1.it] INFO: Found listing with ID: CZ44875
2026-03-28 12:05:43 [auto1.it] INFO: Found listing with ID: ZN99189
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN99189%27 HTTP/1.1" 200 None
2026-03-28 12:05:43 [auto1.it] INFO: Scrape type for ZN99189: 2
2026-03-28 12:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39174ef4-10a3-5355-8bf2-62b56ccf3391 with identifier: ZN99189
2026-03-28 12:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39174ef4-10a3-5355-8bf2-62b56ccf3391 with scrape type 2
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39174ef4-10a3-5355-8bf2-62b56ccf3391 with scrape type 2
2026-03-28 12:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 39174ef4-10a3-5355-8bf2-62b56ccf3391, identifier: ZN99189
2026-03-28 12:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 948f937e-5450-51a5-aae3-44955796b6dd with identifier: HS60673
2026-03-28 12:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 948f937e-5450-51a5-aae3-44955796b6dd with identifier: HS60673
2026-03-28 12:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 948f937e-5450-51a5-aae3-44955796b6dd with identifier: HS60673 to the API
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:18:00Z',
'fuel_type': 'diesel',
'id': '948f937e-5450-51a5-aae3-44955796b6dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS60673',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 163020,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-06',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2017}
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS60673%27 HTTP/1.1" 200 None
2026-03-28 12:05:43 [auto1.it] INFO: Saving data for HS60673: {'auction_closing_time': 1774714680.0, 'created_time': 1773404231.151093, 'last_price_update_time': 1774699543.942793}
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HS60673') HTTP/1.1" 204 0
2026-03-28 12:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 39174ef4-10a3-5355-8bf2-62b56ccf3391 with identifier: ZN99189
2026-03-28 12:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 39174ef4-10a3-5355-8bf2-62b56ccf3391 with identifier: ZN99189
2026-03-28 12:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 39174ef4-10a3-5355-8bf2-62b56ccf3391 with identifier: ZN99189 to the API
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:24:39Z',
'fuel_type': 'diesel',
'id': '39174ef4-10a3-5355-8bf2-62b56ccf3391',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN99189',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Rifter',
'odometer': 149329,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-27',
'seller_name': None,
'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L1',
'transmission': 'manual',
'trim': 'Allure L1',
'year': 2020}
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN99189%27 HTTP/1.1" 200 None
2026-03-28 12:05:44 [auto1.it] INFO: Saving data for ZN99189: {'auction_closing_time': 1774715079.0, 'created_time': 1774612981.805966, 'last_price_update_time': 1774699544.340339}
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZN99189') HTTP/1.1" 204 0
2026-03-28 12:05:44 [auto1.it] INFO: Found listing with ID: BT26363
2026-03-28 12:05:44 [auto1.it] INFO: Found listing with ID: RT50500
2026-03-28 12:05:44 [auto1.it] INFO: Found listing with ID: JM39933
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM39933%27 HTTP/1.1" 200 None
2026-03-28 12:05:44 [auto1.it] INFO: Scrape type for JM39933: 2
2026-03-28 12:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bd221ff-2d93-5b35-a047-6b0041a2c460 with identifier: JM39933
2026-03-28 12:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bd221ff-2d93-5b35-a047-6b0041a2c460 with scrape type 2
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bd221ff-2d93-5b35-a047-6b0041a2c460 with scrape type 2
2026-03-28 12:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9bd221ff-2d93-5b35-a047-6b0041a2c460, identifier: JM39933
2026-03-28 12:05:44 [auto1.it] INFO: Found listing with ID: NG22695
2026-03-28 12:05:44 [auto1.it] INFO: Found listing with ID: LZ33850
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ33850%27 HTTP/1.1" 200 None
2026-03-28 12:05:44 [auto1.it] INFO: Scrape type for LZ33850: 2
2026-03-28 12:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85d2c0a5-5385-5a1a-889e-81fc0660794e with identifier: LZ33850
2026-03-28 12:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85d2c0a5-5385-5a1a-889e-81fc0660794e with scrape type 2
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85d2c0a5-5385-5a1a-889e-81fc0660794e with scrape type 2
2026-03-28 12:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 85d2c0a5-5385-5a1a-889e-81fc0660794e, identifier: LZ33850
2026-03-28 12:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9bd221ff-2d93-5b35-a047-6b0041a2c460 with identifier: JM39933
2026-03-28 12:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9bd221ff-2d93-5b35-a047-6b0041a2c460 with identifier: JM39933
2026-03-28 12:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9bd221ff-2d93-5b35-a047-6b0041a2c460 with identifier: JM39933 to the API
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:02:08Z',
'fuel_type': 'petrol',
'id': '9bd221ff-2d93-5b35-a047-6b0041a2c460',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM39933',
'listing': 'auction',
'make': 'MG',
'model': '3',
'odometer': 33125,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-16',
'seller_name': None,
'title': 'MG 3 1.5 Turbo Standard',
'transmission': 'manual',
'trim': 'Standard',
'year': 2025}
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM39933%27 HTTP/1.1" 200 None
2026-03-28 12:05:44 [auto1.it] INFO: Saving data for JM39933: {'auction_closing_time': 1774713728.0, 'created_time': 1774612891.856983, 'last_price_update_time': 1774699544.836017}
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JM39933') HTTP/1.1" 204 0
2026-03-28 12:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 85d2c0a5-5385-5a1a-889e-81fc0660794e with identifier: LZ33850
2026-03-28 12:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 85d2c0a5-5385-5a1a-889e-81fc0660794e with identifier: LZ33850
2026-03-28 12:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 85d2c0a5-5385-5a1a-889e-81fc0660794e with identifier: LZ33850 to the API
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 162,
'expiration_date': '2026-03-28T16:27:25Z',
'fuel_type': 'petrol',
'id': '85d2c0a5-5385-5a1a-889e-81fc0660794e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ33850',
'listing': 'auction',
'make': 'MG',
'model': 'HS',
'odometer': 40216,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-10',
'seller_name': None,
'title': 'MG HS 1.5 Luxury',
'transmission': 'manual',
'trim': 'Luxury',
'year': 2024}
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ33850%27 HTTP/1.1" 200 None
2026-03-28 12:05:45 [auto1.it] INFO: Saving data for LZ33850: {'auction_closing_time': 1774715245.0, 'created_time': 1774612893.745076, 'last_price_update_time': 1774699545.145562}
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LZ33850') HTTP/1.1" 204 0
2026-03-28 12:05:45 [auto1.it] INFO: Found listing with ID: ZL56801
2026-03-28 12:05:45 [auto1.it] INFO: Found listing with ID: UU49973
2026-03-28 12:05:45 [auto1.it] INFO: Found listing with ID: CR75802
2026-03-28 12:05:45 [auto1.it] INFO: Found listing with ID: XM40674
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM40674%27 HTTP/1.1" 200 None
2026-03-28 12:05:45 [auto1.it] INFO: Scrape type for XM40674: 2
2026-03-28 12:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc0474c2-7577-5dd8-974e-4a310e0300c5 with identifier: XM40674
2026-03-28 12:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc0474c2-7577-5dd8-974e-4a310e0300c5 with scrape type 2
2026-03-28 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc0474c2-7577-5dd8-974e-4a310e0300c5 with scrape type 2
2026-03-28 12:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fc0474c2-7577-5dd8-974e-4a310e0300c5, identifier: XM40674
2026-03-28 12:05:45 [auto1.it] INFO: Found listing with ID: UZ86540
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ86540%27 HTTP/1.1" 200 None
2026-03-28 12:05:45 [auto1.it] INFO: Scrape type for UZ86540: 2
2026-03-28 12:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c9a58cb-00cc-5e89-9107-0f4c6045bc2f with identifier: UZ86540
2026-03-28 12:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c9a58cb-00cc-5e89-9107-0f4c6045bc2f with scrape type 2
2026-03-28 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c9a58cb-00cc-5e89-9107-0f4c6045bc2f with scrape type 2
2026-03-28 12:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8c9a58cb-00cc-5e89-9107-0f4c6045bc2f, identifier: UZ86540
2026-03-28 12:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fc0474c2-7577-5dd8-974e-4a310e0300c5 with identifier: XM40674
2026-03-28 12:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fc0474c2-7577-5dd8-974e-4a310e0300c5 with identifier: XM40674
2026-03-28 12:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fc0474c2-7577-5dd8-974e-4a310e0300c5 with identifier: XM40674 to the API
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 162,
'expiration_date': '2026-03-28T16:14:45Z',
'fuel_type': 'petrol',
'id': 'fc0474c2-7577-5dd8-974e-4a310e0300c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM40674',
'listing': 'auction',
'make': 'MG',
'model': 'HS',
'odometer': 61082,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-29',
'seller_name': None,
'title': 'MG HS 1.5 Luxury',
'transmission': 'automatic',
'trim': 'Luxury',
'year': 2024}
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM40674%27 HTTP/1.1" 200 None
2026-03-28 12:05:46 [auto1.it] INFO: Saving data for XM40674: {'auction_closing_time': 1774714485.0, 'created_time': 1774612893.398643, 'last_price_update_time': 1774699546.189691}
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XM40674') HTTP/1.1" 204 0
2026-03-28 12:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8c9a58cb-00cc-5e89-9107-0f4c6045bc2f with identifier: UZ86540
2026-03-28 12:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8c9a58cb-00cc-5e89-9107-0f4c6045bc2f with identifier: UZ86540
2026-03-28 12:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8c9a58cb-00cc-5e89-9107-0f4c6045bc2f with identifier: UZ86540 to the API
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:58:12Z',
'fuel_type': 'diesel',
'id': '8c9a58cb-00cc-5e89-9107-0f4c6045bc2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ86540',
'listing': 'auction',
'make': 'Jeep',
'model': 'Cherokee',
'odometer': 142732,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-07-25',
'seller_name': None,
'title': 'Jeep Cherokee 2.8 CRD Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2006}
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ86540%27 HTTP/1.1" 200 None
2026-03-28 12:05:46 [auto1.it] INFO: Saving data for UZ86540: {'auction_closing_time': 1774717092.0, 'created_time': 1774612901.963496, 'last_price_update_time': 1774699546.948119}
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UZ86540') HTTP/1.1" 204 0
2026-03-28 12:05:46 [auto1.it] INFO: Found listing with ID: GY05881
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY05881%27 HTTP/1.1" 200 None
2026-03-28 12:05:46 [auto1.it] INFO: Scrape type for GY05881: 2
2026-03-28 12:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bc7a086-511a-517e-898e-5f8478534490 with identifier: GY05881
2026-03-28 12:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bc7a086-511a-517e-898e-5f8478534490 with scrape type 2
2026-03-28 12:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bc7a086-511a-517e-898e-5f8478534490 with scrape type 2
2026-03-28 12:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0bc7a086-511a-517e-898e-5f8478534490, identifier: GY05881
2026-03-28 12:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0bc7a086-511a-517e-898e-5f8478534490 with identifier: GY05881
2026-03-28 12:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0bc7a086-511a-517e-898e-5f8478534490 with identifier: GY05881
2026-03-28 12:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0bc7a086-511a-517e-898e-5f8478534490 with identifier: GY05881 to the API
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:08:18Z',
'fuel_type': 'diesel',
'id': '0bc7a086-511a-517e-898e-5f8478534490',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY05881',
'listing': 'auction',
'make': 'Kia',
'model': 'Carens',
'odometer': 151776,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-16',
'seller_name': None,
'title': 'Kia Carens 1.7 CRDi Cool',
'transmission': 'manual',
'trim': 'Cool',
'year': 2013}
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY05881%27 HTTP/1.1" 200 None
2026-03-28 12:05:47 [auto1.it] INFO: Saving data for GY05881: {'auction_closing_time': 1774714098.0, 'created_time': 1772224531.844079, 'last_price_update_time': 1774699547.421358}
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GY05881') HTTP/1.1" 204 0
2026-03-28 12:05:47 [auto1.it] INFO: Found listing with ID: BS72965
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS72965%27 HTTP/1.1" 200 None
2026-03-28 12:05:47 [auto1.it] INFO: Scrape type for BS72965: 2
2026-03-28 12:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57325b8e-182d-5f4b-8446-cb62b9323f85 with identifier: BS72965
2026-03-28 12:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57325b8e-182d-5f4b-8446-cb62b9323f85 with scrape type 2
2026-03-28 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57325b8e-182d-5f4b-8446-cb62b9323f85 with scrape type 2
2026-03-28 12:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 57325b8e-182d-5f4b-8446-cb62b9323f85, identifier: BS72965
2026-03-28 12:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 57325b8e-182d-5f4b-8446-cb62b9323f85 with identifier: BS72965
2026-03-28 12:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 57325b8e-182d-5f4b-8446-cb62b9323f85 with identifier: BS72965
2026-03-28 12:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 57325b8e-182d-5f4b-8446-cb62b9323f85 with identifier: BS72965 to the API
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:31:37Z',
'fuel_type': 'diesel',
'id': '57325b8e-182d-5f4b-8446-cb62b9323f85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS72965',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 110147,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-23',
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi Laureate 4x2',
'transmission': 'manual',
'trim': 'Laureate 4x2',
'year': 2014}
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS72965%27 HTTP/1.1" 200 None
2026-03-28 12:05:47 [auto1.it] INFO: Saving data for BS72965: {'auction_closing_time': 1774715497.0, 'created_time': 1773130700.924882, 'last_price_update_time': 1774699547.941973}
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BS72965') HTTP/1.1" 204 0
2026-03-28 12:05:47 [auto1.it] INFO: Found listing with ID: HR54236
2026-03-28 12:05:47 [auto1.it] INFO: Found listing with ID: UD54750
2026-03-28 12:05:47 [auto1.it] INFO: Found listing with ID: AK67199
2026-03-28 12:05:47 [auto1.it] INFO: Found listing with ID: WL39771
2026-03-28 12:05:47 [auto1.it] INFO: Found listing with ID: KW57065
2026-03-28 12:05:47 [auto1.it] INFO: Found listing with ID: MW60739
2026-03-28 12:05:47 [auto1.it] INFO: Found listing with ID: LM66726
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM66726%27 HTTP/1.1" 200 None
2026-03-28 12:05:47 [auto1.it] INFO: Scrape type for LM66726: 2
2026-03-28 12:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03791853-11c4-588c-bd9f-829b38bfdbb5 with identifier: LM66726
2026-03-28 12:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03791853-11c4-588c-bd9f-829b38bfdbb5 with scrape type 2
2026-03-28 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03791853-11c4-588c-bd9f-829b38bfdbb5 with scrape type 2
2026-03-28 12:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 03791853-11c4-588c-bd9f-829b38bfdbb5, identifier: LM66726
2026-03-28 12:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 03791853-11c4-588c-bd9f-829b38bfdbb5 with identifier: LM66726
2026-03-28 12:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 03791853-11c4-588c-bd9f-829b38bfdbb5 with identifier: LM66726
2026-03-28 12:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 03791853-11c4-588c-bd9f-829b38bfdbb5 with identifier: LM66726 to the API
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:25:07Z',
'fuel_type': 'diesel',
'id': '03791853-11c4-588c-bd9f-829b38bfdbb5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM66726',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 81283,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-29',
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Longitude FWD',
'transmission': 'automatic',
'trim': 'Longitude FWD',
'year': 2019}
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM66726%27 HTTP/1.1" 200 None
2026-03-28 12:05:48 [auto1.it] INFO: Saving data for LM66726: {'auction_closing_time': 1774715107.0, 'created_time': 1772626095.751312, 'last_price_update_time': 1774699548.378009}
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LM66726') HTTP/1.1" 204 0
2026-03-28 12:05:48 [auto1.it] INFO: Found listing with ID: GT76958
2026-03-28 12:05:48 [auto1.it] INFO: Found listing with ID: VA29565
2026-03-28 12:05:48 [auto1.it] INFO: Found listing with ID: TC64761
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC64761%27 HTTP/1.1" 200 None
2026-03-28 12:05:48 [auto1.it] INFO: Scrape type for TC64761: 2
2026-03-28 12:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73a8b2bc-0ec8-522d-95a9-6536c2f66af8 with identifier: TC64761
2026-03-28 12:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73a8b2bc-0ec8-522d-95a9-6536c2f66af8 with scrape type 2
2026-03-28 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73a8b2bc-0ec8-522d-95a9-6536c2f66af8 with scrape type 2
2026-03-28 12:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 73a8b2bc-0ec8-522d-95a9-6536c2f66af8, identifier: TC64761
2026-03-28 12:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 73a8b2bc-0ec8-522d-95a9-6536c2f66af8 with identifier: TC64761
2026-03-28 12:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 73a8b2bc-0ec8-522d-95a9-6536c2f66af8 with identifier: TC64761
2026-03-28 12:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 73a8b2bc-0ec8-522d-95a9-6536c2f66af8 with identifier: TC64761 to the API
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:42:15Z',
'fuel_type': 'diesel',
'id': '73a8b2bc-0ec8-522d-95a9-6536c2f66af8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC64761',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 207278,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-23',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 CDI Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2017}
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC64761%27 HTTP/1.1" 200 None
2026-03-28 12:05:48 [auto1.it] INFO: Saving data for TC64761: {'auction_closing_time': 1774716135.0, 'created_time': 1773236786.164906, 'last_price_update_time': 1774699548.777527}
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TC64761') HTTP/1.1" 204 0
2026-03-28 12:05:48 [auto1.it] INFO: Found listing with ID: YH58285
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH58285%27 HTTP/1.1" 200 None
2026-03-28 12:05:48 [auto1.it] INFO: Scrape type for YH58285: 2
2026-03-28 12:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0ab7458-fead-5924-bfe6-c703a0890790 with identifier: YH58285
2026-03-28 12:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0ab7458-fead-5924-bfe6-c703a0890790 with scrape type 2
2026-03-28 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0ab7458-fead-5924-bfe6-c703a0890790 with scrape type 2
2026-03-28 12:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c0ab7458-fead-5924-bfe6-c703a0890790, identifier: YH58285
2026-03-28 12:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c0ab7458-fead-5924-bfe6-c703a0890790 with identifier: YH58285
2026-03-28 12:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c0ab7458-fead-5924-bfe6-c703a0890790 with identifier: YH58285
2026-03-28 12:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c0ab7458-fead-5924-bfe6-c703a0890790 with identifier: YH58285 to the API
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-28T16:48:41Z',
'fuel_type': 'diesel',
'id': 'c0ab7458-fead-5924-bfe6-c703a0890790',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH58285',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 94002,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-06',
'seller_name': None,
'title': 'Audi A6 40 TDI Mild-Hybrid quattro Advanced',
'transmission': 'automatic',
'trim': 'quattro Advanced',
'year': 2023}
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH58285%27 HTTP/1.1" 200 None
2026-03-28 12:05:49 [auto1.it] INFO: Saving data for YH58285: {'auction_closing_time': 1774716521.0, 'created_time': 1774612981.406348, 'last_price_update_time': 1774699549.29935}
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YH58285') HTTP/1.1" 204 0
2026-03-28 12:05:49 [auto1.it] INFO: Found listing with ID: FM13591
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM13591%27 HTTP/1.1" 200 None
2026-03-28 12:05:49 [auto1.it] INFO: Scrape type for FM13591: 2
2026-03-28 12:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d77c24bb-72f0-54d5-a1e9-d60dc248c55a with identifier: FM13591
2026-03-28 12:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d77c24bb-72f0-54d5-a1e9-d60dc248c55a with scrape type 2
2026-03-28 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d77c24bb-72f0-54d5-a1e9-d60dc248c55a with scrape type 2
2026-03-28 12:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d77c24bb-72f0-54d5-a1e9-d60dc248c55a, identifier: FM13591
2026-03-28 12:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d77c24bb-72f0-54d5-a1e9-d60dc248c55a with identifier: FM13591
2026-03-28 12:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d77c24bb-72f0-54d5-a1e9-d60dc248c55a with identifier: FM13591
2026-03-28 12:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d77c24bb-72f0-54d5-a1e9-d60dc248c55a with identifier: FM13591 to the API
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:33:32Z',
'fuel_type': 'diesel',
'id': 'd77c24bb-72f0-54d5-a1e9-d60dc248c55a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM13591',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 150209,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-18',
'seller_name': None,
'title': 'Land Rover Evoque D150 Mild-Hybrid S',
'transmission': 'automatic',
'trim': 'S',
'year': 2020}
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM13591%27 HTTP/1.1" 200 None
2026-03-28 12:05:49 [auto1.it] INFO: Saving data for FM13591: {'auction_closing_time': 1774715612.0, 'created_time': 1774612922.955032, 'last_price_update_time': 1774699549.717591}
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FM13591') HTTP/1.1" 204 0
2026-03-28 12:05:49 [auto1.it] INFO: Found listing with ID: BJ23148
2026-03-28 12:05:49 [auto1.it] INFO: Found listing with ID: YJ83729
2026-03-28 12:05:49 [auto1.it] INFO: Found listing with ID: FJ55026
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ55026%27 HTTP/1.1" 200 None
2026-03-28 12:05:49 [auto1.it] INFO: Scrape type for FJ55026: 2
2026-03-28 12:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a0cd5ec-28cb-51b4-83e9-7f26218a7e86 with identifier: FJ55026
2026-03-28 12:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a0cd5ec-28cb-51b4-83e9-7f26218a7e86 with scrape type 2
2026-03-28 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a0cd5ec-28cb-51b4-83e9-7f26218a7e86 with scrape type 2
2026-03-28 12:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5a0cd5ec-28cb-51b4-83e9-7f26218a7e86, identifier: FJ55026
2026-03-28 12:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5a0cd5ec-28cb-51b4-83e9-7f26218a7e86 with identifier: FJ55026
2026-03-28 12:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5a0cd5ec-28cb-51b4-83e9-7f26218a7e86 with identifier: FJ55026
2026-03-28 12:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5a0cd5ec-28cb-51b4-83e9-7f26218a7e86 with identifier: FJ55026 to the API
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:59:34Z',
'fuel_type': 'petrol',
'id': '5a0cd5ec-28cb-51b4-83e9-7f26218a7e86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ55026',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kamiq',
'odometer': 121801,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-27',
'seller_name': None,
'title': 'Skoda Kamiq 1.0 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2020}
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ55026%27 HTTP/1.1" 200 None
2026-03-28 12:05:50 [auto1.it] INFO: Saving data for FJ55026: {'auction_closing_time': 1774717174.0, 'created_time': 1774612978.888412, 'last_price_update_time': 1774699550.098166}
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FJ55026') HTTP/1.1" 204 0
2026-03-28 12:05:50 [auto1.it] INFO: Channel: 24h | Page: 77 | totalHits: 3673 | hits on page: 40
2026-03-28 12:05:50 [auto1.it] INFO: Found listing with ID: RV64880
2026-03-28 12:05:50 [auto1.it] INFO: Found listing with ID: PS94410
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS94410%27 HTTP/1.1" 200 None
2026-03-28 12:05:50 [auto1.it] INFO: Scrape type for PS94410: 2
2026-03-28 12:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44dd245a-b2ac-5328-851e-cc3437b26a08 with identifier: PS94410
2026-03-28 12:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44dd245a-b2ac-5328-851e-cc3437b26a08 with scrape type 2
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44dd245a-b2ac-5328-851e-cc3437b26a08 with scrape type 2
2026-03-28 12:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 44dd245a-b2ac-5328-851e-cc3437b26a08, identifier: PS94410
2026-03-28 12:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 44dd245a-b2ac-5328-851e-cc3437b26a08 with identifier: PS94410
2026-03-28 12:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 44dd245a-b2ac-5328-851e-cc3437b26a08 with identifier: PS94410
2026-03-28 12:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 44dd245a-b2ac-5328-851e-cc3437b26a08 with identifier: PS94410 to the API
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:22:25Z',
'fuel_type': 'petrol',
'id': '44dd245a-b2ac-5328-851e-cc3437b26a08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS94410',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 69702,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-13',
'seller_name': None,
'title': 'Volkswagen T-Cross 1.0 TSI Advanced',
'transmission': 'manual',
'trim': 'Advanced',
'year': 2022}
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS94410%27 HTTP/1.1" 200 None
2026-03-28 12:05:50 [auto1.it] INFO: Saving data for PS94410: {'auction_closing_time': 1774714945.0, 'created_time': 1774612926.528478, 'last_price_update_time': 1774699550.53107}
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PS94410') HTTP/1.1" 204 0
2026-03-28 12:05:50 [auto1.it] INFO: Found listing with ID: DC04279
2026-03-28 12:05:50 [auto1.it] INFO: Found listing with ID: BH96807
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH96807%27 HTTP/1.1" 200 None
2026-03-28 12:05:50 [auto1.it] INFO: Scrape type for BH96807: 2
2026-03-28 12:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ce80b76-14f6-585b-855c-ba8accc57401 with identifier: BH96807
2026-03-28 12:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ce80b76-14f6-585b-855c-ba8accc57401 with scrape type 2
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ce80b76-14f6-585b-855c-ba8accc57401 with scrape type 2
2026-03-28 12:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4ce80b76-14f6-585b-855c-ba8accc57401, identifier: BH96807
2026-03-28 12:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:50 [auto1.it] INFO: Found listing with ID: PW94940
2026-03-28 12:05:50 [auto1.it] INFO: Found listing with ID: PK39445
2026-03-28 12:05:50 [auto1.it] INFO: Found listing with ID: HC25835
2026-03-28 12:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4ce80b76-14f6-585b-855c-ba8accc57401 with identifier: BH96807
2026-03-28 12:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4ce80b76-14f6-585b-855c-ba8accc57401 with identifier: BH96807
2026-03-28 12:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4ce80b76-14f6-585b-855c-ba8accc57401 with identifier: BH96807 to the API
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:05:06Z',
'fuel_type': 'diesel',
'id': '4ce80b76-14f6-585b-855c-ba8accc57401',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH96807',
'listing': 'auction',
'make': 'Kia',
'model': 'Sorento',
'odometer': 192005,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-13',
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi R 4WD',
'transmission': 'automatic',
'trim': 'R 4WD',
'year': 2017}
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH96807%27 HTTP/1.1" 200 None
2026-03-28 12:05:50 [auto1.it] INFO: Saving data for BH96807: {'auction_closing_time': 1774713906.0, 'created_time': 1774612985.913429, 'last_price_update_time': 1774699550.924434}
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BH96807') HTTP/1.1" 204 0
2026-03-28 12:05:51 [auto1.it] INFO: Found listing with ID: WP65731
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP65731%27 HTTP/1.1" 200 None
2026-03-28 12:05:51 [auto1.it] INFO: Scrape type for WP65731: 2
2026-03-28 12:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58cc1284-0048-58cc-88bf-a194878d926b with identifier: WP65731
2026-03-28 12:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58cc1284-0048-58cc-88bf-a194878d926b with scrape type 2
2026-03-28 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58cc1284-0048-58cc-88bf-a194878d926b with scrape type 2
2026-03-28 12:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 58cc1284-0048-58cc-88bf-a194878d926b, identifier: WP65731
2026-03-28 12:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 58cc1284-0048-58cc-88bf-a194878d926b with identifier: WP65731
2026-03-28 12:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 58cc1284-0048-58cc-88bf-a194878d926b with identifier: WP65731
2026-03-28 12:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 58cc1284-0048-58cc-88bf-a194878d926b with identifier: WP65731 to the API
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:35:51Z',
'fuel_type': 'diesel',
'id': '58cc1284-0048-58cc-88bf-a194878d926b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP65731',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 241467,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-07',
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2013}
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP65731%27 HTTP/1.1" 200 None
2026-03-28 12:05:51 [auto1.it] INFO: Saving data for WP65731: {'auction_closing_time': 1774715751.0, 'created_time': 1773129820.558079, 'last_price_update_time': 1774699551.440645}
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WP65731') HTTP/1.1" 204 0
2026-03-28 12:05:51 [auto1.it] INFO: Found listing with ID: EH79430
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH79430%27 HTTP/1.1" 200 None
2026-03-28 12:05:51 [auto1.it] INFO: Scrape type for EH79430: 2
2026-03-28 12:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a530b8fd-2d5b-5567-84b2-ef2e5c0c0533 with identifier: EH79430
2026-03-28 12:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a530b8fd-2d5b-5567-84b2-ef2e5c0c0533 with scrape type 2
2026-03-28 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a530b8fd-2d5b-5567-84b2-ef2e5c0c0533 with scrape type 2
2026-03-28 12:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a530b8fd-2d5b-5567-84b2-ef2e5c0c0533, identifier: EH79430
2026-03-28 12:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a530b8fd-2d5b-5567-84b2-ef2e5c0c0533 with identifier: EH79430
2026-03-28 12:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a530b8fd-2d5b-5567-84b2-ef2e5c0c0533 with identifier: EH79430
2026-03-28 12:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a530b8fd-2d5b-5567-84b2-ef2e5c0c0533 with identifier: EH79430 to the API
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-28T16:26:58Z',
'fuel_type': 'diesel',
'id': 'a530b8fd-2d5b-5567-84b2-ef2e5c0c0533',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH79430',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 191032,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-21',
'seller_name': None,
'title': 'Peugeot 2008 1.6 e-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2014}
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH79430%27 HTTP/1.1" 200 None
2026-03-28 12:05:51 [auto1.it] INFO: Saving data for EH79430: {'auction_closing_time': 1774715218.0, 'created_time': 1774612929.475859, 'last_price_update_time': 1774699551.852108}
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EH79430') HTTP/1.1" 204 0
2026-03-28 12:05:51 [auto1.it] INFO: Found listing with ID: YB05417
2026-03-28 12:05:51 [auto1.it] INFO: Found listing with ID: XB62766
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB62766%27 HTTP/1.1" 200 None
2026-03-28 12:05:51 [auto1.it] INFO: Scrape type for XB62766: 2
2026-03-28 12:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 645d88b5-3758-5604-9586-196b0f40fed2 with identifier: XB62766
2026-03-28 12:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 645d88b5-3758-5604-9586-196b0f40fed2 with scrape type 2
2026-03-28 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 645d88b5-3758-5604-9586-196b0f40fed2 with scrape type 2
2026-03-28 12:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 645d88b5-3758-5604-9586-196b0f40fed2, identifier: XB62766
2026-03-28 12:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 645d88b5-3758-5604-9586-196b0f40fed2 with identifier: XB62766
2026-03-28 12:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 645d88b5-3758-5604-9586-196b0f40fed2 with identifier: XB62766
2026-03-28 12:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 645d88b5-3758-5604-9586-196b0f40fed2 with identifier: XB62766 to the API
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:58:19Z',
'fuel_type': 'diesel',
'id': '645d88b5-3758-5604-9586-196b0f40fed2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB62766',
'listing': 'auction',
'make': 'Lancia',
'model': 'Delta',
'odometer': 332502,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-03',
'seller_name': None,
'title': 'Lancia Delta 1.6 Diesel Gold',
'transmission': 'automatic',
'trim': 'Gold',
'year': 2012}
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB62766%27 HTTP/1.1" 200 None
2026-03-28 12:05:52 [auto1.it] INFO: Saving data for XB62766: {'auction_closing_time': 1774717099.0, 'created_time': 1773135999.904243, 'last_price_update_time': 1774699552.2638}
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XB62766') HTTP/1.1" 204 0
2026-03-28 12:05:52 [auto1.it] INFO: Found listing with ID: CN31542
2026-03-28 12:05:52 [auto1.it] INFO: Found listing with ID: DY75013
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY75013%27 HTTP/1.1" 200 None
2026-03-28 12:05:52 [auto1.it] INFO: Scrape type for DY75013: 2
2026-03-28 12:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eb8906e-7dec-5c7f-b61c-965f55f366f1 with identifier: DY75013
2026-03-28 12:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eb8906e-7dec-5c7f-b61c-965f55f366f1 with scrape type 2
2026-03-28 12:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4eb8906e-7dec-5c7f-b61c-965f55f366f1 with scrape type 2
2026-03-28 12:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4eb8906e-7dec-5c7f-b61c-965f55f366f1, identifier: DY75013
2026-03-28 12:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4eb8906e-7dec-5c7f-b61c-965f55f366f1 with identifier: DY75013
2026-03-28 12:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4eb8906e-7dec-5c7f-b61c-965f55f366f1 with identifier: DY75013
2026-03-28 12:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4eb8906e-7dec-5c7f-b61c-965f55f366f1 with identifier: DY75013 to the API
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:45:54Z',
'fuel_type': 'diesel',
'id': '4eb8906e-7dec-5c7f-b61c-965f55f366f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY75013',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 273481,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-27',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2013}
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY75013%27 HTTP/1.1" 200 None
2026-03-28 12:05:52 [auto1.it] INFO: Saving data for DY75013: {'auction_closing_time': 1774716354.0, 'created_time': 1774612979.325246, 'last_price_update_time': 1774699552.739504}
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DY75013') HTTP/1.1" 204 0
2026-03-28 12:05:52 [auto1.it] INFO: Found listing with ID: UC13059
2026-03-28 12:05:52 [auto1.it] INFO: Found listing with ID: RU19351
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU19351%27 HTTP/1.1" 200 None
2026-03-28 12:05:52 [auto1.it] INFO: Scrape type for RU19351: 2
2026-03-28 12:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f29395ac-b207-57fd-98af-5d84cad0395e with identifier: RU19351
2026-03-28 12:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f29395ac-b207-57fd-98af-5d84cad0395e with scrape type 2
2026-03-28 12:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f29395ac-b207-57fd-98af-5d84cad0395e with scrape type 2
2026-03-28 12:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f29395ac-b207-57fd-98af-5d84cad0395e, identifier: RU19351
2026-03-28 12:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f29395ac-b207-57fd-98af-5d84cad0395e with identifier: RU19351
2026-03-28 12:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f29395ac-b207-57fd-98af-5d84cad0395e with identifier: RU19351
2026-03-28 12:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f29395ac-b207-57fd-98af-5d84cad0395e with identifier: RU19351 to the API
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:21:31Z',
'fuel_type': 'petrol',
'id': 'f29395ac-b207-57fd-98af-5d84cad0395e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU19351',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Picasso',
'odometer': 162889,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-29',
'seller_name': None,
'title': 'Citroen C3 Picasso 1.4 VTi Seduction',
'transmission': 'manual',
'trim': 'Seduction',
'year': 2013}
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU19351%27 HTTP/1.1" 200 None
2026-03-28 12:05:53 [auto1.it] INFO: Saving data for RU19351: {'auction_closing_time': 1774714891.0, 'created_time': 1772951944.696338, 'last_price_update_time': 1774699553.156893}
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RU19351') HTTP/1.1" 204 0
2026-03-28 12:05:53 [auto1.it] INFO: Found listing with ID: JX57169
2026-03-28 12:05:53 [auto1.it] INFO: Found listing with ID: AE05588
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE05588%27 HTTP/1.1" 200 None
2026-03-28 12:05:53 [auto1.it] INFO: Scrape type for AE05588: 2
2026-03-28 12:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d305b93-8601-5e44-9edf-4ed54c3c3105 with identifier: AE05588
2026-03-28 12:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d305b93-8601-5e44-9edf-4ed54c3c3105 with scrape type 2
2026-03-28 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d305b93-8601-5e44-9edf-4ed54c3c3105 with scrape type 2
2026-03-28 12:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6d305b93-8601-5e44-9edf-4ed54c3c3105, identifier: AE05588
2026-03-28 12:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6d305b93-8601-5e44-9edf-4ed54c3c3105 with identifier: AE05588
2026-03-28 12:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6d305b93-8601-5e44-9edf-4ed54c3c3105 with identifier: AE05588
2026-03-28 12:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6d305b93-8601-5e44-9edf-4ed54c3c3105 with identifier: AE05588 to the API
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:18:42Z',
'fuel_type': 'diesel',
'id': '6d305b93-8601-5e44-9edf-4ed54c3c3105',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE05588',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 167026,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-25',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI',
'transmission': 'manual',
'trim': '',
'year': 2019}
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE05588%27 HTTP/1.1" 200 None
2026-03-28 12:05:53 [auto1.it] INFO: Saving data for AE05588: {'auction_closing_time': 1774714722.0, 'created_time': 1774040587.425867, 'last_price_update_time': 1774699553.575654}
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AE05588') HTTP/1.1" 204 0
2026-03-28 12:05:53 [auto1.it] INFO: Found listing with ID: ZJ55913
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ55913%27 HTTP/1.1" 200 None
2026-03-28 12:05:53 [auto1.it] INFO: Scrape type for ZJ55913: 0
2026-03-28 12:05:53 [auto1.it] INFO: Found listing with ID: AT75049
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT75049%27 HTTP/1.1" 200 None
2026-03-28 12:05:53 [auto1.it] INFO: Scrape type for AT75049: 2
2026-03-28 12:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7c3c513-619d-5a4a-b60e-c84e11b72c52 with identifier: AT75049
2026-03-28 12:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7c3c513-619d-5a4a-b60e-c84e11b72c52 with scrape type 2
2026-03-28 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7c3c513-619d-5a4a-b60e-c84e11b72c52 with scrape type 2
2026-03-28 12:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c7c3c513-619d-5a4a-b60e-c84e11b72c52, identifier: AT75049
2026-03-28 12:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c7c3c513-619d-5a4a-b60e-c84e11b72c52 with identifier: AT75049
2026-03-28 12:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c7c3c513-619d-5a4a-b60e-c84e11b72c52 with identifier: AT75049
2026-03-28 12:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c7c3c513-619d-5a4a-b60e-c84e11b72c52 with identifier: AT75049 to the API
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:49:03Z',
'fuel_type': 'petrol',
'id': 'c7c3c513-619d-5a4a-b60e-c84e11b72c52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT75049',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 45737,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-30',
'seller_name': None,
'title': 'Fiat Panda 1.2 Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2015}
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT75049%27 HTTP/1.1" 200 None
2026-03-28 12:05:53 [auto1.it] INFO: Saving data for AT75049: {'auction_closing_time': 1774716543.0, 'created_time': 1774612977.95203, 'last_price_update_time': 1774699553.987574}
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AT75049') HTTP/1.1" 204 0
2026-03-28 12:05:54 [auto1.it] INFO: Found listing with ID: SE76395
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE76395%27 HTTP/1.1" 200 None
2026-03-28 12:05:54 [auto1.it] INFO: Scrape type for SE76395: 2
2026-03-28 12:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 670ebd20-962f-5717-bab4-0b87d617b767 with identifier: SE76395
2026-03-28 12:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 670ebd20-962f-5717-bab4-0b87d617b767 with scrape type 2
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 670ebd20-962f-5717-bab4-0b87d617b767 with scrape type 2
2026-03-28 12:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 670ebd20-962f-5717-bab4-0b87d617b767, identifier: SE76395
2026-03-28 12:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 670ebd20-962f-5717-bab4-0b87d617b767 with identifier: SE76395
2026-03-28 12:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 670ebd20-962f-5717-bab4-0b87d617b767 with identifier: SE76395
2026-03-28 12:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 670ebd20-962f-5717-bab4-0b87d617b767 with identifier: SE76395 to the API
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-28T16:51:43Z',
'fuel_type': 'petrol',
'id': '670ebd20-962f-5717-bab4-0b87d617b767',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE76395',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 107689,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-27',
'seller_name': None,
'title': 'Peugeot 2008 1.2 e-VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2018}
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE76395%27 HTTP/1.1" 200 None
2026-03-28 12:05:54 [auto1.it] INFO: Saving data for SE76395: {'auction_closing_time': 1774716703.0, 'created_time': 1773132757.618497, 'last_price_update_time': 1774699554.533978}
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SE76395') HTTP/1.1" 204 0
2026-03-28 12:05:54 [auto1.it] INFO: Found listing with ID: MB12953
2026-03-28 12:05:54 [auto1.it] INFO: Found listing with ID: GU93940
2026-03-28 12:05:54 [auto1.it] INFO: Found listing with ID: LW86872
2026-03-28 12:05:54 [auto1.it] INFO: Found listing with ID: LE96160
2026-03-28 12:05:54 [auto1.it] INFO: Found listing with ID: FU73160
2026-03-28 12:05:54 [auto1.it] INFO: Found listing with ID: UF29900
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF29900%27 HTTP/1.1" 200 None
2026-03-28 12:05:54 [auto1.it] INFO: Scrape type for UF29900: 2
2026-03-28 12:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d459eea4-635f-5f6a-a0f7-88e8f1e3d75d with identifier: UF29900
2026-03-28 12:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d459eea4-635f-5f6a-a0f7-88e8f1e3d75d with scrape type 2
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d459eea4-635f-5f6a-a0f7-88e8f1e3d75d with scrape type 2
2026-03-28 12:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d459eea4-635f-5f6a-a0f7-88e8f1e3d75d, identifier: UF29900
2026-03-28 12:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d459eea4-635f-5f6a-a0f7-88e8f1e3d75d with identifier: UF29900
2026-03-28 12:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d459eea4-635f-5f6a-a0f7-88e8f1e3d75d with identifier: UF29900
2026-03-28 12:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d459eea4-635f-5f6a-a0f7-88e8f1e3d75d with identifier: UF29900 to the API
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:06:04Z',
'fuel_type': 'petrol',
'id': 'd459eea4-635f-5f6a-a0f7-88e8f1e3d75d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF29900',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 143660,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-26',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.0 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2021}
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF29900%27 HTTP/1.1" 200 None
2026-03-28 12:05:54 [auto1.it] INFO: Saving data for UF29900: {'auction_closing_time': 1774713964.0, 'created_time': 1772951994.03307, 'last_price_update_time': 1774699554.946106}
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UF29900') HTTP/1.1" 204 0
2026-03-28 12:05:54 [auto1.it] INFO: Channel: 24h | Page: 78 | totalHits: 3673 | hits on page: 40
2026-03-28 12:05:54 [auto1.it] INFO: Found listing with ID: GM73700
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM73700%27 HTTP/1.1" 200 None
2026-03-28 12:05:54 [auto1.it] INFO: Scrape type for GM73700: 2
2026-03-28 12:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2c247ff-1cd1-5c13-99f4-8cf0a05e3287 with identifier: GM73700
2026-03-28 12:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2c247ff-1cd1-5c13-99f4-8cf0a05e3287 with scrape type 2
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2c247ff-1cd1-5c13-99f4-8cf0a05e3287 with scrape type 2
2026-03-28 12:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d2c247ff-1cd1-5c13-99f4-8cf0a05e3287, identifier: GM73700
2026-03-28 12:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d2c247ff-1cd1-5c13-99f4-8cf0a05e3287 with identifier: GM73700
2026-03-28 12:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d2c247ff-1cd1-5c13-99f4-8cf0a05e3287 with identifier: GM73700
2026-03-28 12:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d2c247ff-1cd1-5c13-99f4-8cf0a05e3287 with identifier: GM73700 to the API
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:30:11Z',
'fuel_type': 'petrol',
'id': 'd2c247ff-1cd1-5c13-99f4-8cf0a05e3287',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM73700',
'listing': 'auction',
'make': 'Ford',
'model': 'EcoSport',
'odometer': 87961,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-27',
'seller_name': None,
'title': 'Ford EcoSport 1.0 EcoBoost Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2021}
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM73700%27 HTTP/1.1" 200 None
2026-03-28 12:05:55 [auto1.it] INFO: Saving data for GM73700: {'auction_closing_time': 1774715411.0, 'created_time': 1774613002.726491, 'last_price_update_time': 1774699555.364203}
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GM73700') HTTP/1.1" 204 0
2026-03-28 12:05:55 [auto1.it] INFO: Found listing with ID: BJ52580
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ52580%27 HTTP/1.1" 200 None
2026-03-28 12:05:55 [auto1.it] INFO: Scrape type for BJ52580: 2
2026-03-28 12:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d72dc3c-6417-506e-864e-81ac31fea6ab with identifier: BJ52580
2026-03-28 12:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d72dc3c-6417-506e-864e-81ac31fea6ab with scrape type 2
2026-03-28 12:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d72dc3c-6417-506e-864e-81ac31fea6ab with scrape type 2
2026-03-28 12:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2d72dc3c-6417-506e-864e-81ac31fea6ab, identifier: BJ52580
2026-03-28 12:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:55 [auto1.it] INFO: Found listing with ID: JP63485
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP63485%27 HTTP/1.1" 200 None
2026-03-28 12:05:55 [auto1.it] INFO: Scrape type for JP63485: 2
2026-03-28 12:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5259d30d-cb9d-5691-8f85-c0399bf933db with identifier: JP63485
2026-03-28 12:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5259d30d-cb9d-5691-8f85-c0399bf933db with scrape type 2
2026-03-28 12:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5259d30d-cb9d-5691-8f85-c0399bf933db with scrape type 2
2026-03-28 12:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5259d30d-cb9d-5691-8f85-c0399bf933db, identifier: JP63485
2026-03-28 12:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2d72dc3c-6417-506e-864e-81ac31fea6ab with identifier: BJ52580
2026-03-28 12:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2d72dc3c-6417-506e-864e-81ac31fea6ab with identifier: BJ52580
2026-03-28 12:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2d72dc3c-6417-506e-864e-81ac31fea6ab with identifier: BJ52580 to the API
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 65,
'expiration_date': '2026-03-28T16:33:33Z',
'fuel_type': 'petrol',
'id': '2d72dc3c-6417-506e-864e-81ac31fea6ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ52580',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 63397,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-12-03',
'seller_name': None,
'title': 'Seat Ibiza 1.2 Stella',
'transmission': 'manual',
'trim': 'Stella',
'year': 2002}
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ52580%27 HTTP/1.1" 200 None
2026-03-28 12:05:55 [auto1.it] INFO: Saving data for BJ52580: {'auction_closing_time': 1774715613.0, 'created_time': 1774612983.881091, 'last_price_update_time': 1774699555.857162}
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BJ52580') HTTP/1.1" 204 0
2026-03-28 12:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5259d30d-cb9d-5691-8f85-c0399bf933db with identifier: JP63485
2026-03-28 12:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5259d30d-cb9d-5691-8f85-c0399bf933db with identifier: JP63485
2026-03-28 12:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5259d30d-cb9d-5691-8f85-c0399bf933db with identifier: JP63485 to the API
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 340,
'expiration_date': '2026-03-28T16:59:01Z',
'fuel_type': 'diesel',
'id': '5259d30d-cb9d-5691-8f85-c0399bf933db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP63485',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 189396,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-25',
'seller_name': None,
'title': 'BMW 5er 540d Mild-Hybrid xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2021}
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP63485%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [auto1.it] INFO: Saving data for JP63485: {'auction_closing_time': 1774717141.0, 'created_time': 1774300043.789731, 'last_price_update_time': 1774699556.148904}
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JP63485') HTTP/1.1" 204 0
2026-03-28 12:05:56 [auto1.it] INFO: Found listing with ID: BN67984
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN67984%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [auto1.it] INFO: Scrape type for BN67984: 2
2026-03-28 12:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d266f65-3f7a-53cc-ac76-3feb289ecf1d with identifier: BN67984
2026-03-28 12:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d266f65-3f7a-53cc-ac76-3feb289ecf1d with scrape type 2
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d266f65-3f7a-53cc-ac76-3feb289ecf1d with scrape type 2
2026-03-28 12:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4d266f65-3f7a-53cc-ac76-3feb289ecf1d, identifier: BN67984
2026-03-28 12:05:56 [auto1.it] INFO: Found listing with ID: AB86109
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB86109%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [auto1.it] INFO: Scrape type for AB86109: 2
2026-03-28 12:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52f7f5a0-95f0-590f-b9c1-4c101917c083 with identifier: AB86109
2026-03-28 12:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52f7f5a0-95f0-590f-b9c1-4c101917c083 with scrape type 2
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52f7f5a0-95f0-590f-b9c1-4c101917c083 with scrape type 2
2026-03-28 12:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 52f7f5a0-95f0-590f-b9c1-4c101917c083, identifier: AB86109
2026-03-28 12:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4d266f65-3f7a-53cc-ac76-3feb289ecf1d with identifier: BN67984
2026-03-28 12:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4d266f65-3f7a-53cc-ac76-3feb289ecf1d with identifier: BN67984
2026-03-28 12:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4d266f65-3f7a-53cc-ac76-3feb289ecf1d with identifier: BN67984 to the API
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 88,
'expiration_date': '2026-03-28T16:24:01Z',
'fuel_type': 'petrol',
'id': '4d266f65-3f7a-53cc-ac76-3feb289ecf1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN67984',
'listing': 'auction',
'make': 'Peugeot',
'model': '307',
'odometer': 167477,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-05-31',
'seller_name': None,
'title': 'Peugeot 307 1.4 XR Presence',
'transmission': 'manual',
'trim': 'XR Presence',
'year': 2004}
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN67984%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [auto1.it] INFO: Saving data for BN67984: {'auction_closing_time': 1774715041.0, 'created_time': 1774612946.353073, 'last_price_update_time': 1774699556.624806}
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BN67984') HTTP/1.1" 204 0
2026-03-28 12:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 52f7f5a0-95f0-590f-b9c1-4c101917c083 with identifier: AB86109
2026-03-28 12:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 52f7f5a0-95f0-590f-b9c1-4c101917c083 with identifier: AB86109
2026-03-28 12:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 52f7f5a0-95f0-590f-b9c1-4c101917c083 with identifier: AB86109 to the API
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:07:06Z',
'fuel_type': 'diesel',
'id': '52f7f5a0-95f0-590f-b9c1-4c101917c083',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB86109',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 225492,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-26',
'seller_name': None,
'title': 'Peugeot 308 1.5 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2018}
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB86109%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [auto1.it] INFO: Saving data for AB86109: {'auction_closing_time': 1774714026.0, 'created_time': 1774612993.062867, 'last_price_update_time': 1774699557.026382}
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AB86109') HTTP/1.1" 204 0
2026-03-28 12:05:57 [auto1.it] INFO: Found listing with ID: RJ45303
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ45303%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [auto1.it] INFO: Scrape type for RJ45303: 2
2026-03-28 12:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cd12b5f-bff7-5c7f-88be-b192018652f9 with identifier: RJ45303
2026-03-28 12:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cd12b5f-bff7-5c7f-88be-b192018652f9 with scrape type 2
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cd12b5f-bff7-5c7f-88be-b192018652f9 with scrape type 2
2026-03-28 12:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3cd12b5f-bff7-5c7f-88be-b192018652f9, identifier: RJ45303
2026-03-28 12:05:57 [auto1.it] INFO: Found listing with ID: VT00900
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT00900%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [auto1.it] INFO: Scrape type for VT00900: 2
2026-03-28 12:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 392cf446-7b5d-5bad-aa43-d1266666c94d with identifier: VT00900
2026-03-28 12:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 392cf446-7b5d-5bad-aa43-d1266666c94d with scrape type 2
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 392cf446-7b5d-5bad-aa43-d1266666c94d with scrape type 2
2026-03-28 12:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 392cf446-7b5d-5bad-aa43-d1266666c94d, identifier: VT00900
2026-03-28 12:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3cd12b5f-bff7-5c7f-88be-b192018652f9 with identifier: RJ45303
2026-03-28 12:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3cd12b5f-bff7-5c7f-88be-b192018652f9 with identifier: RJ45303
2026-03-28 12:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3cd12b5f-bff7-5c7f-88be-b192018652f9 with identifier: RJ45303 to the API
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:33:17Z',
'fuel_type': 'diesel',
'id': '3cd12b5f-bff7-5c7f-88be-b192018652f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ45303',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 361129,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-29',
'seller_name': None,
'title': 'Toyota RAV 4 2.0 D-4D Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2013}
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ45303%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [auto1.it] INFO: Saving data for RJ45303: {'auction_closing_time': 1774715597.0, 'created_time': 1774612947.231636, 'last_price_update_time': 1774699557.554299}
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RJ45303') HTTP/1.1" 204 0
2026-03-28 12:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 392cf446-7b5d-5bad-aa43-d1266666c94d with identifier: VT00900
2026-03-28 12:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 392cf446-7b5d-5bad-aa43-d1266666c94d with identifier: VT00900
2026-03-28 12:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 392cf446-7b5d-5bad-aa43-d1266666c94d with identifier: VT00900 to the API
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-28T16:39:27Z',
'fuel_type': 'petrol',
'id': '392cf446-7b5d-5bad-aa43-d1266666c94d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT00900',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 142814,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-28',
'seller_name': None,
'title': 'Peugeot 208 1.2 VTi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2017}
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT00900%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [auto1.it] INFO: Saving data for VT00900: {'auction_closing_time': 1774715967.0, 'created_time': 1773662557.593807, 'last_price_update_time': 1774699557.838884}
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VT00900') HTTP/1.1" 204 0
2026-03-28 12:05:57 [auto1.it] INFO: Found listing with ID: CV62006
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV62006%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [auto1.it] INFO: Scrape type for CV62006: 2
2026-03-28 12:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdc24622-ea3c-5fee-90e5-db2d88d9027f with identifier: CV62006
2026-03-28 12:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdc24622-ea3c-5fee-90e5-db2d88d9027f with scrape type 2
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdc24622-ea3c-5fee-90e5-db2d88d9027f with scrape type 2
2026-03-28 12:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cdc24622-ea3c-5fee-90e5-db2d88d9027f, identifier: CV62006
2026-03-28 12:05:57 [auto1.it] INFO: Found listing with ID: BW24813
2026-03-28 12:05:57 [auto1.it] INFO: Found listing with ID: GL62022
2026-03-28 12:05:57 [auto1.it] INFO: Found listing with ID: PV85970
2026-03-28 12:05:57 [auto1.it] INFO: Found listing with ID: LC62662
2026-03-28 12:05:57 [auto1.it] INFO: Found listing with ID: EV28185
2026-03-28 12:05:57 [auto1.it] INFO: Found listing with ID: HR15000
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR15000%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [auto1.it] INFO: Scrape type for HR15000: 2
2026-03-28 12:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99234a7d-8ed3-5fb5-88ca-0223f78d83e7 with identifier: HR15000
2026-03-28 12:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99234a7d-8ed3-5fb5-88ca-0223f78d83e7 with scrape type 2
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99234a7d-8ed3-5fb5-88ca-0223f78d83e7 with scrape type 2
2026-03-28 12:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 99234a7d-8ed3-5fb5-88ca-0223f78d83e7, identifier: HR15000
2026-03-28 12:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cdc24622-ea3c-5fee-90e5-db2d88d9027f with identifier: CV62006
2026-03-28 12:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cdc24622-ea3c-5fee-90e5-db2d88d9027f with identifier: CV62006
2026-03-28 12:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cdc24622-ea3c-5fee-90e5-db2d88d9027f with identifier: CV62006 to the API
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 117,
'expiration_date': '2026-03-28T16:16:25Z',
'fuel_type': 'petrol',
'id': 'cdc24622-ea3c-5fee-90e5-db2d88d9027f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV62006',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Freelander',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-06-06',
'seller_name': None,
'title': 'Land Rover Freelander 1.8 Hardback',
'transmission': 'manual',
'trim': 'Hardback',
'year': 2001}
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV62006%27 HTTP/1.1" 200 None
2026-03-28 12:05:58 [auto1.it] INFO: Saving data for CV62006: {'auction_closing_time': 1774714585.0, 'created_time': 1774612948.381977, 'last_price_update_time': 1774699558.374382}
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CV62006') HTTP/1.1" 204 0
2026-03-28 12:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 99234a7d-8ed3-5fb5-88ca-0223f78d83e7 with identifier: HR15000
2026-03-28 12:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 99234a7d-8ed3-5fb5-88ca-0223f78d83e7 with identifier: HR15000
2026-03-28 12:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 99234a7d-8ed3-5fb5-88ca-0223f78d83e7 with identifier: HR15000 to the API
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:06:53Z',
'fuel_type': 'diesel',
'id': '99234a7d-8ed3-5fb5-88ca-0223f78d83e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR15000',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 91339,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-01',
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Td4 Pure',
'transmission': 'automatic',
'trim': 'Pure',
'year': 2018}
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR15000%27 HTTP/1.1" 200 None
2026-03-28 12:05:58 [auto1.it] INFO: Saving data for HR15000: {'auction_closing_time': 1774714013.0, 'created_time': 1773663118.139947, 'last_price_update_time': 1774699558.648947}
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HR15000') HTTP/1.1" 204 0
2026-03-28 12:05:58 [auto1.it] INFO: Found listing with ID: BV13892
2026-03-28 12:05:58 [auto1.it] INFO: Found listing with ID: VG64666
2026-03-28 12:05:58 [auto1.it] INFO: Found listing with ID: XC82626
2026-03-28 12:05:58 [auto1.it] INFO: Found listing with ID: WV75327
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV75327%27 HTTP/1.1" 200 None
2026-03-28 12:05:58 [auto1.it] INFO: Scrape type for WV75327: 0
2026-03-28 12:05:58 [auto1.it] INFO: Found listing with ID: JC13198
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC13198%27 HTTP/1.1" 200 None
2026-03-28 12:05:58 [auto1.it] INFO: Scrape type for JC13198: 2
2026-03-28 12:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9bf09c9-664b-5dad-bfff-21c18889755e with identifier: JC13198
2026-03-28 12:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9bf09c9-664b-5dad-bfff-21c18889755e with scrape type 2
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9bf09c9-664b-5dad-bfff-21c18889755e with scrape type 2
2026-03-28 12:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e9bf09c9-664b-5dad-bfff-21c18889755e, identifier: JC13198
2026-03-28 12:05:58 [auto1.it] INFO: Found listing with ID: FA16942
2026-03-28 12:05:58 [auto1.it] INFO: Found listing with ID: ET15005
2026-03-28 12:05:58 [auto1.it] INFO: Found listing with ID: LM08573
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM08573%27 HTTP/1.1" 200 None
2026-03-28 12:05:58 [auto1.it] INFO: Scrape type for LM08573: 2
2026-03-28 12:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfe55bbe-fe8c-5d31-902c-caffab15ce6c with identifier: LM08573
2026-03-28 12:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfe55bbe-fe8c-5d31-902c-caffab15ce6c with scrape type 2
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfe55bbe-fe8c-5d31-902c-caffab15ce6c with scrape type 2
2026-03-28 12:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dfe55bbe-fe8c-5d31-902c-caffab15ce6c, identifier: LM08573
2026-03-28 12:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e9bf09c9-664b-5dad-bfff-21c18889755e with identifier: JC13198
2026-03-28 12:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e9bf09c9-664b-5dad-bfff-21c18889755e with identifier: JC13198
2026-03-28 12:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e9bf09c9-664b-5dad-bfff-21c18889755e with identifier: JC13198 to the API
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:38:05Z',
'fuel_type': 'diesel',
'id': 'e9bf09c9-664b-5dad-bfff-21c18889755e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC13198',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 114664,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-27',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Advance BlueMotion',
'transmission': 'automatic',
'trim': 'Advance BlueMotion',
'year': 2018}
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC13198%27 HTTP/1.1" 200 None
2026-03-28 12:05:59 [auto1.it] INFO: Saving data for JC13198: {'auction_closing_time': 1774715885.0, 'created_time': 1774612992.306828, 'last_price_update_time': 1774699559.203811}
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JC13198') HTTP/1.1" 204 0
2026-03-28 12:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dfe55bbe-fe8c-5d31-902c-caffab15ce6c with identifier: LM08573
2026-03-28 12:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dfe55bbe-fe8c-5d31-902c-caffab15ce6c with identifier: LM08573
2026-03-28 12:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dfe55bbe-fe8c-5d31-902c-caffab15ce6c with identifier: LM08573 to the API
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:57:31Z',
'fuel_type': 'diesel',
'id': 'dfe55bbe-fe8c-5d31-902c-caffab15ce6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM08573',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 150026,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-28',
'seller_name': None,
'title': 'BMW 3er 318d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2017}
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM08573%27 HTTP/1.1" 200 None
2026-03-28 12:05:59 [auto1.it] INFO: Saving data for LM08573: {'auction_closing_time': 1774717051.0, 'created_time': 1774612972.709362, 'last_price_update_time': 1774699559.570131}
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LM08573') HTTP/1.1" 204 0
2026-03-28 12:05:59 [auto1.it] INFO: Found listing with ID: VS87113
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS87113%27 HTTP/1.1" 200 None
2026-03-28 12:05:59 [auto1.it] INFO: Scrape type for VS87113: 0
2026-03-28 12:05:59 [auto1.it] INFO: Found listing with ID: YD67684
2026-03-28 12:05:59 [auto1.it] INFO: Found listing with ID: VX54252
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX54252%27 HTTP/1.1" 200 None
2026-03-28 12:05:59 [auto1.it] INFO: Scrape type for VX54252: 0
2026-03-28 12:05:59 [auto1.it] INFO: Found listing with ID: UA46628
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA46628%27 HTTP/1.1" 200 None
2026-03-28 12:05:59 [auto1.it] INFO: Scrape type for UA46628: 2
2026-03-28 12:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecd23489-45f3-5913-b113-c0c7ea047936 with identifier: UA46628
2026-03-28 12:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecd23489-45f3-5913-b113-c0c7ea047936 with scrape type 2
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecd23489-45f3-5913-b113-c0c7ea047936 with scrape type 2
2026-03-28 12:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ecd23489-45f3-5913-b113-c0c7ea047936, identifier: UA46628
2026-03-28 12:05:59 [auto1.it] INFO: Found listing with ID: MH63316
2026-03-28 12:05:59 [auto1.it] INFO: Found listing with ID: FN23706
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN23706%27 HTTP/1.1" 200 None
2026-03-28 12:05:59 [auto1.it] INFO: Scrape type for FN23706: 0
2026-03-28 12:05:59 [auto1.it] INFO: Found listing with ID: ZR50624
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR50624%27 HTTP/1.1" 200 None
2026-03-28 12:05:59 [auto1.it] INFO: Scrape type for ZR50624: 2
2026-03-28 12:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4546aff8-6df1-5c74-a5c8-346670268668 with identifier: ZR50624
2026-03-28 12:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4546aff8-6df1-5c74-a5c8-346670268668 with scrape type 2
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4546aff8-6df1-5c74-a5c8-346670268668 with scrape type 2
2026-03-28 12:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4546aff8-6df1-5c74-a5c8-346670268668, identifier: ZR50624
2026-03-28 12:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ecd23489-45f3-5913-b113-c0c7ea047936 with identifier: UA46628
2026-03-28 12:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ecd23489-45f3-5913-b113-c0c7ea047936 with identifier: UA46628
2026-03-28 12:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ecd23489-45f3-5913-b113-c0c7ea047936 with identifier: UA46628 to the API
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 84,
'expiration_date': '2026-03-28T16:01:15Z',
'fuel_type': 'petrol',
'id': 'ecd23489-45f3-5913-b113-c0c7ea047936',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA46628',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 49385,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-27',
'seller_name': None,
'title': 'Hyundai i20 1.2 Connectline',
'transmission': 'manual',
'trim': 'Connectline',
'year': 2023}
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA46628%27 HTTP/1.1" 200 None
2026-03-28 12:06:00 [auto1.it] INFO: Saving data for UA46628: {'auction_closing_time': 1774713675.0, 'created_time': 1774612950.603493, 'last_price_update_time': 1774699560.172685}
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UA46628') HTTP/1.1" 204 0
2026-03-28 12:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4546aff8-6df1-5c74-a5c8-346670268668 with identifier: ZR50624
2026-03-28 12:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4546aff8-6df1-5c74-a5c8-346670268668 with identifier: ZR50624
2026-03-28 12:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4546aff8-6df1-5c74-a5c8-346670268668 with identifier: ZR50624 to the API
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:52:37Z',
'fuel_type': 'petrol',
'id': '4546aff8-6df1-5c74-a5c8-346670268668',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR50624',
'listing': 'auction',
'make': 'Kia',
'model': "cee'd",
'odometer': 172428,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-21',
'seller_name': None,
'title': "Kia cee'd 1.6 GDI SW Platinum",
'transmission': 'automatic',
'trim': 'SW Platinum',
'year': 2013}
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR50624%27 HTTP/1.1" 200 None
2026-03-28 12:06:00 [auto1.it] INFO: Saving data for ZR50624: {'auction_closing_time': 1774716757.0, 'created_time': 1774612988.187821, 'last_price_update_time': 1774699560.471768}
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZR50624') HTTP/1.1" 204 0
2026-03-28 12:06:00 [auto1.it] INFO: Found listing with ID: KG92568
2026-03-28 12:06:00 [auto1.it] INFO: Found listing with ID: YJ41537
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ41537%27 HTTP/1.1" 200 None
2026-03-28 12:06:00 [auto1.it] INFO: Scrape type for YJ41537: 2
2026-03-28 12:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73300ab6-945d-5c39-a942-50789056db14 with identifier: YJ41537
2026-03-28 12:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73300ab6-945d-5c39-a942-50789056db14 with scrape type 2
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73300ab6-945d-5c39-a942-50789056db14 with scrape type 2
2026-03-28 12:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 73300ab6-945d-5c39-a942-50789056db14, identifier: YJ41537
2026-03-28 12:06:00 [auto1.it] INFO: Found listing with ID: NP16593
2026-03-28 12:06:00 [auto1.it] INFO: Found listing with ID: CB44170
2026-03-28 12:06:00 [auto1.it] INFO: Found listing with ID: DV62458
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV62458%27 HTTP/1.1" 200 None
2026-03-28 12:06:00 [auto1.it] INFO: Scrape type for DV62458: 2
2026-03-28 12:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee224a74-0a79-5def-8246-ebfb26e4700d with identifier: DV62458
2026-03-28 12:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee224a74-0a79-5def-8246-ebfb26e4700d with scrape type 2
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee224a74-0a79-5def-8246-ebfb26e4700d with scrape type 2
2026-03-28 12:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ee224a74-0a79-5def-8246-ebfb26e4700d, identifier: DV62458
2026-03-28 12:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 73300ab6-945d-5c39-a942-50789056db14 with identifier: YJ41537
2026-03-28 12:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 73300ab6-945d-5c39-a942-50789056db14 with identifier: YJ41537
2026-03-28 12:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 73300ab6-945d-5c39-a942-50789056db14 with identifier: YJ41537 to the API
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:40:51Z',
'fuel_type': 'diesel',
'id': '73300ab6-945d-5c39-a942-50789056db14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ41537',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto',
'odometer': 159998,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-13',
'seller_name': None,
'title': 'Fiat Punto 1.3 JTD Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2012}
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ41537%27 HTTP/1.1" 200 None
2026-03-28 12:06:00 [auto1.it] INFO: Saving data for YJ41537: {'auction_closing_time': 1774716051.0, 'created_time': 1774612949.996256, 'last_price_update_time': 1774699560.963824}
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YJ41537') HTTP/1.1" 204 0
2026-03-28 12:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ee224a74-0a79-5def-8246-ebfb26e4700d with identifier: DV62458
2026-03-28 12:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ee224a74-0a79-5def-8246-ebfb26e4700d with identifier: DV62458
2026-03-28 12:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ee224a74-0a79-5def-8246-ebfb26e4700d with identifier: DV62458 to the API
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:08:37Z',
'fuel_type': 'diesel',
'id': 'ee224a74-0a79-5def-8246-ebfb26e4700d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV62458',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 340838,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-25',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2016}
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV62458%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [auto1.it] INFO: Saving data for DV62458: {'auction_closing_time': 1774714117.0, 'created_time': 1774612994.379669, 'last_price_update_time': 1774699561.344533}
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DV62458') HTTP/1.1" 204 0
2026-03-28 12:06:01 [auto1.it] INFO: Found listing with ID: GW20586
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW20586%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [auto1.it] INFO: Scrape type for GW20586: 2
2026-03-28 12:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe0bd400-ebe9-5d9b-b21d-fdc1dfb5467b with identifier: GW20586
2026-03-28 12:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe0bd400-ebe9-5d9b-b21d-fdc1dfb5467b with scrape type 2
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe0bd400-ebe9-5d9b-b21d-fdc1dfb5467b with scrape type 2
2026-03-28 12:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fe0bd400-ebe9-5d9b-b21d-fdc1dfb5467b, identifier: GW20586
2026-03-28 12:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fe0bd400-ebe9-5d9b-b21d-fdc1dfb5467b with identifier: GW20586
2026-03-28 12:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fe0bd400-ebe9-5d9b-b21d-fdc1dfb5467b with identifier: GW20586
2026-03-28 12:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fe0bd400-ebe9-5d9b-b21d-fdc1dfb5467b with identifier: GW20586 to the API
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:07:21Z',
'fuel_type': 'diesel',
'id': 'fe0bd400-ebe9-5d9b-b21d-fdc1dfb5467b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW20586',
'listing': 'auction',
'make': 'Fiat',
'model': 'Fiorino',
'odometer': 213361,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-17',
'seller_name': None,
'title': 'Fiat Fiorino 1.3 M-Jet SX Kasten',
'transmission': 'manual',
'trim': 'SX Kasten',
'year': 2021}
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW20586%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [auto1.it] INFO: Saving data for GW20586: {'auction_closing_time': 1774714041.0, 'created_time': 1774612968.059739, 'last_price_update_time': 1774699561.734747}
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GW20586') HTTP/1.1" 204 0
2026-03-28 12:06:01 [auto1.it] INFO: Found listing with ID: AL26239
2026-03-28 12:06:01 [auto1.it] INFO: Found listing with ID: AK60352
2026-03-28 12:06:01 [auto1.it] INFO: Found listing with ID: CH30071
2026-03-28 12:06:01 [auto1.it] INFO: Found listing with ID: MW84295
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW84295%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [auto1.it] INFO: Scrape type for MW84295: 2
2026-03-28 12:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c6a7b34-1ccf-55ea-8fb7-81e3efcd9bb5 with identifier: MW84295
2026-03-28 12:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c6a7b34-1ccf-55ea-8fb7-81e3efcd9bb5 with scrape type 2
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c6a7b34-1ccf-55ea-8fb7-81e3efcd9bb5 with scrape type 2
2026-03-28 12:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5c6a7b34-1ccf-55ea-8fb7-81e3efcd9bb5, identifier: MW84295
2026-03-28 12:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5c6a7b34-1ccf-55ea-8fb7-81e3efcd9bb5 with identifier: MW84295
2026-03-28 12:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5c6a7b34-1ccf-55ea-8fb7-81e3efcd9bb5 with identifier: MW84295
2026-03-28 12:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5c6a7b34-1ccf-55ea-8fb7-81e3efcd9bb5 with identifier: MW84295 to the API
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:08:08Z',
'fuel_type': 'diesel',
'id': '5c6a7b34-1ccf-55ea-8fb7-81e3efcd9bb5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW84295',
'listing': 'auction',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 199653,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-28',
'seller_name': None,
'title': 'Skoda Yeti 1.6 TDI Active GreenLine',
'transmission': 'manual',
'trim': 'Active GreenLine',
'year': 2011}
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW84295%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [auto1.it] INFO: Saving data for MW84295: {'auction_closing_time': 1774714088.0, 'created_time': 1774612983.405927, 'last_price_update_time': 1774699562.107176}
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MW84295') HTTP/1.1" 204 0
2026-03-28 12:06:02 [auto1.it] INFO: Found listing with ID: PW65105
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW65105%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [auto1.it] INFO: Scrape type for PW65105: 2
2026-03-28 12:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35ffa56d-1ba8-5ec7-a166-2ab75b1ebf3a with identifier: PW65105
2026-03-28 12:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35ffa56d-1ba8-5ec7-a166-2ab75b1ebf3a with scrape type 2
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35ffa56d-1ba8-5ec7-a166-2ab75b1ebf3a with scrape type 2
2026-03-28 12:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 35ffa56d-1ba8-5ec7-a166-2ab75b1ebf3a, identifier: PW65105
2026-03-28 12:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 35ffa56d-1ba8-5ec7-a166-2ab75b1ebf3a with identifier: PW65105
2026-03-28 12:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 35ffa56d-1ba8-5ec7-a166-2ab75b1ebf3a with identifier: PW65105
2026-03-28 12:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 35ffa56d-1ba8-5ec7-a166-2ab75b1ebf3a with identifier: PW65105 to the API
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:53:18Z',
'fuel_type': 'gas',
'id': '35ffa56d-1ba8-5ec7-a166-2ab75b1ebf3a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW65105',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 46953,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-25',
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe LPG Stepway 15th Anniversary',
'transmission': 'manual',
'trim': 'Stepway 15th Anniversary',
'year': 2020}
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW65105%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [auto1.it] INFO: Saving data for PW65105: {'auction_closing_time': 1774716798.0, 'created_time': 1774612969.062976, 'last_price_update_time': 1774699562.530888}
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PW65105') HTTP/1.1" 204 0
2026-03-28 12:06:02 [auto1.it] INFO: Found listing with ID: CN99073
2026-03-28 12:06:02 [auto1.it] INFO: Found listing with ID: ES11783
2026-03-28 12:06:02 [auto1.it] INFO: Found listing with ID: RF56449
2026-03-28 12:06:02 [auto1.it] INFO: Found listing with ID: NR19227
2026-03-28 12:06:02 [auto1.it] INFO: Found listing with ID: LE11885
2026-03-28 12:06:02 [auto1.it] INFO: Found listing with ID: LC05888
2026-03-28 12:06:02 [auto1.it] INFO: Found listing with ID: TL13450
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL13450%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [auto1.it] INFO: Scrape type for TL13450: 2
2026-03-28 12:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55eb9aa2-62ba-5424-b858-8d117083bd70 with identifier: TL13450
2026-03-28 12:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55eb9aa2-62ba-5424-b858-8d117083bd70 with scrape type 2
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55eb9aa2-62ba-5424-b858-8d117083bd70 with scrape type 2
2026-03-28 12:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 55eb9aa2-62ba-5424-b858-8d117083bd70, identifier: TL13450
2026-03-28 12:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 55eb9aa2-62ba-5424-b858-8d117083bd70 with identifier: TL13450
2026-03-28 12:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 55eb9aa2-62ba-5424-b858-8d117083bd70 with identifier: TL13450
2026-03-28 12:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 55eb9aa2-62ba-5424-b858-8d117083bd70 with identifier: TL13450 to the API
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:51:28Z',
'fuel_type': 'diesel',
'id': '55eb9aa2-62ba-5424-b858-8d117083bd70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL13450',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Trax',
'odometer': 140955,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-05',
'seller_name': None,
'title': 'Chevrolet Trax 1.7 Diesel LT',
'transmission': 'manual',
'trim': 'LT',
'year': 2014}
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL13450%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [auto1.it] INFO: Saving data for TL13450: {'auction_closing_time': 1774716688.0, 'created_time': 1773129550.262176, 'last_price_update_time': 1774699562.946666}
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TL13450') HTTP/1.1" 204 0
2026-03-28 12:06:03 [auto1.it] INFO: Found listing with ID: HY91699
2026-03-28 12:06:03 [auto1.it] INFO: Found listing with ID: ZY78533
2026-03-28 12:06:03 [auto1.it] INFO: Found listing with ID: WH00709
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH00709%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [auto1.it] INFO: Scrape type for WH00709: 2
2026-03-28 12:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f82507d-b8fe-5c01-b818-9b8e7d89bb2c with identifier: WH00709
2026-03-28 12:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f82507d-b8fe-5c01-b818-9b8e7d89bb2c with scrape type 2
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f82507d-b8fe-5c01-b818-9b8e7d89bb2c with scrape type 2
2026-03-28 12:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2f82507d-b8fe-5c01-b818-9b8e7d89bb2c, identifier: WH00709
2026-03-28 12:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2f82507d-b8fe-5c01-b818-9b8e7d89bb2c with identifier: WH00709
2026-03-28 12:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2f82507d-b8fe-5c01-b818-9b8e7d89bb2c with identifier: WH00709
2026-03-28 12:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2f82507d-b8fe-5c01-b818-9b8e7d89bb2c with identifier: WH00709 to the API
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:31:18Z',
'fuel_type': 'petrol',
'id': '2f82507d-b8fe-5c01-b818-9b8e7d89bb2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH00709',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf IV',
'odometer': 117077,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-09-11',
'seller_name': None,
'title': 'Volkswagen Golf IV 1.6 Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2002}
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH00709%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [auto1.it] INFO: Saving data for WH00709: {'auction_closing_time': 1774715478.0, 'created_time': 1773662667.355662, 'last_price_update_time': 1774699563.418123}
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WH00709') HTTP/1.1" 204 0
2026-03-28 12:06:03 [auto1.it] INFO: Channel: 24h | Page: 79 | totalHits: 3673 | hits on page: 40
2026-03-28 12:06:03 [auto1.it] INFO: Found listing with ID: YM07828
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM07828%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [auto1.it] INFO: Scrape type for YM07828: 2
2026-03-28 12:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20bb034f-2ac5-5fe2-9422-64c0ab81943a with identifier: YM07828
2026-03-28 12:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20bb034f-2ac5-5fe2-9422-64c0ab81943a with scrape type 2
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20bb034f-2ac5-5fe2-9422-64c0ab81943a with scrape type 2
2026-03-28 12:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 20bb034f-2ac5-5fe2-9422-64c0ab81943a, identifier: YM07828
2026-03-28 12:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 20bb034f-2ac5-5fe2-9422-64c0ab81943a with identifier: YM07828
2026-03-28 12:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 20bb034f-2ac5-5fe2-9422-64c0ab81943a with identifier: YM07828
2026-03-28 12:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 20bb034f-2ac5-5fe2-9422-64c0ab81943a with identifier: YM07828 to the API
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-28T16:12:53Z',
'fuel_type': 'diesel',
'id': '20bb034f-2ac5-5fe2-9422-64c0ab81943a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM07828',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 89994,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-11',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d Mild-Hybrid 4Matic Avantgarde',
'transmission': 'automatic',
'trim': '4Matic Avantgarde',
'year': 2023}
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM07828%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [auto1.it] INFO: Saving data for YM07828: {'auction_closing_time': 1774714373.0, 'created_time': 1774612991.241744, 'last_price_update_time': 1774699563.87}
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YM07828') HTTP/1.1" 204 0
2026-03-28 12:06:03 [auto1.it] INFO: Found listing with ID: XT45099
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT45099%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [auto1.it] INFO: Scrape type for XT45099: 2
2026-03-28 12:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9f63593-685f-558c-972e-4407e73070ba with identifier: XT45099
2026-03-28 12:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9f63593-685f-558c-972e-4407e73070ba with scrape type 2
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9f63593-685f-558c-972e-4407e73070ba with scrape type 2
2026-03-28 12:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f9f63593-685f-558c-972e-4407e73070ba, identifier: XT45099
2026-03-28 12:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:03 [auto1.it] INFO: Found listing with ID: BD99197
2026-03-28 12:06:03 [auto1.it] INFO: Found listing with ID: CF35894
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF35894%27 HTTP/1.1" 200 None
2026-03-28 12:06:04 [auto1.it] INFO: Scrape type for CF35894: 2
2026-03-28 12:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27b33966-24c2-5748-93a1-62fd9087618c with identifier: CF35894
2026-03-28 12:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27b33966-24c2-5748-93a1-62fd9087618c with scrape type 2
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27b33966-24c2-5748-93a1-62fd9087618c with scrape type 2
2026-03-28 12:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 27b33966-24c2-5748-93a1-62fd9087618c, identifier: CF35894
2026-03-28 12:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f9f63593-685f-558c-972e-4407e73070ba with identifier: XT45099
2026-03-28 12:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f9f63593-685f-558c-972e-4407e73070ba with identifier: XT45099
2026-03-28 12:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f9f63593-685f-558c-972e-4407e73070ba with identifier: XT45099 to the API
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-28T16:33:35Z',
'fuel_type': 'hybrid',
'id': 'f9f63593-685f-558c-972e-4407e73070ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT45099',
'listing': 'auction',
'make': 'Toyota',
'model': 'Auris Touring Sports',
'odometer': 159357,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-15',
'seller_name': None,
'title': 'Toyota Auris Touring Sports 1.8 Hybrid Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2016}
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT45099%27 HTTP/1.1" 200 None
2026-03-28 12:06:04 [auto1.it] INFO: Saving data for XT45099: {'auction_closing_time': 1774715615.0, 'created_time': 1774612976.684066, 'last_price_update_time': 1774699564.373384}
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XT45099') HTTP/1.1" 204 0
2026-03-28 12:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 27b33966-24c2-5748-93a1-62fd9087618c with identifier: CF35894
2026-03-28 12:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 27b33966-24c2-5748-93a1-62fd9087618c with identifier: CF35894
2026-03-28 12:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 27b33966-24c2-5748-93a1-62fd9087618c with identifier: CF35894 to the API
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:15:30Z',
'fuel_type': 'diesel',
'id': '27b33966-24c2-5748-93a1-62fd9087618c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF35894',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 208720,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-11',
'seller_name': None,
'title': 'BMW X1 xDrive 20d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2019}
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF35894%27 HTTP/1.1" 200 None
2026-03-28 12:06:04 [auto1.it] INFO: Saving data for CF35894: {'auction_closing_time': 1774714530.0, 'created_time': 1772705370.238412, 'last_price_update_time': 1774699564.652787}
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CF35894') HTTP/1.1" 204 0
2026-03-28 12:06:04 [auto1.it] INFO: Found listing with ID: SK74491
2026-03-28 12:06:04 [auto1.it] INFO: Found listing with ID: KN82468
2026-03-28 12:06:04 [auto1.it] INFO: Found listing with ID: MU83341
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU83341%27 HTTP/1.1" 200 None
2026-03-28 12:06:04 [auto1.it] INFO: Scrape type for MU83341: 2
2026-03-28 12:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9adcaed4-1fec-59bc-8fd5-c14101d45265 with identifier: MU83341
2026-03-28 12:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9adcaed4-1fec-59bc-8fd5-c14101d45265 with scrape type 2
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9adcaed4-1fec-59bc-8fd5-c14101d45265 with scrape type 2
2026-03-28 12:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9adcaed4-1fec-59bc-8fd5-c14101d45265, identifier: MU83341
2026-03-28 12:06:04 [auto1.it] INFO: Found listing with ID: UM78803
2026-03-28 12:06:04 [auto1.it] INFO: Found listing with ID: LW40364
2026-03-28 12:06:04 [auto1.it] INFO: Found listing with ID: CW25523
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW25523%27 HTTP/1.1" 200 None
2026-03-28 12:06:04 [auto1.it] INFO: Scrape type for CW25523: 2
2026-03-28 12:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8b8a1ae-17bb-51a6-b04e-6484ae6ff9ee with identifier: CW25523
2026-03-28 12:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8b8a1ae-17bb-51a6-b04e-6484ae6ff9ee with scrape type 2
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8b8a1ae-17bb-51a6-b04e-6484ae6ff9ee with scrape type 2
2026-03-28 12:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a8b8a1ae-17bb-51a6-b04e-6484ae6ff9ee, identifier: CW25523
2026-03-28 12:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9adcaed4-1fec-59bc-8fd5-c14101d45265 with identifier: MU83341
2026-03-28 12:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9adcaed4-1fec-59bc-8fd5-c14101d45265 with identifier: MU83341
2026-03-28 12:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9adcaed4-1fec-59bc-8fd5-c14101d45265 with identifier: MU83341 to the API
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-28T16:28:47Z',
'fuel_type': 'diesel',
'id': '9adcaed4-1fec-59bc-8fd5-c14101d45265',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU83341',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 240461,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-25',
'seller_name': None,
'title': 'BMW X5 xDrive 25d',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU83341%27 HTTP/1.1" 200 None
2026-03-28 12:06:05 [auto1.it] INFO: Saving data for MU83341: {'auction_closing_time': 1774715327.0, 'created_time': 1772654485.511742, 'last_price_update_time': 1774699565.160046}
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MU83341') HTTP/1.1" 204 0
2026-03-28 12:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a8b8a1ae-17bb-51a6-b04e-6484ae6ff9ee with identifier: CW25523
2026-03-28 12:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a8b8a1ae-17bb-51a6-b04e-6484ae6ff9ee with identifier: CW25523
2026-03-28 12:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a8b8a1ae-17bb-51a6-b04e-6484ae6ff9ee with identifier: CW25523 to the API
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:45:37Z',
'fuel_type': 'diesel',
'id': 'a8b8a1ae-17bb-51a6-b04e-6484ae6ff9ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW25523',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 226872,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-29',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic Exclusive',
'transmission': 'automatic',
'trim': '4Matic Exclusive',
'year': 2016}
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW25523%27 HTTP/1.1" 200 None
2026-03-28 12:06:05 [auto1.it] INFO: Saving data for CW25523: {'auction_closing_time': 1774716337.0, 'created_time': 1773133161.21575, 'last_price_update_time': 1774699565.653435}
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CW25523') HTTP/1.1" 204 0
2026-03-28 12:06:05 [auto1.it] INFO: Found listing with ID: PM68240
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM68240%27 HTTP/1.1" 200 None
2026-03-28 12:06:05 [auto1.it] INFO: Scrape type for PM68240: 2
2026-03-28 12:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6ddd38c-ea2c-5e21-b287-a784dc5b9d25 with identifier: PM68240
2026-03-28 12:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6ddd38c-ea2c-5e21-b287-a784dc5b9d25 with scrape type 2
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6ddd38c-ea2c-5e21-b287-a784dc5b9d25 with scrape type 2
2026-03-28 12:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f6ddd38c-ea2c-5e21-b287-a784dc5b9d25, identifier: PM68240
2026-03-28 12:06:05 [auto1.it] INFO: Found listing with ID: AK92313
2026-03-28 12:06:05 [auto1.it] INFO: Found listing with ID: FZ95983
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ95983%27 HTTP/1.1" 200 None
2026-03-28 12:06:05 [auto1.it] INFO: Scrape type for FZ95983: 2
2026-03-28 12:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 006f55ce-4deb-5111-8fad-091a1f59cc03 with identifier: FZ95983
2026-03-28 12:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 006f55ce-4deb-5111-8fad-091a1f59cc03 with scrape type 2
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 006f55ce-4deb-5111-8fad-091a1f59cc03 with scrape type 2
2026-03-28 12:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 006f55ce-4deb-5111-8fad-091a1f59cc03, identifier: FZ95983
2026-03-28 12:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f6ddd38c-ea2c-5e21-b287-a784dc5b9d25 with identifier: PM68240
2026-03-28 12:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f6ddd38c-ea2c-5e21-b287-a784dc5b9d25 with identifier: PM68240
2026-03-28 12:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f6ddd38c-ea2c-5e21-b287-a784dc5b9d25 with identifier: PM68240 to the API
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-28T16:11:35Z',
'fuel_type': 'hybrid',
'id': 'f6ddd38c-ea2c-5e21-b287-a784dc5b9d25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM68240',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 30978,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-30',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid Exellence 4WD',
'transmission': 'automatic',
'trim': 'Exellence 4WD',
'year': 2022}
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM68240%27 HTTP/1.1" 200 None
2026-03-28 12:06:06 [auto1.it] INFO: Saving data for PM68240: {'auction_closing_time': 1774714295.0, 'created_time': 1773129745.848896, 'last_price_update_time': 1774699566.242567}
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM68240') HTTP/1.1" 204 0
2026-03-28 12:06:06 [scrapy.extensions.logstats] INFO: Crawled 277 pages (at 10 pages/min), scraped 324 items (at 125 items/min)
2026-03-28 12:06:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-28 12:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 006f55ce-4deb-5111-8fad-091a1f59cc03 with identifier: FZ95983
2026-03-28 12:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 006f55ce-4deb-5111-8fad-091a1f59cc03 with identifier: FZ95983
2026-03-28 12:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 006f55ce-4deb-5111-8fad-091a1f59cc03 with identifier: FZ95983 to the API
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:51:57Z',
'fuel_type': 'petrol',
'id': '006f55ce-4deb-5111-8fad-091a1f59cc03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ95983',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 40725,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-30',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2023}
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ95983%27 HTTP/1.1" 200 None
2026-03-28 12:06:06 [auto1.it] INFO: Saving data for FZ95983: {'auction_closing_time': 1774716717.0, 'created_time': 1774612971.232083, 'last_price_update_time': 1774699566.53656}
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FZ95983') HTTP/1.1" 204 0
2026-03-28 12:06:06 [auto1.it] INFO: Found listing with ID: HR92713
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR92713%27 HTTP/1.1" 200 None
2026-03-28 12:06:06 [auto1.it] INFO: Scrape type for HR92713: 2
2026-03-28 12:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5b04a94-1a35-5d16-b131-37b482c7dbee with identifier: HR92713
2026-03-28 12:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5b04a94-1a35-5d16-b131-37b482c7dbee with scrape type 2
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5b04a94-1a35-5d16-b131-37b482c7dbee with scrape type 2
2026-03-28 12:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f5b04a94-1a35-5d16-b131-37b482c7dbee, identifier: HR92713
2026-03-28 12:06:06 [auto1.it] INFO: Found listing with ID: LB07538
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB07538%27 HTTP/1.1" 200 None
2026-03-28 12:06:06 [auto1.it] INFO: Scrape type for LB07538: 2
2026-03-28 12:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bb462a4-2342-58cd-af7c-b40689926e5b with identifier: LB07538
2026-03-28 12:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bb462a4-2342-58cd-af7c-b40689926e5b with scrape type 2
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bb462a4-2342-58cd-af7c-b40689926e5b with scrape type 2
2026-03-28 12:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9bb462a4-2342-58cd-af7c-b40689926e5b, identifier: LB07538
2026-03-28 12:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f5b04a94-1a35-5d16-b131-37b482c7dbee with identifier: HR92713
2026-03-28 12:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f5b04a94-1a35-5d16-b131-37b482c7dbee with identifier: HR92713
2026-03-28 12:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f5b04a94-1a35-5d16-b131-37b482c7dbee with identifier: HR92713 to the API
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:04:44Z',
'fuel_type': 'diesel',
'id': 'f5b04a94-1a35-5d16-b131-37b482c7dbee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR92713',
'listing': 'auction',
'make': 'Honda',
'model': 'CR-V',
'odometer': 218083,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-24',
'seller_name': None,
'title': 'Honda CR-V 2.2 CTDI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2009}
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR92713%27 HTTP/1.1" 200 None
2026-03-28 12:06:07 [auto1.it] INFO: Saving data for HR92713: {'auction_closing_time': 1774713884.0, 'created_time': 1774612975.526409, 'last_price_update_time': 1774699567.021545}
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HR92713') HTTP/1.1" 204 0
2026-03-28 12:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9bb462a4-2342-58cd-af7c-b40689926e5b with identifier: LB07538
2026-03-28 12:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9bb462a4-2342-58cd-af7c-b40689926e5b with identifier: LB07538
2026-03-28 12:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9bb462a4-2342-58cd-af7c-b40689926e5b with identifier: LB07538 to the API
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:23:36Z',
'fuel_type': 'diesel',
'id': '9bb462a4-2342-58cd-af7c-b40689926e5b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB07538',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 184848,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-27',
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi L2 Sport',
'transmission': 'automatic',
'trim': 'L2 Sport',
'year': 2020}
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB07538%27 HTTP/1.1" 200 None
2026-03-28 12:06:07 [auto1.it] INFO: Saving data for LB07538: {'auction_closing_time': 1774715016.0, 'created_time': 1774612971.624398, 'last_price_update_time': 1774699567.329263}
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LB07538') HTTP/1.1" 204 0
2026-03-28 12:06:07 [auto1.it] INFO: Found listing with ID: JF75950
2026-03-28 12:06:07 [auto1.it] INFO: Found listing with ID: BF69187
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF69187%27 HTTP/1.1" 200 None
2026-03-28 12:06:07 [auto1.it] INFO: Scrape type for BF69187: 2
2026-03-28 12:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f809a0f-42c8-5782-83eb-647db4607e5c with identifier: BF69187
2026-03-28 12:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f809a0f-42c8-5782-83eb-647db4607e5c with scrape type 2
2026-03-28 12:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f809a0f-42c8-5782-83eb-647db4607e5c with scrape type 2
2026-03-28 12:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2f809a0f-42c8-5782-83eb-647db4607e5c, identifier: BF69187
2026-03-28 12:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2f809a0f-42c8-5782-83eb-647db4607e5c with identifier: BF69187
2026-03-28 12:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2f809a0f-42c8-5782-83eb-647db4607e5c with identifier: BF69187
2026-03-28 12:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2f809a0f-42c8-5782-83eb-647db4607e5c with identifier: BF69187 to the API
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:57:10Z',
'fuel_type': 'diesel',
'id': '2f809a0f-42c8-5782-83eb-647db4607e5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF69187',
'listing': 'auction',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 123028,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-25',
'seller_name': None,
'title': 'Skoda Karoq 2.0 TDI Scout',
'transmission': 'automatic',
'trim': 'Scout',
'year': 2021}
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF69187%27 HTTP/1.1" 200 None
2026-03-28 12:06:07 [auto1.it] INFO: Saving data for BF69187: {'auction_closing_time': 1774717030.0, 'created_time': 1774612961.509251, 'last_price_update_time': 1774699567.732776}
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BF69187') HTTP/1.1" 204 0
2026-03-28 12:06:07 [auto1.it] INFO: Found listing with ID: BL65453
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL65453%27 HTTP/1.1" 200 None
2026-03-28 12:06:07 [auto1.it] INFO: Scrape type for BL65453: 2
2026-03-28 12:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65254d1a-4c5e-52ef-9d4b-26976271f67b with identifier: BL65453
2026-03-28 12:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65254d1a-4c5e-52ef-9d4b-26976271f67b with scrape type 2
2026-03-28 12:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65254d1a-4c5e-52ef-9d4b-26976271f67b with scrape type 2
2026-03-28 12:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 65254d1a-4c5e-52ef-9d4b-26976271f67b, identifier: BL65453
2026-03-28 12:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 65254d1a-4c5e-52ef-9d4b-26976271f67b with identifier: BL65453
2026-03-28 12:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 65254d1a-4c5e-52ef-9d4b-26976271f67b with identifier: BL65453
2026-03-28 12:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 65254d1a-4c5e-52ef-9d4b-26976271f67b with identifier: BL65453 to the API
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-28T16:34:33Z',
'fuel_type': 'diesel',
'id': '65254d1a-4c5e-52ef-9d4b-26976271f67b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL65453',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 152677,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-25',
'seller_name': None,
'title': 'Audi A5 Sportback 40 TDI Mild-Hybrid quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2023}
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL65453%27 HTTP/1.1" 200 None
2026-03-28 12:06:08 [auto1.it] INFO: Saving data for BL65453: {'auction_closing_time': 1774715673.0, 'created_time': 1774612960.400587, 'last_price_update_time': 1774699568.141488}
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BL65453') HTTP/1.1" 204 0
2026-03-28 12:06:08 [auto1.it] INFO: Found listing with ID: PG89190
2026-03-28 12:06:08 [auto1.it] INFO: Found listing with ID: TW94655
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW94655%27 HTTP/1.1" 200 None
2026-03-28 12:06:08 [auto1.it] INFO: Scrape type for TW94655: 2
2026-03-28 12:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2f77d9a-4642-5aac-955a-d1608830a7a3 with identifier: TW94655
2026-03-28 12:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2f77d9a-4642-5aac-955a-d1608830a7a3 with scrape type 2
2026-03-28 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2f77d9a-4642-5aac-955a-d1608830a7a3 with scrape type 2
2026-03-28 12:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e2f77d9a-4642-5aac-955a-d1608830a7a3, identifier: TW94655
2026-03-28 12:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e2f77d9a-4642-5aac-955a-d1608830a7a3 with identifier: TW94655
2026-03-28 12:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e2f77d9a-4642-5aac-955a-d1608830a7a3 with identifier: TW94655
2026-03-28 12:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e2f77d9a-4642-5aac-955a-d1608830a7a3 with identifier: TW94655 to the API
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:51:21Z',
'fuel_type': 'diesel',
'id': 'e2f77d9a-4642-5aac-955a-d1608830a7a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW94655',
'listing': 'auction',
'make': 'BMW',
'model': 'X2',
'odometer': 165552,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-30',
'seller_name': None,
'title': 'BMW X2 sDrive 18d M Sport X',
'transmission': 'automatic',
'trim': 'M Sport X',
'year': 2018}
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW94655%27 HTTP/1.1" 200 None
2026-03-28 12:06:08 [auto1.it] INFO: Saving data for TW94655: {'auction_closing_time': 1774716681.0, 'created_time': 1774612959.079846, 'last_price_update_time': 1774699568.516883}
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TW94655') HTTP/1.1" 204 0
2026-03-28 12:06:08 [auto1.it] INFO: Found listing with ID: DX46579
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX46579%27 HTTP/1.1" 200 None
2026-03-28 12:06:08 [auto1.it] INFO: Scrape type for DX46579: 2
2026-03-28 12:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69bcd55e-93c2-57aa-b010-b20ba47b68c4 with identifier: DX46579
2026-03-28 12:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69bcd55e-93c2-57aa-b010-b20ba47b68c4 with scrape type 2
2026-03-28 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69bcd55e-93c2-57aa-b010-b20ba47b68c4 with scrape type 2
2026-03-28 12:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 69bcd55e-93c2-57aa-b010-b20ba47b68c4, identifier: DX46579
2026-03-28 12:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 69bcd55e-93c2-57aa-b010-b20ba47b68c4 with identifier: DX46579
2026-03-28 12:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 69bcd55e-93c2-57aa-b010-b20ba47b68c4 with identifier: DX46579
2026-03-28 12:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 69bcd55e-93c2-57aa-b010-b20ba47b68c4 with identifier: DX46579 to the API
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-28T16:08:35Z',
'fuel_type': 'petrol',
'id': '69bcd55e-93c2-57aa-b010-b20ba47b68c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX46579',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 99098,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-28',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 35 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2021}
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX46579%27 HTTP/1.1" 200 None
2026-03-28 12:06:08 [auto1.it] INFO: Saving data for DX46579: {'auction_closing_time': 1774714115.0, 'created_time': 1774612952.800951, 'last_price_update_time': 1774699568.961423}
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DX46579') HTTP/1.1" 204 0
2026-03-28 12:06:09 [auto1.it] INFO: Found listing with ID: RS22306
2026-03-28 12:06:09 [auto1.it] INFO: Found listing with ID: VD33216
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VD33216%27 HTTP/1.1" 200 None
2026-03-28 12:06:09 [auto1.it] INFO: Scrape type for VD33216: 2
2026-03-28 12:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 187ec9ef-2359-5355-910d-38fe92f6aa1a with identifier: VD33216
2026-03-28 12:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 187ec9ef-2359-5355-910d-38fe92f6aa1a with scrape type 2
2026-03-28 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 187ec9ef-2359-5355-910d-38fe92f6aa1a with scrape type 2
2026-03-28 12:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 187ec9ef-2359-5355-910d-38fe92f6aa1a, identifier: VD33216
2026-03-28 12:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 187ec9ef-2359-5355-910d-38fe92f6aa1a with identifier: VD33216
2026-03-28 12:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 187ec9ef-2359-5355-910d-38fe92f6aa1a with identifier: VD33216
2026-03-28 12:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 187ec9ef-2359-5355-910d-38fe92f6aa1a with identifier: VD33216 to the API
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:50:27Z',
'fuel_type': 'diesel',
'id': '187ec9ef-2359-5355-910d-38fe92f6aa1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD33216',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 96901,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-29',
'seller_name': None,
'title': 'MINI Countryman Cooper D',
'transmission': 'manual',
'trim': '',
'year': 2017}
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VD33216%27 HTTP/1.1" 200 None
2026-03-28 12:06:09 [auto1.it] INFO: Saving data for VD33216: {'auction_closing_time': 1774716627.0, 'created_time': 1774612966.866601, 'last_price_update_time': 1774699569.496772}
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VD33216') HTTP/1.1" 204 0
2026-03-28 12:06:09 [auto1.it] INFO: Found listing with ID: EX06757
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX06757%27 HTTP/1.1" 200 None
2026-03-28 12:06:09 [auto1.it] INFO: Scrape type for EX06757: 2
2026-03-28 12:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e17b59-69a9-5900-9427-2cc7de991d11 with identifier: EX06757
2026-03-28 12:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e17b59-69a9-5900-9427-2cc7de991d11 with scrape type 2
2026-03-28 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96e17b59-69a9-5900-9427-2cc7de991d11 with scrape type 2
2026-03-28 12:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 96e17b59-69a9-5900-9427-2cc7de991d11, identifier: EX06757
2026-03-28 12:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 96e17b59-69a9-5900-9427-2cc7de991d11 with identifier: EX06757
2026-03-28 12:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 96e17b59-69a9-5900-9427-2cc7de991d11 with identifier: EX06757
2026-03-28 12:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 96e17b59-69a9-5900-9427-2cc7de991d11 with identifier: EX06757 to the API
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:20:01Z',
'fuel_type': 'diesel',
'id': '96e17b59-69a9-5900-9427-2cc7de991d11',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX06757',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 161201,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-15',
'seller_name': None,
'title': 'Land Rover Evoque D150 Mild-Hybrid S',
'transmission': 'automatic',
'trim': 'S',
'year': 2020}
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX06757%27 HTTP/1.1" 200 None
2026-03-28 12:06:09 [auto1.it] INFO: Saving data for EX06757: {'auction_closing_time': 1774714801.0, 'created_time': 1774472716.941289, 'last_price_update_time': 1774699569.895001}
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EX06757') HTTP/1.1" 204 0
2026-03-28 12:06:09 [auto1.it] INFO: Found listing with ID: JT03140
2026-03-28 12:06:09 [auto1.it] INFO: Found listing with ID: ZZ64526
2026-03-28 12:06:09 [auto1.it] INFO: Found listing with ID: WZ44056
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ44056%27 HTTP/1.1" 200 None
2026-03-28 12:06:09 [auto1.it] INFO: Scrape type for WZ44056: 2
2026-03-28 12:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 880c8f1d-47cd-51b4-8674-c00178868c88 with identifier: WZ44056
2026-03-28 12:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 880c8f1d-47cd-51b4-8674-c00178868c88 with scrape type 2
2026-03-28 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 880c8f1d-47cd-51b4-8674-c00178868c88 with scrape type 2
2026-03-28 12:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 880c8f1d-47cd-51b4-8674-c00178868c88, identifier: WZ44056
2026-03-28 12:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 880c8f1d-47cd-51b4-8674-c00178868c88 with identifier: WZ44056
2026-03-28 12:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 880c8f1d-47cd-51b4-8674-c00178868c88 with identifier: WZ44056
2026-03-28 12:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 880c8f1d-47cd-51b4-8674-c00178868c88 with identifier: WZ44056 to the API
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:55:52Z',
'fuel_type': 'gas',
'id': '880c8f1d-47cd-51b4-8674-c00178868c88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ44056',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 166899,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-03',
'seller_name': None,
'title': 'Peugeot 208 1.4 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ44056%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [auto1.it] INFO: Saving data for WZ44056: {'auction_closing_time': 1774716952.0, 'created_time': 1774612962.321867, 'last_price_update_time': 1774699570.35734}
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WZ44056') HTTP/1.1" 204 0
2026-03-28 12:06:10 [auto1.it] INFO: Channel: 24h | Page: 80 | totalHits: 3673 | hits on page: 40
2026-03-28 12:06:10 [auto1.it] INFO: Found listing with ID: AC09989
2026-03-28 12:06:10 [auto1.it] INFO: Found listing with ID: EH65874
2026-03-28 12:06:10 [auto1.it] INFO: Found listing with ID: UA98317
2026-03-28 12:06:10 [auto1.it] INFO: Found listing with ID: XE71259
2026-03-28 12:06:10 [auto1.it] INFO: Found listing with ID: KX33846
2026-03-28 12:06:10 [auto1.it] INFO: Found listing with ID: NE12117
2026-03-28 12:06:10 [auto1.it] INFO: Found listing with ID: JH33133
2026-03-28 12:06:10 [auto1.it] INFO: Found listing with ID: UZ05025
2026-03-28 12:06:10 [auto1.it] INFO: Found listing with ID: MY92785
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY92785%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [auto1.it] INFO: Scrape type for MY92785: 0
2026-03-28 12:06:10 [auto1.it] INFO: Found listing with ID: UJ60071
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ60071%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [auto1.it] INFO: Scrape type for UJ60071: 2
2026-03-28 12:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46e47a08-b2d1-5eaa-a895-b755d3973b80 with identifier: UJ60071
2026-03-28 12:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46e47a08-b2d1-5eaa-a895-b755d3973b80 with scrape type 2
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46e47a08-b2d1-5eaa-a895-b755d3973b80 with scrape type 2
2026-03-28 12:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 46e47a08-b2d1-5eaa-a895-b755d3973b80, identifier: UJ60071
2026-03-28 12:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 46e47a08-b2d1-5eaa-a895-b755d3973b80 with identifier: UJ60071
2026-03-28 12:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 46e47a08-b2d1-5eaa-a895-b755d3973b80 with identifier: UJ60071
2026-03-28 12:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 46e47a08-b2d1-5eaa-a895-b755d3973b80 with identifier: UJ60071 to the API
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:26:01Z',
'fuel_type': 'diesel',
'id': '46e47a08-b2d1-5eaa-a895-b755d3973b80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ60071',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 133285,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-11',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Energy Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2017}
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ60071%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [auto1.it] INFO: Saving data for UJ60071: {'auction_closing_time': 1774715161.0, 'created_time': 1774612974.724765, 'last_price_update_time': 1774699570.840888}
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UJ60071') HTTP/1.1" 204 0
2026-03-28 12:06:10 [auto1.it] INFO: Found listing with ID: RM50913
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM50913%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [auto1.it] INFO: Scrape type for RM50913: 0
2026-03-28 12:06:10 [auto1.it] INFO: Found listing with ID: SM29752
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM29752%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [auto1.it] INFO: Scrape type for SM29752: 0
2026-03-28 12:06:10 [auto1.it] INFO: Found listing with ID: PT89621
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT89621%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Scrape type for PT89621: 0
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: LG18660
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: UA37690
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA37690%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Scrape type for UA37690: 0
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: DD38287
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: AN07116
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN07116%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Scrape type for AN07116: 0
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: FS34329
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS34329%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Scrape type for FS34329: 0
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: ZU37783
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU37783%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Scrape type for ZU37783: 0
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: MA77848
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: EZ27389
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: NZ40909
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: UW92889
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW92889%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Scrape type for UW92889: 0
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: NC90447
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC90447%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Scrape type for NC90447: 0
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: GR65234
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR65234%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Scrape type for GR65234: 0
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: VS88689
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: KA98059
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: MZ03364
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ03364%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Scrape type for MZ03364: 2
2026-03-28 12:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0ad0505-836b-5520-a221-d11d0b8c432c with identifier: MZ03364
2026-03-28 12:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0ad0505-836b-5520-a221-d11d0b8c432c with scrape type 2
2026-03-28 12:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0ad0505-836b-5520-a221-d11d0b8c432c with scrape type 2
2026-03-28 12:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d0ad0505-836b-5520-a221-d11d0b8c432c, identifier: MZ03364
2026-03-28 12:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: HP12790
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP12790%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Scrape type for HP12790: 2
2026-03-28 12:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7d86a32-1c3d-5da3-86f1-1daaebb9a4a2 with identifier: HP12790
2026-03-28 12:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7d86a32-1c3d-5da3-86f1-1daaebb9a4a2 with scrape type 2
2026-03-28 12:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7d86a32-1c3d-5da3-86f1-1daaebb9a4a2 with scrape type 2
2026-03-28 12:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b7d86a32-1c3d-5da3-86f1-1daaebb9a4a2, identifier: HP12790
2026-03-28 12:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d0ad0505-836b-5520-a221-d11d0b8c432c with identifier: MZ03364
2026-03-28 12:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d0ad0505-836b-5520-a221-d11d0b8c432c with identifier: MZ03364
2026-03-28 12:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d0ad0505-836b-5520-a221-d11d0b8c432c with identifier: MZ03364 to the API
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:30:51Z',
'fuel_type': 'petrol',
'id': 'd0ad0505-836b-5520-a221-d11d0b8c432c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ03364',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 89566,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-13',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 160 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2011}
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ03364%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Saving data for MZ03364: {'auction_closing_time': 1774715451.0, 'created_time': 1774300037.464107, 'last_price_update_time': 1774699571.671195}
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MZ03364') HTTP/1.1" 204 0
2026-03-28 12:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b7d86a32-1c3d-5da3-86f1-1daaebb9a4a2 with identifier: HP12790
2026-03-28 12:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b7d86a32-1c3d-5da3-86f1-1daaebb9a4a2 with identifier: HP12790
2026-03-28 12:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b7d86a32-1c3d-5da3-86f1-1daaebb9a4a2 with identifier: HP12790 to the API
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:51:46Z',
'fuel_type': 'diesel',
'id': 'b7d86a32-1c3d-5da3-86f1-1daaebb9a4a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP12790',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 182971,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-30',
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
'transmission': 'automatic',
'trim': 'Limited FWD',
'year': 2017}
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP12790%27 HTTP/1.1" 200 None
2026-03-28 12:06:12 [auto1.it] INFO: Saving data for HP12790: {'auction_closing_time': 1774716706.0, 'created_time': 1774612975.876943, 'last_price_update_time': 1774699572.054799}
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HP12790') HTTP/1.1" 204 0
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: FF49180
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: NZ37386
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ37386%27 HTTP/1.1" 200 None
2026-03-28 12:06:12 [auto1.it] INFO: Scrape type for NZ37386: 0
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: PN03774
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN03774%27 HTTP/1.1" 200 None
2026-03-28 12:06:12 [auto1.it] INFO: Scrape type for PN03774: 0
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: EV67651
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: JV05910
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV05910%27 HTTP/1.1" 200 None
2026-03-28 12:06:12 [auto1.it] INFO: Scrape type for JV05910: 0
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: KZ16799
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: HZ70208
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: EJ60730
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: VR56129
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: BE98404
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE98404%27 HTTP/1.1" 200 None
2026-03-28 12:06:12 [auto1.it] INFO: Scrape type for BE98404: 0
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: CZ22961
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: AY46194
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: PR79135
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: UC24034
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC24034%27 HTTP/1.1" 200 None
2026-03-28 12:06:12 [auto1.it] INFO: Scrape type for UC24034: 0
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: FX03621
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: AG93268
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: XV25356
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: SN26450
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: PA07928
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA07928%27 HTTP/1.1" 200 None
2026-03-28 12:06:12 [auto1.it] INFO: Scrape type for PA07928: 0
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: LV99150
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: UL06285
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL06285%27 HTTP/1.1" 200 None
2026-03-28 12:06:12 [auto1.it] INFO: Scrape type for UL06285: 0
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: JB83291
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB83291%27 HTTP/1.1" 200 None
2026-03-28 12:06:12 [auto1.it] INFO: Scrape type for JB83291: 0
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: RL61545
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: TA87203
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: VV94396
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: EY67229
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY67229%27 HTTP/1.1" 200 None
2026-03-28 12:06:12 [auto1.it] INFO: Scrape type for EY67229: 2
2026-03-28 12:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a8f699c-586c-5700-af6a-64db5ff90034 with identifier: EY67229
2026-03-28 12:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a8f699c-586c-5700-af6a-64db5ff90034 with scrape type 2
2026-03-28 12:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a8f699c-586c-5700-af6a-64db5ff90034 with scrape type 2
2026-03-28 12:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0a8f699c-586c-5700-af6a-64db5ff90034, identifier: EY67229
2026-03-28 12:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0a8f699c-586c-5700-af6a-64db5ff90034 with identifier: EY67229
2026-03-28 12:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0a8f699c-586c-5700-af6a-64db5ff90034 with identifier: EY67229
2026-03-28 12:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0a8f699c-586c-5700-af6a-64db5ff90034 with identifier: EY67229 to the API
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:56:26Z',
'fuel_type': 'diesel',
'id': '0a8f699c-586c-5700-af6a-64db5ff90034',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY67229',
'listing': 'auction',
'make': 'Fiat',
'model': 'Grande Punto',
'odometer': 187861,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-06-28',
'seller_name': None,
'title': 'Fiat Grande Punto 1.3 JTD Multijet Active',
'transmission': 'manual',
'trim': 'Multijet Active',
'year': 2007}
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY67229%27 HTTP/1.1" 200 None
2026-03-28 12:06:12 [auto1.it] INFO: Saving data for EY67229: {'auction_closing_time': 1774716986.0, 'created_time': 1774612959.9471, 'last_price_update_time': 1774699572.604724}
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EY67229') HTTP/1.1" 204 0
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: BV29552
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: EG00977
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG00977%27 HTTP/1.1" 200 None
2026-03-28 12:06:12 [auto1.it] INFO: Scrape type for EG00977: 2
2026-03-28 12:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e274709a-6253-5c20-a8c1-3fda8439db8b with identifier: EG00977
2026-03-28 12:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e274709a-6253-5c20-a8c1-3fda8439db8b with scrape type 2
2026-03-28 12:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e274709a-6253-5c20-a8c1-3fda8439db8b with scrape type 2
2026-03-28 12:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e274709a-6253-5c20-a8c1-3fda8439db8b, identifier: EG00977
2026-03-28 12:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e274709a-6253-5c20-a8c1-3fda8439db8b with identifier: EG00977
2026-03-28 12:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e274709a-6253-5c20-a8c1-3fda8439db8b with identifier: EG00977
2026-03-28 12:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e274709a-6253-5c20-a8c1-3fda8439db8b with identifier: EG00977 to the API
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:37:09Z',
'fuel_type': 'diesel',
'id': 'e274709a-6253-5c20-a8c1-3fda8439db8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG00977',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLK-Klasse',
'odometer': 193649,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-06',
'seller_name': None,
'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
'transmission': 'automatic',
'trim': '4Matic BlueEfficiency',
'year': 2010}
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG00977%27 HTTP/1.1" 200 None
2026-03-28 12:06:13 [auto1.it] INFO: Saving data for EG00977: {'auction_closing_time': 1774715829.0, 'created_time': 1774040784.83193, 'last_price_update_time': 1774699573.101745}
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EG00977') HTTP/1.1" 204 0
2026-03-28 12:06:13 [auto1.it] INFO: Found listing with ID: UE31204
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE31204%27 HTTP/1.1" 200 None
2026-03-28 12:06:13 [auto1.it] INFO: Scrape type for UE31204: 2
2026-03-28 12:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 464c943a-5dea-5911-a6c0-85136683b6fa with identifier: UE31204
2026-03-28 12:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 464c943a-5dea-5911-a6c0-85136683b6fa with scrape type 2
2026-03-28 12:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 464c943a-5dea-5911-a6c0-85136683b6fa with scrape type 2
2026-03-28 12:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 464c943a-5dea-5911-a6c0-85136683b6fa, identifier: UE31204
2026-03-28 12:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 464c943a-5dea-5911-a6c0-85136683b6fa with identifier: UE31204
2026-03-28 12:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 464c943a-5dea-5911-a6c0-85136683b6fa with identifier: UE31204
2026-03-28 12:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 464c943a-5dea-5911-a6c0-85136683b6fa with identifier: UE31204 to the API
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:55:11Z',
'fuel_type': 'petrol',
'id': '464c943a-5dea-5911-a6c0-85136683b6fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE31204',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 63110,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-20',
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2018}
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE31204%27 HTTP/1.1" 200 None
2026-03-28 12:06:13 [auto1.it] INFO: Saving data for UE31204: {'auction_closing_time': 1774716911.0, 'created_time': 1774300029.286544, 'last_price_update_time': 1774699573.483475}
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UE31204') HTTP/1.1" 204 0
2026-03-28 12:06:13 [auto1.it] INFO: Found listing with ID: WW68303
2026-03-28 12:06:13 [auto1.it] INFO: Found listing with ID: UZ72139
2026-03-28 12:06:13 [auto1.it] INFO: Found listing with ID: XP38873
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP38873%27 HTTP/1.1" 200 None
2026-03-28 12:06:13 [auto1.it] INFO: Scrape type for XP38873: 0
2026-03-28 12:06:13 [auto1.it] INFO: Found listing with ID: PH70338
2026-03-28 12:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:14 [auto1.it] INFO: Channel: 24h | Page: 81 | totalHits: 3673 | hits on page: 40
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: TG59717
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: DX02178
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX02178%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for DX02178: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: BD73790
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: PK74621
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK74621%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for PK74621: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: TG93645
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG93645%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for TG93645: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: DD55036
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD55036%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for DD55036: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: SH99694
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: NF38082
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: BY06123
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY06123%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for BY06123: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: PT68883
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: BF81880
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF81880%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for BF81880: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: HG18459
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: SB68054
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB68054%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for SB68054: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: VY30881
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY30881%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for VY30881: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: KT34727
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: YB75201
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB75201%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for YB75201: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: UE17288
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE17288%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for UE17288: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: YX10047
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX10047%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for YX10047: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: BD43330
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: FT22704
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT22704%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for FT22704: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: FU42856
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU42856%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for FU42856: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: WY54071
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY54071%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for WY54071: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: CS68621
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS68621%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for CS68621: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: FT43083
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: HU04780
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: BM42520
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM42520%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for BM42520: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: MD14180
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: PY21369
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: XZ55537
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ55537%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for XZ55537: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: XW45727
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: MJ56549
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: RG49415
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: MZ03960
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ03960%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for MZ03960: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: SX19566
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX19566%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for SX19566: 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: TT73216
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: SW30840
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: JT48153
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: XY41121
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: NP81459
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: YG79824
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG79824%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for YG79824: 0
2026-03-28 12:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:15 [auto1.it] INFO: Channel: 24h | Page: 82 | totalHits: 3673 | hits on page: 40
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: JD30640
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: WL66559
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: HD95534
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD95534%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for HD95534: 0
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: HY50336
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY50336%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for HY50336: 0
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: TU52552
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU52552%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for TU52552: 0
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: SP76043
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP76043%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for SP76043: 0
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: DS02463
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: DV09922
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV09922%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for DV09922: 0
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: CM00839
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: TL02319
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: KT26389
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: FB26923
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB26923%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for FB26923: 0
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: FC72088
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC72088%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for FC72088: 0
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: CA11723
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA11723%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for CA11723: 0
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: EZ66710
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: HW61207
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: UB12324
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB12324%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for UB12324: 0
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: ZZ85760
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: DS09153
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: PV39557
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV39557%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for PV39557: 0
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: JU08968
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU08968%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for JU08968: 0
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: RM13688
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM13688%27 HTTP/1.1" 200 None
2026-03-28 12:06:16 [auto1.it] INFO: Scrape type for RM13688: 0
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: DS07920
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: BJ95013
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ95013%27 HTTP/1.1" 200 None
2026-03-28 12:06:16 [auto1.it] INFO: Scrape type for BJ95013: 0
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: AH42596
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: XJ39556
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ39556%27 HTTP/1.1" 200 None
2026-03-28 12:06:16 [auto1.it] INFO: Scrape type for XJ39556: 0
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: PE96276
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE96276%27 HTTP/1.1" 200 None
2026-03-28 12:06:16 [auto1.it] INFO: Scrape type for PE96276: 0
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: VX84045
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX84045%27 HTTP/1.1" 200 None
2026-03-28 12:06:16 [auto1.it] INFO: Scrape type for VX84045: 0
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: JC61958
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC61958%27 HTTP/1.1" 200 None
2026-03-28 12:06:16 [auto1.it] INFO: Scrape type for JC61958: 0
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: WB02542
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: KW54926
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW54926%27 HTTP/1.1" 200 None
2026-03-28 12:06:16 [auto1.it] INFO: Scrape type for KW54926: 0
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: MH68095
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: TT28559
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: HG73673
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: SS18980
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS18980%27 HTTP/1.1" 200 None
2026-03-28 12:06:16 [auto1.it] INFO: Scrape type for SS18980: 0
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: FZ15341
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: UH39950
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: WU48456
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU48456%27 HTTP/1.1" 200 None
2026-03-28 12:06:16 [auto1.it] INFO: Scrape type for WU48456: 0
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: WN29902
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN29902%27 HTTP/1.1" 200 None
2026-03-28 12:06:16 [auto1.it] INFO: Scrape type for WN29902: 0
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: AZ64167
2026-03-28 12:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:17 [auto1.it] INFO: Channel: 24h | Page: 83 | totalHits: 3673 | hits on page: 40
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: ZG57893
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG57893%27 HTTP/1.1" 200 None
2026-03-28 12:06:17 [auto1.it] INFO: Scrape type for ZG57893: 0
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: LR70211
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR70211%27 HTTP/1.1" 200 None
2026-03-28 12:06:17 [auto1.it] INFO: Scrape type for LR70211: 0
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: LY33062
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY33062%27 HTTP/1.1" 200 None
2026-03-28 12:06:17 [auto1.it] INFO: Scrape type for LY33062: 0
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: HD69394
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: UR14764
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: XY34648
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: LK74824
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK74824%27 HTTP/1.1" 200 None
2026-03-28 12:06:17 [auto1.it] INFO: Scrape type for LK74824: 0
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: JV49964
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: RB26067
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB26067%27 HTTP/1.1" 200 None
2026-03-28 12:06:17 [auto1.it] INFO: Scrape type for RB26067: 0
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: JK56818
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK56818%27 HTTP/1.1" 200 None
2026-03-28 12:06:17 [auto1.it] INFO: Scrape type for JK56818: 0
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: LP45822
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: KF78303
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: AS07739
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: CD01213
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: EW42527
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: JU78402
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: FZ10631
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: PR30387
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: XD70855
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: KK35105
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK35105%27 HTTP/1.1" 200 None
2026-03-28 12:06:17 [auto1.it] INFO: Scrape type for KK35105: 0
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: FD87905
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: EU38381
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: EA99644
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: FT94062
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: ED98224
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: DV90531
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV90531%27 HTTP/1.1" 200 None
2026-03-28 12:06:17 [auto1.it] INFO: Scrape type for DV90531: 0
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: WG94514
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: KE74592
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE74592%27 HTTP/1.1" 200 None
2026-03-28 12:06:17 [auto1.it] INFO: Scrape type for KE74592: 0
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: RA84354
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA84354%27 HTTP/1.1" 200 None
2026-03-28 12:06:17 [auto1.it] INFO: Scrape type for RA84354: 0
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: NT11806
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT11806%27 HTTP/1.1" 200 None
2026-03-28 12:06:17 [auto1.it] INFO: Scrape type for NT11806: 0
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: PZ52577
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: MA17223
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA17223%27 HTTP/1.1" 200 None
2026-03-28 12:06:17 [auto1.it] INFO: Scrape type for MA17223: 0
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: ZM35614
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: FS29770
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: XW21530
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW21530%27 HTTP/1.1" 200 None
2026-03-28 12:06:17 [auto1.it] INFO: Scrape type for XW21530: 0
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: PU63843
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: DW91233
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW91233%27 HTTP/1.1" 200 None
2026-03-28 12:06:17 [auto1.it] INFO: Scrape type for DW91233: 0
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: EA21012
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA21012%27 HTTP/1.1" 200 None
2026-03-28 12:06:17 [auto1.it] INFO: Scrape type for EA21012: 0
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: SR85753
2026-03-28 12:06:17 [auto1.it] INFO: Found listing with ID: LC41998
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC41998%27 HTTP/1.1" 200 None
2026-03-28 12:06:17 [auto1.it] INFO: Scrape type for LC41998: 0
2026-03-28 12:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:18 [auto1.it] INFO: Channel: 24h | Page: 84 | totalHits: 3673 | hits on page: 40
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: TZ26377
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: ZV75074
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: CP26264
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: YT14284
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT14284%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for YT14284: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: XC32215
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: YZ66981
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ66981%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for YZ66981: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: GC55004
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC55004%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for GC55004: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: RL48638
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: MZ97051
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: DV74338
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: DA57942
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA57942%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for DA57942: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: RD83320
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: FC73004
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: UK76860
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: XH07717
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: FR80508
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: ZT64017
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT64017%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for ZT64017: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: CH37521
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: JU23021
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU23021%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for JU23021: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: BD54797
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD54797%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for BD54797: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: CV42265
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: VL10175
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL10175%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for VL10175: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: RB61179
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB61179%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for RB61179: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: TX50484
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: ST20254
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST20254%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for ST20254: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: UC27147
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC27147%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for UC27147: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: BV06574
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV06574%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for BV06574: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: TC65145
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: SG53706
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: SM56678
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM56678%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for SM56678: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: BX57696
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX57696%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for BX57696: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: UK17345
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK17345%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for UK17345: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: ER04044
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: PG80369
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: ET07404
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET07404%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for ET07404: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: LD41720
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD41720%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for LD41720: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: YA87774
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: MU61390
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: WH19380
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH19380%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for WH19380: 0
2026-03-28 12:06:18 [auto1.it] INFO: Found listing with ID: YX87347
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX87347%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [auto1.it] INFO: Scrape type for YX87347: 0
2026-03-28 12:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:20 [auto1.it] INFO: Channel: 24h | Page: 85 | totalHits: 3673 | hits on page: 40
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: PA70519
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: SC05419
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: EG89993
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: TT44801
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: BR85251
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: ML20734
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: ZZ56254
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: CX56381
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: UG05722
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UG05722%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [auto1.it] INFO: Scrape type for UG05722: 0
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: ED77139
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED77139%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [auto1.it] INFO: Scrape type for ED77139: 0
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: UX44191
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: ZU39445
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: WM00919
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: YU40333
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU40333%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [auto1.it] INFO: Scrape type for YU40333: 0
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: XB00155
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: VY08559
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: DT24064
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: AF97148
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: TK41328
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK41328%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [auto1.it] INFO: Scrape type for TK41328: 0
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: EW75020
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: XG00486
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: LZ05951
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ05951%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [auto1.it] INFO: Scrape type for LZ05951: 0
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: YU33914
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: SN78206
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: PH25620
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: RZ31848
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ31848%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [auto1.it] INFO: Scrape type for RZ31848: 0
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: DW68997
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW68997%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [auto1.it] INFO: Scrape type for DW68997: 0
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: MH53431
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: SF43415
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF43415%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [auto1.it] INFO: Scrape type for SF43415: 0
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: RD96225
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD96225%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [auto1.it] INFO: Scrape type for RD96225: 0
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: YF34065
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF34065%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [auto1.it] INFO: Scrape type for YF34065: 0
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: RH67441
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH67441%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [auto1.it] INFO: Scrape type for RH67441: 0
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: KV39692
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV39692%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [auto1.it] INFO: Scrape type for KV39692: 0
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: XC56824
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC56824%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [auto1.it] INFO: Scrape type for XC56824: 0
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: YG84271
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: UY38032
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY38032%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [auto1.it] INFO: Scrape type for UY38032: 0
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: TT97007
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: UL45556
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL45556%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [auto1.it] INFO: Scrape type for UL45556: 0
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: GT53480
2026-03-28 12:06:20 [auto1.it] INFO: Found listing with ID: RL33082
2026-03-28 12:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:21 [auto1.it] INFO: Channel: 24h | Page: 86 | totalHits: 3673 | hits on page: 40
2026-03-28 12:06:21 [auto1.it] INFO: Found listing with ID: TG24306
2026-03-28 12:06:21 [auto1.it] INFO: Found listing with ID: NE13837
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE13837%27 HTTP/1.1" 200 None
2026-03-28 12:06:21 [auto1.it] INFO: Scrape type for NE13837: 0
2026-03-28 12:06:21 [auto1.it] INFO: Found listing with ID: LR71348
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR71348%27 HTTP/1.1" 200 None
2026-03-28 12:06:21 [auto1.it] INFO: Scrape type for LR71348: 0
2026-03-28 12:06:21 [auto1.it] INFO: Found listing with ID: GW48563
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW48563%27 HTTP/1.1" 200 None
2026-03-28 12:06:21 [auto1.it] INFO: Scrape type for GW48563: 0
2026-03-28 12:06:21 [auto1.it] INFO: Found listing with ID: FF22275
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF22275%27 HTTP/1.1" 200 None
2026-03-28 12:06:21 [auto1.it] INFO: Scrape type for FF22275: 2
2026-03-28 12:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f17fe5fb-9851-57e2-838d-ff6c78d62765 with identifier: FF22275
2026-03-28 12:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f17fe5fb-9851-57e2-838d-ff6c78d62765 with scrape type 2
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f17fe5fb-9851-57e2-838d-ff6c78d62765 with scrape type 2
2026-03-28 12:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f17fe5fb-9851-57e2-838d-ff6c78d62765, identifier: FF22275
2026-03-28 12:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f17fe5fb-9851-57e2-838d-ff6c78d62765 with identifier: FF22275
2026-03-28 12:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f17fe5fb-9851-57e2-838d-ff6c78d62765 with identifier: FF22275
2026-03-28 12:06:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f17fe5fb-9851-57e2-838d-ff6c78d62765 with identifier: FF22275 to the API
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:08:27Z',
'fuel_type': 'petrol',
'id': 'f17fe5fb-9851-57e2-838d-ff6c78d62765',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF22275',
'listing': 'auction',
'make': 'Jeep',
'model': 'Avenger',
'odometer': 3152,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2026-01-20',
'seller_name': None,
'title': 'Jeep Avenger 1.2 T-GDI Altitude',
'transmission': 'manual',
'trim': 'Altitude',
'year': 2026}
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF22275%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Saving data for FF22275: {'auction_closing_time': 1774714107.0, 'created_time': 1774299872.510923, 'last_price_update_time': 1774699582.046562}
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FF22275') HTTP/1.1" 204 0
2026-03-28 12:06:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: LX97199
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX97199%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for LX97199: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: DK51991
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK51991%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for DK51991: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: LY57551
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: HE58096
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: PN84990
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: SM22245
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM22245%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for SM22245: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: EP08968
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP08968%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for EP08968: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: FB65897
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: KF31033
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: RA25408
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: KG02437
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: DP78893
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: UJ66117
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: BG99585
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: XC65612
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC65612%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for XC65612: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: JR54731
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: JU83939
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: WP21128
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP21128%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for WP21128: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: AL62204
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL62204%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for AL62204: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: SS09351
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: TH21432
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH21432%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for TH21432: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: ZX88730
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX88730%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for ZX88730: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: SK49323
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: CJ66066
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ66066%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for CJ66066: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: AK04319
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK04319%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for AK04319: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: LW29692
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: PM88021
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM88021%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for PM88021: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: DB18786
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB18786%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for DB18786: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: DW69714
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW69714%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for DW69714: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: GB19602
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB19602%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for GB19602: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: JR93194
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR93194%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for JR93194: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: CD59495
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD59495%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for CD59495: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: SV37675
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV37675%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for SV37675: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: JV83854
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV83854%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Scrape type for JV83854: 0
2026-03-28 12:06:22 [auto1.it] INFO: Found listing with ID: XJ39462
2026-03-28 12:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:23 [auto1.it] INFO: Channel: 24h | Page: 87 | totalHits: 3673 | hits on page: 40
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: NB02604
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: AZ52753
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ52753%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [auto1.it] INFO: Scrape type for AZ52753: 0
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: HS22715
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: GB11317
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB11317%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [auto1.it] INFO: Scrape type for GB11317: 0
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: WW83170
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW83170%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [auto1.it] INFO: Scrape type for WW83170: 0
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: SL34558
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL34558%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [auto1.it] INFO: Scrape type for SL34558: 0
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: DW35808
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: RN99841
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: ZX72389
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX72389%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [auto1.it] INFO: Scrape type for ZX72389: 0
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: VA41104
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA41104%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [auto1.it] INFO: Scrape type for VA41104: 0
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: PW56521
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW56521%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [auto1.it] INFO: Scrape type for PW56521: 0
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: LH59018
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: AP47784
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: MT68027
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT68027%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [auto1.it] INFO: Scrape type for MT68027: 0
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: ZA31579
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA31579%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [auto1.it] INFO: Scrape type for ZA31579: 0
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: UX29999
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX29999%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [auto1.it] INFO: Scrape type for UX29999: 0
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: JH67201
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH67201%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [auto1.it] INFO: Scrape type for JH67201: 0
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: AL30811
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: TT50547
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT50547%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [auto1.it] INFO: Scrape type for TT50547: 0
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: JY70774
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: MX32120
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX32120%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [auto1.it] INFO: Scrape type for MX32120: 0
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: WW01067
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: CN60691
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: BR31309
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: DC03945
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: AY12786
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY12786%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [auto1.it] INFO: Scrape type for AY12786: 0
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: TB60435
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: ZA78643
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA78643%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [auto1.it] INFO: Scrape type for ZA78643: 0
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: VC37401
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: AW98600
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW98600%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [auto1.it] INFO: Scrape type for AW98600: 0
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: MS98879
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS98879%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [auto1.it] INFO: Scrape type for MS98879: 0
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: GZ29519
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: NJ63404
2026-03-28 12:06:23 [auto1.it] INFO: Found listing with ID: UW94573
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW94573%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [auto1.it] INFO: Scrape type for UW94573: 0
2026-03-28 12:06:24 [auto1.it] INFO: Found listing with ID: VG76075
2026-03-28 12:06:24 [auto1.it] INFO: Found listing with ID: ZG86392
2026-03-28 12:06:24 [auto1.it] INFO: Found listing with ID: DP39396
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP39396%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [auto1.it] INFO: Scrape type for DP39396: 0
2026-03-28 12:06:24 [auto1.it] INFO: Found listing with ID: EB44431
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB44431%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [auto1.it] INFO: Scrape type for EB44431: 0
2026-03-28 12:06:24 [auto1.it] INFO: Found listing with ID: KM03539
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM03539%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [auto1.it] INFO: Scrape type for KM03539: 0
2026-03-28 12:06:24 [auto1.it] INFO: Found listing with ID: RE99850
2026-03-28 12:06:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:25 [auto1.it] INFO: Channel: 24h | Page: 88 | totalHits: 3673 | hits on page: 40
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: SK80279
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: US69373
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US69373%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for US69373: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: NC67394
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: JF90456
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF90456%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for JF90456: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: JC41210
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC41210%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for JC41210: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: HW82018
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: VY08024
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: AE09913
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: ST64226
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST64226%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for ST64226: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: TH88339
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: XJ18858
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: NM56587
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM56587%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for NM56587: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: NF96122
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: SX04553
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX04553%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for SX04553: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: LB78915
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB78915%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for LB78915: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: NC00198
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC00198%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for NC00198: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: GA39078
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: JP92326
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: NC97185
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC97185%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for NC97185: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: MJ97902
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: NV87278
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV87278%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for NV87278: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: EM60693
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM60693%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for EM60693: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: XH17321
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: ES59878
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES59878%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for ES59878: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: SK90576
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: SX21241
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX21241%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for SX21241: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: FF76752
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: MG44195
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG44195%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for MG44195: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: WY95771
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: GN63834
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN63834%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for GN63834: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: PA53057
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: TL40655
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: VX86460
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX86460%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for VX86460: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: LX42454
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX42454%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for LX42454: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: HK70439
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK70439%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for HK70439: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: ER51817
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER51817%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for ER51817: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: CA07197
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA07197%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for CA07197: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: TJ19111
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: XX93100
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX93100%27 HTTP/1.1" 200 None
2026-03-28 12:06:25 [auto1.it] INFO: Scrape type for XX93100: 0
2026-03-28 12:06:25 [auto1.it] INFO: Found listing with ID: MR16221
2026-03-28 12:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:26 [auto1.it] INFO: Channel: 24h | Page: 89 | totalHits: 3674 | hits on page: 40
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: MR16221
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: YP04797
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: DE48831
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE48831%27 HTTP/1.1" 200 None
2026-03-28 12:06:26 [auto1.it] INFO: Scrape type for DE48831: 0
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: LS49318
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS49318%27 HTTP/1.1" 200 None
2026-03-28 12:06:26 [auto1.it] INFO: Scrape type for LS49318: 0
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: ZW56281
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: ET21203
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: SV89112
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: ZL07806
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: WH83035
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH83035%27 HTTP/1.1" 200 None
2026-03-28 12:06:26 [auto1.it] INFO: Scrape type for WH83035: 0
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: XX96776
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX96776%27 HTTP/1.1" 200 None
2026-03-28 12:06:26 [auto1.it] INFO: Scrape type for XX96776: 0
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: VV97216
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV97216%27 HTTP/1.1" 200 None
2026-03-28 12:06:26 [auto1.it] INFO: Scrape type for VV97216: 0
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: DP87516
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: FF48098
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF48098%27 HTTP/1.1" 200 None
2026-03-28 12:06:26 [auto1.it] INFO: Scrape type for FF48098: 0
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: GV75261
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: TV74767
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: YW82008
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: KD02463
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD02463%27 HTTP/1.1" 200 None
2026-03-28 12:06:26 [auto1.it] INFO: Scrape type for KD02463: 0
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: RT31033
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: KW23650
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW23650%27 HTTP/1.1" 200 None
2026-03-28 12:06:26 [auto1.it] INFO: Scrape type for KW23650: 0
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: DW12322
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: HL13838
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: KS49913
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: BT22959
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: MN59888
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: FW35723
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW35723%27 HTTP/1.1" 200 None
2026-03-28 12:06:26 [auto1.it] INFO: Scrape type for FW35723: 0
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: KR27714
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: ED22447
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: VJ79188
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: LU63689
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU63689%27 HTTP/1.1" 200 None
2026-03-28 12:06:26 [auto1.it] INFO: Scrape type for LU63689: 0
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: WV37243
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: JB13262
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: CC61798
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: WD34729
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: XH41983
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: ZW84587
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW84587%27 HTTP/1.1" 200 None
2026-03-28 12:06:26 [auto1.it] INFO: Scrape type for ZW84587: 0
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: LN05453
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN05453%27 HTTP/1.1" 200 None
2026-03-28 12:06:26 [auto1.it] INFO: Scrape type for LN05453: 0
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: RT93241
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: RY04213
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: ER90508
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER90508%27 HTTP/1.1" 200 None
2026-03-28 12:06:26 [auto1.it] INFO: Scrape type for ER90508: 0
2026-03-28 12:06:26 [auto1.it] INFO: Found listing with ID: HZ93936
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ93936%27 HTTP/1.1" 200 None
2026-03-28 12:06:26 [auto1.it] INFO: Scrape type for HZ93936: 0
2026-03-28 12:06:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:27 [auto1.it] INFO: Channel: 24h | Page: 90 | totalHits: 3674 | hits on page: 40
2026-03-28 12:06:27 [auto1.it] INFO: Found listing with ID: NF97325
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF97325%27 HTTP/1.1" 200 None
2026-03-28 12:06:27 [auto1.it] INFO: Scrape type for NF97325: 0
2026-03-28 12:06:27 [auto1.it] INFO: Found listing with ID: JE32335
2026-03-28 12:06:27 [auto1.it] INFO: Found listing with ID: BJ63933
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ63933%27 HTTP/1.1" 200 None
2026-03-28 12:06:27 [auto1.it] INFO: Scrape type for BJ63933: 0
2026-03-28 12:06:27 [auto1.it] INFO: Found listing with ID: LR54413
2026-03-28 12:06:27 [auto1.it] INFO: Found listing with ID: XN19179
2026-03-28 12:06:27 [auto1.it] INFO: Found listing with ID: EZ73351
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ73351%27 HTTP/1.1" 200 None
2026-03-28 12:06:27 [auto1.it] INFO: Scrape type for EZ73351: 0
2026-03-28 12:06:27 [auto1.it] INFO: Found listing with ID: SB88786
2026-03-28 12:06:27 [auto1.it] INFO: Found listing with ID: HE93915
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE93915%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [auto1.it] INFO: Scrape type for HE93915: 0
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: ED09945
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED09945%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [auto1.it] INFO: Scrape type for ED09945: 0
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: HA74709
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA74709%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [auto1.it] INFO: Scrape type for HA74709: 0
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: XJ87572
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ87572%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [auto1.it] INFO: Scrape type for XJ87572: 0
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: FZ12921
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ12921%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [auto1.it] INFO: Scrape type for FZ12921: 0
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: SE27388
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE27388%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [auto1.it] INFO: Scrape type for SE27388: 0
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: JS62412
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: ZV11200
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: ZZ46834
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: HR66434
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: ZK25944
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: SM34278
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM34278%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [auto1.it] INFO: Scrape type for SM34278: 0
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: EU08042
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: LC36038
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC36038%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [auto1.it] INFO: Scrape type for LC36038: 0
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: RJ82738
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: UR83709
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: KM71175
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM71175%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [auto1.it] INFO: Scrape type for KM71175: 0
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: ZP73975
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: LX64348
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: RY42018
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: MX61025
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX61025%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [auto1.it] INFO: Scrape type for MX61025: 0
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: UL18238
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: UA98347
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA98347%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [auto1.it] INFO: Scrape type for UA98347: 0
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: MA06356
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: XW51036
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW51036%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [auto1.it] INFO: Scrape type for XW51036: 0
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: VX82839
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX82839%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [auto1.it] INFO: Scrape type for VX82839: 0
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: BJ69368
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: DT48918
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: VL74139
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: NN68396
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN68396%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [auto1.it] INFO: Scrape type for NN68396: 0
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: BW07837
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: GL09473
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL09473%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [auto1.it] INFO: Scrape type for GL09473: 0
2026-03-28 12:06:28 [auto1.it] INFO: Found listing with ID: CN54432
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN54432%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [auto1.it] INFO: Scrape type for CN54432: 0
2026-03-28 12:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:29 [auto1.it] INFO: Channel: 24h | Page: 91 | totalHits: 3674 | hits on page: 40
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: AS27324
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS27324%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for AS27324: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: WD12881
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: XP84134
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: DX59233
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX59233%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for DX59233: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: US24028
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: UX21158
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX21158%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for UX21158: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: GX75357
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: AR78219
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR78219%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for AR78219: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: DA37611
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA37611%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for DA37611: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: LD48805
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: RA37062
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA37062%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for RA37062: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: XX59557
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX59557%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for XX59557: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: CJ01668
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: ED34625
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED34625%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for ED34625: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: NY40947
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: EB11724
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: BP64052
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP64052%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for BP64052: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: TJ20772
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: RS54948
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: MA83267
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA83267%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for MA83267: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: KR95959
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR95959%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for KR95959: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: DT34666
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT34666%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for DT34666: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: WR61044
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: PN56075
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN56075%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for PN56075: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: JN19530
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: CP99007
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP99007%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for CP99007: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: ES67961
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES67961%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for ES67961: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: YY37168
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: VC26054
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC26054%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for VC26054: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: ZN14128
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: EV19228
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: RM88416
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: XV39349
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: KA77498
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA77498%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for KA77498: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: CN88471
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN88471%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for CN88471: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: HY34989
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY34989%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for HY34989: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: EN53386
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: CV81447
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV81447%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Scrape type for CV81447: 0
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: JU21728
2026-03-28 12:06:29 [auto1.it] INFO: Found listing with ID: RG06778
2026-03-28 12:06:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:30 [auto1.it] INFO: Channel: 24h | Page: 92 | totalHits: 3674 | hits on page: 34
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: YW53472
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: GM11383
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM11383%27 HTTP/1.1" 200 None
2026-03-28 12:06:30 [auto1.it] INFO: Scrape type for GM11383: 0
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: LU21739
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU21739%27 HTTP/1.1" 200 None
2026-03-28 12:06:30 [auto1.it] INFO: Scrape type for LU21739: 0
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: VS54724
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS54724%27 HTTP/1.1" 200 None
2026-03-28 12:06:30 [auto1.it] INFO: Scrape type for VS54724: 0
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: KD87590
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: TD38619
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: XC14615
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: TH24600
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: PV59173
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: GU05332
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU05332%27 HTTP/1.1" 200 None
2026-03-28 12:06:30 [auto1.it] INFO: Scrape type for GU05332: 0
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: KY69981
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: GW90153
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW90153%27 HTTP/1.1" 200 None
2026-03-28 12:06:30 [auto1.it] INFO: Scrape type for GW90153: 0
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: KC73163
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: GC28590
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: LH97251
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: ND06570
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: FT76605
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: UT43750
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: TZ23741
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: VR70375
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: RR03246
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: ZM66429
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: MS79311
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS79311%27 HTTP/1.1" 200 None
2026-03-28 12:06:30 [auto1.it] INFO: Scrape type for MS79311: 0
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: YL87875
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL87875%27 HTTP/1.1" 200 None
2026-03-28 12:06:30 [auto1.it] INFO: Scrape type for YL87875: 0
2026-03-28 12:06:30 [auto1.it] INFO: Found listing with ID: RJ76809
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ76809%27 HTTP/1.1" 200 None
2026-03-28 12:06:31 [auto1.it] INFO: Scrape type for RJ76809: 0
2026-03-28 12:06:31 [auto1.it] INFO: Found listing with ID: UU69652
2026-03-28 12:06:31 [auto1.it] INFO: Found listing with ID: BH88586
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH88586%27 HTTP/1.1" 200 None
2026-03-28 12:06:31 [auto1.it] INFO: Scrape type for BH88586: 0
2026-03-28 12:06:31 [auto1.it] INFO: Found listing with ID: PL71131
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL71131%27 HTTP/1.1" 200 None
2026-03-28 12:06:31 [auto1.it] INFO: Scrape type for PL71131: 0
2026-03-28 12:06:31 [auto1.it] INFO: Found listing with ID: SL84548
2026-03-28 12:06:31 [auto1.it] INFO: Found listing with ID: NV14531
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV14531%27 HTTP/1.1" 200 None
2026-03-28 12:06:31 [auto1.it] INFO: Scrape type for NV14531: 0
2026-03-28 12:06:31 [auto1.it] INFO: Found listing with ID: GA45330
2026-03-28 12:06:31 [auto1.it] INFO: Found listing with ID: FG22478
2026-03-28 12:06:31 [auto1.it] INFO: Found listing with ID: PK65337
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK65337%27 HTTP/1.1" 200 None
2026-03-28 12:06:31 [auto1.it] INFO: Scrape type for PK65337: 0
2026-03-28 12:06:31 [auto1.it] INFO: Found listing with ID: AU70551
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU70551%27 HTTP/1.1" 200 None
2026-03-28 12:06:31 [auto1.it] INFO: Scrape type for AU70551: 0
2026-03-28 12:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:31 [auto1.it] INFO: Channel: 24h | Page: 93 | totalHits: 3674 | hits on page: 0
2026-03-28 12:06:31 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 12:06:31 [auto1.it] INFO: auto1.it Batch config: batch 1/2
2026-03-28 12:06:31 [auto1.it] INFO: auto1.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 127, <ScrapeType.BATCH_SKIPPED: 5>: 142}
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20last_price_update_time%20lt%201774267592 HTTP/1.1" 200 None
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='AB61050') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='AU40791') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='AU57025') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='BE80776') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='BJ25775') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='BJ47426') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='BL12748') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='BL27728') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='BX32747') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CC73546') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CM33617') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CR89969') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CU77957') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CZ86305') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CZ89669') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='DB04120') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='DK99841') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='DN16039') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='DT70523') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='DV92182') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='DY67922') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='EC41125') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ED09596') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='EP59254') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ES44185') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ES61114') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='EY30987') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='EZ15465') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='FC80955') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='FJ50799') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='FN53725') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='FR09983') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='GD05176') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='GJ44194') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='HD43956') HTTP/1.1" 204 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='HP30710') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='HU34790') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JP15584') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JR52403') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JS30214') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JU34928') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JV01871') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JW31582') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JZ82542') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KB08250') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KG37768') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KW20053') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KZ65568') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LB06226') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LC69762') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LD74204') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LF81454') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LK64518') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LM44868') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LN98755') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LS68308') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LS71413') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LU33475') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LU86398') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LY78924') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='MU93072') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='MV29408') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='MV76262') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='MW36799') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='MX85045') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NB05481') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NB34500') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ND41368') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NF57755') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NR44234') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NW69529') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NY01945') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NY50513') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NY63740') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='PA10811') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='PN63978') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='PU74357') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='PV39721') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='PX17427') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ07537') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RB85094') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RF53509') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RR99837') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RZ13611') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RZ53840') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SG73964') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SJ07375') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SK78603') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SM91514') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SR07478') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TE70171') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TF46033') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TJ84643') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TT70062') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UC14598') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UC37851') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UC75077') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UE07363') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UW57613') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UY09817') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UY83839') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VA85498') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VJ94912') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VK21285') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VL97661') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WC79116') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WJ27311') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WL73556') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WM65321') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WM96719') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WT31989') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XC10148') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XC32483') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XC45910') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XD73989') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XH74087') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XR16002') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XS81991') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XU96260') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YD08336') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YH99570') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YP88006') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YS34741') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YS90199') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YV44698') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZA02716') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZE58846') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZT64960') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZU81404') HTTP/1.1" 204 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ23585') HTTP/1.1" 204 0
2026-03-28 12:06:33 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (341 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.it/task_24_2026-03-28T12_00_00.jl
2026-03-28 12:06:33 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1598074,
'downloader/request_count': 915,
'downloader/request_method_count/GET': 820,
'downloader/request_method_count/POST': 95,
'downloader/response_bytes': 350051979,
'downloader/response_count': 915,
'downloader/response_status_count/200': 915,
'dupefilter/filtered': 18,
'elapsed_time_seconds': 388.505932,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 28, 12, 6, 33, 900322, tzinfo=datetime.timezone.utc),
'item_scraped_count': 341,
'log_count/DEBUG': 11639,
'log_count/INFO': 13090,
'memusage/max': 202227712,
'memusage/startup': 150155264,
'photo_download_count': 624,
'request_depth_max': 96,
'response_received_count': 291,
'scheduler/dequeued': 915,
'scheduler/dequeued/memory': 915,
'scheduler/enqueued': 915,
'scheduler/enqueued/memory': 915,
'scrape_type/batch_skipped': 1882,
'scrape_type/new': 97,
'scrape_type/price_update': 244,
'scrape_type/skipped': 1473,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 291,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 2.773767565985136,
'scrapy-zyte-api/mean_response_seconds': 2.8316881297831493,
'scrapy-zyte-api/processed': 291,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 291,
'scrapy-zyte-api/request_args/experimental.requestCookies': 290,
'scrapy-zyte-api/request_args/experimental.responseCookies': 291,
'scrapy-zyte-api/request_args/httpRequestBody': 95,
'scrapy-zyte-api/request_args/httpRequestMethod': 95,
'scrapy-zyte-api/request_args/httpResponseBody': 291,
'scrapy-zyte-api/request_args/httpResponseHeaders': 291,
'scrapy-zyte-api/request_args/sessionContext': 291,
'scrapy-zyte-api/request_args/url': 291,
'scrapy-zyte-api/status_codes/200': 291,
'scrapy-zyte-api/success': 291,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 3714,
'source/total_available': 3674,
'start_time': datetime.datetime(2026, 3, 28, 12, 0, 5, 394390, tzinfo=datetime.timezone.utc)}
2026-03-28 12:06:33 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 12:06:34 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2e3f5b1f50>
2026-03-28 12:06:34 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2e3f700450>