2026-03-28 09:00:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 09:00:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 09:00:04 [auto1.it] INFO: Batch mode enabled: batch 1/2
2026-03-28 09:00:04 [auto1.it] INFO: Starting spider auto1.it
2026-03-28 09:00:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 09:00:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 09:00:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 09:00:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 09:00:04 [scrapy.extensions.telnet] INFO: Telnet Password: 134605d4a3a42867
2026-03-28 09:00:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 09:00:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.it/task_24_2026-03-28T09_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 09:00:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 09:00:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 09:00:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 09:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 09:00:05 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 09:00:05 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-28 09:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 09:00:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-28 09:00:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 09:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 09:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 09:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 09:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 09:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 09:00:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 09:00:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 09:00:05 [scrapy.core.engine] INFO: Spider opened
2026-03-28 09:00:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 09:00:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 09:00:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-28 09:00:05 [scrapy-playwright] INFO: Starting download handler
2026-03-28 09:00:05 [scrapy-playwright] INFO: Starting download handler
2026-03-28 09:00:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 09:00:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 09:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 09:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 09:00:15 [auto1.it] INFO: Channel: 24h | Page: 0 | totalHits: 3429 | hits on page: 40
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: FV28373
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: WM91137
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: BU89130
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: MR74044
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: JB83443
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: PB47164
2026-03-28 09:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB47164%27 HTTP/1.1" 200 None
2026-03-28 09:00:15 [auto1.it] INFO: Scrape type for PB47164: 1
2026-03-28 09:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: RU74019
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: GT62268
2026-03-28 09:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT62268%27 HTTP/1.1" 200 None
2026-03-28 09:00:15 [auto1.it] INFO: Scrape type for GT62268: 1
2026-03-28 09:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: NY06096
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: DD11193
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: TU55073
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: JC52693
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: BA37529
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: PR63683
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: KC74563
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: JD73354
2026-03-28 09:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD73354%27 HTTP/1.1" 200 None
2026-03-28 09:00:15 [auto1.it] INFO: Scrape type for JD73354: 1
2026-03-28 09:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: MB22824
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: NW35507
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: AG64342
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: RC92896
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: WK68121
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: DR04246
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: MM70792
2026-03-28 09:00:15 [auto1.it] INFO: Found listing with ID: RF74009
2026-03-28 09:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF74009%27 HTTP/1.1" 200 None
2026-03-28 09:00:15 [auto1.it] INFO: Scrape type for RF74009: 2
2026-03-28 09:00:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2f55222-a70a-5771-9dfb-4bcd638f3c9f with identifier: RF74009
2026-03-28 09:00:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2f55222-a70a-5771-9dfb-4bcd638f3c9f with scrape type 2
2026-03-28 09:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2f55222-a70a-5771-9dfb-4bcd638f3c9f with scrape type 2
2026-03-28 09:00:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a2f55222-a70a-5771-9dfb-4bcd638f3c9f, identifier: RF74009
2026-03-28 09:00:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a2f55222-a70a-5771-9dfb-4bcd638f3c9f with identifier: RF74009
2026-03-28 09:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:00:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 09:00:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:00:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 09:00:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:00:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a2f55222-a70a-5771-9dfb-4bcd638f3c9f with identifier: RF74009
2026-03-28 09:00:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a2f55222-a70a-5771-9dfb-4bcd638f3c9f with identifier: RF74009 to the API
2026-03-28 09:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:36:08Z',
 'fuel_type': 'diesel',
 'id': 'a2f55222-a70a-5771-9dfb-4bcd638f3c9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF74009',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Connect',
 'odometer': 34876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-04',
 'seller_name': None,
 'title': 'Ford Transit Connect 1.5 EcoBlue TDCi Kasten Trend',
 'transmission': 'manual',
 'trim': 'Kasten Trend',
 'year': 2023}
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF74009%27 HTTP/1.1" 200 None
2026-03-28 09:00:16 [auto1.it] INFO: Saving data for RF74009: {'auction_closing_time': 1774884968.0, 'created_time': 1774342890.819331, 'last_price_update_time': 1774688416.389314}
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RF74009') HTTP/1.1" 204 0
2026-03-28 09:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:16 [auto1.it] INFO: Found listing with ID: FD11952
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD11952%27 HTTP/1.1" 200 None
2026-03-28 09:00:16 [auto1.it] INFO: Scrape type for FD11952: 0
2026-03-28 09:00:16 [auto1.it] INFO: Found listing with ID: VP67579
2026-03-28 09:00:16 [auto1.it] INFO: Found listing with ID: VM60926
2026-03-28 09:00:16 [auto1.it] INFO: Found listing with ID: RY72509
2026-03-28 09:00:16 [auto1.it] INFO: Found listing with ID: UE94474
2026-03-28 09:00:16 [auto1.it] INFO: Found listing with ID: FC17573
2026-03-28 09:00:16 [auto1.it] INFO: Found listing with ID: LG11591
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG11591%27 HTTP/1.1" 200 None
2026-03-28 09:00:16 [auto1.it] INFO: Scrape type for LG11591: 1
2026-03-28 09:00:16 [auto1.it] INFO: Found listing with ID: UD99211
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD99211%27 HTTP/1.1" 200 None
2026-03-28 09:00:16 [auto1.it] INFO: Scrape type for UD99211: 1
2026-03-28 09:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:16 [auto1.it] INFO: Found listing with ID: SX47374
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX47374%27 HTTP/1.1" 200 None
2026-03-28 09:00:16 [auto1.it] INFO: Scrape type for SX47374: 1
2026-03-28 09:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:16 [auto1.it] INFO: Found listing with ID: AP90035
2026-03-28 09:00:16 [auto1.it] INFO: Found listing with ID: NS10029
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS10029%27 HTTP/1.1" 200 None
2026-03-28 09:00:16 [auto1.it] INFO: Scrape type for NS10029: 1
2026-03-28 09:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:16 [auto1.it] INFO: Found listing with ID: BY89134
2026-03-28 09:00:16 [auto1.it] INFO: Found listing with ID: TW88152
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW88152%27 HTTP/1.1" 200 None
2026-03-28 09:00:16 [auto1.it] INFO: Scrape type for TW88152: 1
2026-03-28 09:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:16 [auto1.it] INFO: Found listing with ID: MU21056
2026-03-28 09:00:16 [auto1.it] INFO: Found listing with ID: BG29864
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG29864%27 HTTP/1.1" 200 None
2026-03-28 09:00:16 [auto1.it] INFO: Scrape type for BG29864: 1
2026-03-28 09:00:16 [auto1.it] INFO: Found listing with ID: XE56181
2026-03-28 09:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG11591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS10029/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX47374/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD73354/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB47164/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT62268/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BG29864/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW88152/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG11591> (referer: https://www.auto1.com/v1/car-details-view/LG11591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD99211/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbab5590-197f-5160-b62f-f56d70110de0 with identifier: LG11591
2026-03-28 09:00:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbab5590-197f-5160-b62f-f56d70110de0 with scrape type 1
2026-03-28 09:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item bbab5590-197f-5160-b62f-f56d70110de0
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec780b3b4a34c6615b35b01d28ef44b3%252Fpa%252FLG11591_9b049fb2eeea8111cbac861b320e2cce.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_9b049fb2eeea8111cbac861b320e2cce.jpg not downloaded yet
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec780b3b4a34c6615b35b01d28ef44b3%252Fpa%252FLG11591_6e4cccb12aa841728c577615d0025820.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_6e4cccb12aa841728c577615d0025820.jpg not downloaded yet
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec780b3b4a34c6615b35b01d28ef44b3%252Fpa%252FLG11591_ee90a82f6e3dd438268dc010e59136a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_ee90a82f6e3dd438268dc010e59136a2.jpg not downloaded yet
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec780b3b4a34c6615b35b01d28ef44b3%252Fpa%252FLG11591_0a00241fc5e1f925839ad27be34c01ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_0a00241fc5e1f925839ad27be34c01ed.jpg not downloaded yet
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec780b3b4a34c6615b35b01d28ef44b3%252Fpa%252FLG11591_602b3bb32f0e99f9f6b72446d557ea75.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_602b3bb32f0e99f9f6b72446d557ea75.jpg not downloaded yet
2026-03-28 09:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD73354> (referer: https://www.auto1.com/v1/car-details-view/JD73354/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5 with identifier: JD73354
2026-03-28 09:00:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5 with scrape type 1
2026-03-28 09:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fe5%252F2fe5c1742f4eba76073eaabfbeffefa2%252Fpa%252FJD73354_f8e8ebc830b644c5f9e383d13ec2f333.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_f8e8ebc830b644c5f9e383d13ec2f333.jpg not downloaded yet
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fe5%252F2fe5c1742f4eba76073eaabfbeffefa2%252Fpa%252FJD73354_7599bfb6ed69145131f49f5f4f62f3d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_7599bfb6ed69145131f49f5f4f62f3d7.jpg not downloaded yet
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fe5%252F2fe5c1742f4eba76073eaabfbeffefa2%252Fpa%252FJD73354_0ce9cd903bf8b0ddc08e8fa3553b000a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_0ce9cd903bf8b0ddc08e8fa3553b000a.jpg not downloaded yet
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fe5%252F2fe5c1742f4eba76073eaabfbeffefa2%252Fpa%252FJD73354_341b542efd0db9cb1c8a1ee96faab0bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_341b542efd0db9cb1c8a1ee96faab0bc.jpg not downloaded yet
2026-03-28 09:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS10029> (referer: https://www.auto1.com/v1/car-details-view/NS10029/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_9b049fb2eeea8111cbac861b320e2cce.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fe5%252F2fe5c1742f4eba76073eaabfbeffefa2%252Fpa%252FJD73354_4b2482fc0c354356dbb169c15184a499.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_4b2482fc0c354356dbb169c15184a499.jpg not downloaded yet
2026-03-28 09:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_602b3bb32f0e99f9f6b72446d557ea75.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_341b542efd0db9cb1c8a1ee96faab0bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_ee90a82f6e3dd438268dc010e59136a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 147f78cc-380a-581c-9a8a-580c07129338 with identifier: NS10029
2026-03-28 09:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 147f78cc-380a-581c-9a8a-580c07129338 with scrape type 1
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 147f78cc-380a-581c-9a8a-580c07129338
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fe5%252F2be5407945cc2d5ff1b7d4b07729bcde%252Fpa%252FNS10029_bf7725ce3dff780abf87b69f719b30d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_bf7725ce3dff780abf87b69f719b30d0.jpg not downloaded yet
2026-03-28 09:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_4b2482fc0c354356dbb169c15184a499.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fe5%252F2be5407945cc2d5ff1b7d4b07729bcde%252Fpa%252FNS10029_5c0be194662de9a3e97111f8942d97ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_5c0be194662de9a3e97111f8942d97ae.jpg not downloaded yet
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fe5%252F2be5407945cc2d5ff1b7d4b07729bcde%252Fpa%252FNS10029_7ef938007d7d2b845d3f0a3f6964aa72.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_7ef938007d7d2b845d3f0a3f6964aa72.jpg not downloaded yet
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6add90>
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2111
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbab5590-197f-5160-b62f-f56d70110de0/bbab5590-197f-5160-b62f-f56d70110de0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec780b3b4a34c6615b35b01d28ef44b3%252Fpa%252FLG11591_9b049fb2eeea8111cbac861b320e2cce.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_9b049fb2eeea8111cbac861b320e2cce.jpg saved to cache
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbab5590-197f-5160-b62f-f56d70110de0
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19dab5d0>
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbab5590-197f-5160-b62f-f56d70110de0/bbab5590-197f-5160-b62f-f56d70110de0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec780b3b4a34c6615b35b01d28ef44b3%252Fpa%252FLG11591_602b3bb32f0e99f9f6b72446d557ea75.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_602b3bb32f0e99f9f6b72446d557ea75.jpg saved to cache
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbab5590-197f-5160-b62f-f56d70110de0
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fe5%252F2be5407945cc2d5ff1b7d4b07729bcde%252Fpa%252FNS10029_08ad668c8e630bf380465b294cdead5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_08ad668c8e630bf380465b294cdead5b.jpg not downloaded yet
2026-03-28 09:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_7599bfb6ed69145131f49f5f4f62f3d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_f8e8ebc830b644c5f9e383d13ec2f333.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_6e4cccb12aa841728c577615d0025820.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_0a00241fc5e1f925839ad27be34c01ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_0ce9cd903bf8b0ddc08e8fa3553b000a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_bf7725ce3dff780abf87b69f719b30d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fe5%252F2be5407945cc2d5ff1b7d4b07729bcde%252Fpa%252FNS10029_29463a2a37261532ecf49499c5338e6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_29463a2a37261532ecf49499c5338e6f.jpg not downloaded yet
2026-03-28 09:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB47164> (referer: https://www.auto1.com/v1/car-details-view/PB47164/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a667f10>
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71fd0bc0-b942-5fc4-849b-935c3f7dc6e5/71fd0bc0-b942-5fc4-849b-935c3f7dc6e5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fe5%252F2fe5c1742f4eba76073eaabfbeffefa2%252Fpa%252FJD73354_341b542efd0db9cb1c8a1ee96faab0bc.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_341b542efd0db9cb1c8a1ee96faab0bc.jpg saved to cache
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19e07410>
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbab5590-197f-5160-b62f-f56d70110de0/bbab5590-197f-5160-b62f-f56d70110de0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec780b3b4a34c6615b35b01d28ef44b3%252Fpa%252FLG11591_ee90a82f6e3dd438268dc010e59136a2.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_ee90a82f6e3dd438268dc010e59136a2.jpg saved to cache
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbab5590-197f-5160-b62f-f56d70110de0
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19e0bdd0>
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71fd0bc0-b942-5fc4-849b-935c3f7dc6e5/71fd0bc0-b942-5fc4-849b-935c3f7dc6e5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fe5%252F2fe5c1742f4eba76073eaabfbeffefa2%252Fpa%252FJD73354_4b2482fc0c354356dbb169c15184a499.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_4b2482fc0c354356dbb169c15184a499.jpg saved to cache
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5
2026-03-28 09:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_7ef938007d7d2b845d3f0a3f6964aa72.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT62268> (referer: https://www.auto1.com/v1/car-details-view/GT62268/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19e07110>
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71fd0bc0-b942-5fc4-849b-935c3f7dc6e5/71fd0bc0-b942-5fc4-849b-935c3f7dc6e5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fe5%252F2fe5c1742f4eba76073eaabfbeffefa2%252Fpa%252FJD73354_7599bfb6ed69145131f49f5f4f62f3d7.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_7599bfb6ed69145131f49f5f4f62f3d7.jpg saved to cache
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cb59d0>
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71fd0bc0-b942-5fc4-849b-935c3f7dc6e5/71fd0bc0-b942-5fc4-849b-935c3f7dc6e5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fe5%252F2fe5c1742f4eba76073eaabfbeffefa2%252Fpa%252FJD73354_f8e8ebc830b644c5f9e383d13ec2f333.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_f8e8ebc830b644c5f9e383d13ec2f333.jpg saved to cache
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cb5d50>
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbab5590-197f-5160-b62f-f56d70110de0/bbab5590-197f-5160-b62f-f56d70110de0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec780b3b4a34c6615b35b01d28ef44b3%252Fpa%252FLG11591_6e4cccb12aa841728c577615d0025820.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_6e4cccb12aa841728c577615d0025820.jpg saved to cache
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbab5590-197f-5160-b62f-f56d70110de0
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cc03d0>
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbab5590-197f-5160-b62f-f56d70110de0/bbab5590-197f-5160-b62f-f56d70110de0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F78%252Fec780b3b4a34c6615b35b01d28ef44b3%252Fpa%252FLG11591_0a00241fc5e1f925839ad27be34c01ed.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_0a00241fc5e1f925839ad27be34c01ed.jpg saved to cache
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbab5590-197f-5160-b62f-f56d70110de0
2026-03-28 09:00:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbab5590-197f-5160-b62f-f56d70110de0, skipping ID generation
2026-03-28 09:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbab5590-197f-5160-b62f-f56d70110de0 with scrape type 1
2026-03-28 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbab5590-197f-5160-b62f-f56d70110de0 sending to next pipeline
2026-03-28 09:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bbab5590-197f-5160-b62f-f56d70110de0, identifier: LG11591
2026-03-28 09:00:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1c5b5350>
2026-03-28 09:00:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71fd0bc0-b942-5fc4-849b-935c3f7dc6e5/71fd0bc0-b942-5fc4-849b-935c3f7dc6e5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fe5%252F2fe5c1742f4eba76073eaabfbeffefa2%252Fpa%252FJD73354_0ce9cd903bf8b0ddc08e8fa3553b000a.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_0ce9cd903bf8b0ddc08e8fa3553b000a.jpg saved to cache
2026-03-28 09:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5
2026-03-28 09:00:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5, skipping ID generation
2026-03-28 09:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5 with scrape type 1
2026-03-28 09:00:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5 sending to next pipeline
2026-03-28 09:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5, identifier: JD73354
2026-03-28 09:00:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1c700490>
2026-03-28 09:00:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147f78cc-380a-581c-9a8a-580c07129338/147f78cc-380a-581c-9a8a-580c07129338_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fe5%252F2be5407945cc2d5ff1b7d4b07729bcde%252Fpa%252FNS10029_bf7725ce3dff780abf87b69f719b30d0.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_bf7725ce3dff780abf87b69f719b30d0.jpg saved to cache
2026-03-28 09:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 147f78cc-380a-581c-9a8a-580c07129338
2026-03-28 09:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbb1755c-dcc1-5901-ad6a-8691b825311c with identifier: PB47164
2026-03-28 09:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbb1755c-dcc1-5901-ad6a-8691b825311c with scrape type 1
2026-03-28 09:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item dbb1755c-dcc1-5901-ad6a-8691b825311c
2026-03-28 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F80%252Fc2801e2f9b5c9f9b1514a6f7bf29242d%252Fpa%252FPB47164_ee9a9d3bf135f36c34ed0eefd4dc7e0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_ee9a9d3bf135f36c34ed0eefd4dc7e0c.jpg not downloaded yet
2026-03-28 09:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bbab5590-197f-5160-b62f-f56d70110de0 with identifier: LG11591
2026-03-28 09:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:00:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 09:00:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:00:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 09:00:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bbab5590-197f-5160-b62f-f56d70110de0 with identifier: LG11591
2026-03-28 09:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bbab5590-197f-5160-b62f-f56d70110de0 with identifier: LG11591 to the API
2026-03-28 09:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_0a00241fc5e1f925839ad27be34c01ed.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:32:39Z',
 'fuel_type': 'petrol',
 'id': 'bbab5590-197f-5160-b62f-f56d70110de0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG11591',
 'listing': 'auction',
 'location': 'IT, Casoria',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 241422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbab5590-197f-5160-b62f-f56d70110de0/bbab5590-197f-5160-b62f-f56d70110de0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_9b049fb2eeea8111cbac861b320e2cce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbab5590-197f-5160-b62f-f56d70110de0/bbab5590-197f-5160-b62f-f56d70110de0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_6e4cccb12aa841728c577615d0025820.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbab5590-197f-5160-b62f-f56d70110de0/bbab5590-197f-5160-b62f-f56d70110de0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_ee90a82f6e3dd438268dc010e59136a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbab5590-197f-5160-b62f-f56d70110de0/bbab5590-197f-5160-b62f-f56d70110de0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_0a00241fc5e1f925839ad27be34c01ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbab5590-197f-5160-b62f-f56d70110de0/bbab5590-197f-5160-b62f-f56d70110de0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/78/ec780b3b4a34c6615b35b01d28ef44b3/pa/LG11591_602b3bb32f0e99f9f6b72446d557ea75.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2015}
2026-03-28 09:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG11591%27 HTTP/1.1" 200 None
2026-03-28 09:00:21 [auto1.it] INFO: Saving data for LG11591: {'created_time': 1774688421.303635, 'last_price_update_time': 1774688421.303646, 'auction_closing_time': 1774884759.0}
2026-03-28 09:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LG11591') HTTP/1.1" 204 0
2026-03-28 09:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5 with identifier: JD73354
2026-03-28 09:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:00:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 09:00:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5 with identifier: JD73354
2026-03-28 09:00:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5 with identifier: JD73354 to the API
2026-03-28 09:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_0ce9cd903bf8b0ddc08e8fa3553b000a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:13:43Z',
 'fuel_type': 'diesel',
 'id': '71fd0bc0-b942-5fc4-849b-935c3f7dc6e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD73354',
 'listing': 'auction',
 'location': 'IT, Alessandria',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 176577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71fd0bc0-b942-5fc4-849b-935c3f7dc6e5/71fd0bc0-b942-5fc4-849b-935c3f7dc6e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_f8e8ebc830b644c5f9e383d13ec2f333.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71fd0bc0-b942-5fc4-849b-935c3f7dc6e5/71fd0bc0-b942-5fc4-849b-935c3f7dc6e5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_7599bfb6ed69145131f49f5f4f62f3d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71fd0bc0-b942-5fc4-849b-935c3f7dc6e5/71fd0bc0-b942-5fc4-849b-935c3f7dc6e5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_0ce9cd903bf8b0ddc08e8fa3553b000a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71fd0bc0-b942-5fc4-849b-935c3f7dc6e5/71fd0bc0-b942-5fc4-849b-935c3f7dc6e5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_341b542efd0db9cb1c8a1ee96faab0bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71fd0bc0-b942-5fc4-849b-935c3f7dc6e5/71fd0bc0-b942-5fc4-849b-935c3f7dc6e5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/e5/2fe5c1742f4eba76073eaabfbeffefa2/pa/JD73354_4b2482fc0c354356dbb169c15184a499.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Corolla 1.4 D-4D Compact',
 'transmission': 'automatic',
 'trim': 'Compact',
 'year': 2006}
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD73354%27 HTTP/1.1" 200 None
2026-03-28 09:00:22 [auto1.it] INFO: Saving data for JD73354: {'created_time': 1774688422.074593, 'last_price_update_time': 1774688422.074605, 'auction_closing_time': 1774883623.0}
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JD73354') HTTP/1.1" 204 0
2026-03-28 09:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_29463a2a37261532ecf49499c5338e6f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_08ad668c8e630bf380465b294cdead5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F80%252Fc2801e2f9b5c9f9b1514a6f7bf29242d%252Fpa%252FPB47164_721b6ec3871601f4b8c710e9dc8e6f09.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_721b6ec3871601f4b8c710e9dc8e6f09.jpg not downloaded yet
2026-03-28 09:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_5c0be194662de9a3e97111f8942d97ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW88152> (referer: https://www.auto1.com/v1/car-details-view/TW88152/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F80%252Fc2801e2f9b5c9f9b1514a6f7bf29242d%252Fpa%252FPB47164_a583372cec7be71aaf34663205de0f2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_a583372cec7be71aaf34663205de0f2e.jpg not downloaded yet
2026-03-28 09:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BG29864> (referer: https://www.auto1.com/v1/car-details-view/BG29864/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX47374> (referer: https://www.auto1.com/v1/car-details-view/SX47374/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD99211> (referer: https://www.auto1.com/v1/car-details-view/UD99211/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19df7790>
2026-03-28 09:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147f78cc-380a-581c-9a8a-580c07129338/147f78cc-380a-581c-9a8a-580c07129338_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fe5%252F2be5407945cc2d5ff1b7d4b07729bcde%252Fpa%252FNS10029_7ef938007d7d2b845d3f0a3f6964aa72.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_7ef938007d7d2b845d3f0a3f6964aa72.jpg saved to cache
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 147f78cc-380a-581c-9a8a-580c07129338
2026-03-28 09:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 215da4ae-ea25-5460-b688-baeacd31392c with identifier: GT62268
2026-03-28 09:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 215da4ae-ea25-5460-b688-baeacd31392c with scrape type 1
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 215da4ae-ea25-5460-b688-baeacd31392c
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_0d40e163c9cc296e3646bc73092f582e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_0d40e163c9cc296e3646bc73092f582e.jpg not downloaded yet
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F80%252Fc2801e2f9b5c9f9b1514a6f7bf29242d%252Fpa%252FPB47164_b56ffebe8260bdb6b0a683b6933df93f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_b56ffebe8260bdb6b0a683b6933df93f.jpg not downloaded yet
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_e6ee723163d66985622658fa41fcf3ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_e6ee723163d66985622658fa41fcf3ef.jpg not downloaded yet
2026-03-28 09:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_ee9a9d3bf135f36c34ed0eefd4dc7e0c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F80%252Fc2801e2f9b5c9f9b1514a6f7bf29242d%252Fpa%252FPB47164_2e40bef95a80d9a00604c161fae2c0b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_2e40bef95a80d9a00604c161fae2c0b1.jpg not downloaded yet
2026-03-28 09:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19e0f950>
2026-03-28 09:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147f78cc-380a-581c-9a8a-580c07129338/147f78cc-380a-581c-9a8a-580c07129338_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fe5%252F2be5407945cc2d5ff1b7d4b07729bcde%252Fpa%252FNS10029_29463a2a37261532ecf49499c5338e6f.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_29463a2a37261532ecf49499c5338e6f.jpg saved to cache
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 147f78cc-380a-581c-9a8a-580c07129338
2026-03-28 09:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1c7175d0>
2026-03-28 09:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147f78cc-380a-581c-9a8a-580c07129338/147f78cc-380a-581c-9a8a-580c07129338_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fe5%252F2be5407945cc2d5ff1b7d4b07729bcde%252Fpa%252FNS10029_08ad668c8e630bf380465b294cdead5b.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_08ad668c8e630bf380465b294cdead5b.jpg saved to cache
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 147f78cc-380a-581c-9a8a-580c07129338
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_d2dab5236750dc9b568cd3e61ad81bff.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_d2dab5236750dc9b568cd3e61ad81bff.jpg not downloaded yet
2026-03-28 09:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19e08310>
2026-03-28 09:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147f78cc-380a-581c-9a8a-580c07129338/147f78cc-380a-581c-9a8a-580c07129338_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fe5%252F2be5407945cc2d5ff1b7d4b07729bcde%252Fpa%252FNS10029_5c0be194662de9a3e97111f8942d97ae.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_5c0be194662de9a3e97111f8942d97ae.jpg saved to cache
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 147f78cc-380a-581c-9a8a-580c07129338
2026-03-28 09:00:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 147f78cc-380a-581c-9a8a-580c07129338, skipping ID generation
2026-03-28 09:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 147f78cc-380a-581c-9a8a-580c07129338 with scrape type 1
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 147f78cc-380a-581c-9a8a-580c07129338 sending to next pipeline
2026-03-28 09:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 147f78cc-380a-581c-9a8a-580c07129338, identifier: NS10029
2026-03-28 09:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1a92a41-4229-59b0-9860-e8d72eee9698 with identifier: TW88152
2026-03-28 09:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1a92a41-4229-59b0-9860-e8d72eee9698 with scrape type 1
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f1a92a41-4229-59b0-9860-e8d72eee9698
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F70%252F35703302a944b1d17ba43a473719da68%252Fpa%252FTW88152_ba510151e4b2f98e7baa7f1e21cc89ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_ba510151e4b2f98e7baa7f1e21cc89ca.jpg not downloaded yet
2026-03-28 09:00:22 [auto1.it] INFO: Channel: 24h | Page: 1 | totalHits: 3429 | hits on page: 40
2026-03-28 09:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 147f78cc-380a-581c-9a8a-580c07129338 with identifier: NS10029
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 09:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 147f78cc-380a-581c-9a8a-580c07129338 with identifier: NS10029
2026-03-28 09:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 147f78cc-380a-581c-9a8a-580c07129338 with identifier: NS10029 to the API
2026-03-28 09:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_5c0be194662de9a3e97111f8942d97ae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:47:23Z',
 'fuel_type': 'petrol',
 'id': '147f78cc-380a-581c-9a8a-580c07129338',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS10029',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 120461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147f78cc-380a-581c-9a8a-580c07129338/147f78cc-380a-581c-9a8a-580c07129338_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_bf7725ce3dff780abf87b69f719b30d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147f78cc-380a-581c-9a8a-580c07129338/147f78cc-380a-581c-9a8a-580c07129338_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_5c0be194662de9a3e97111f8942d97ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147f78cc-380a-581c-9a8a-580c07129338/147f78cc-380a-581c-9a8a-580c07129338_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_7ef938007d7d2b845d3f0a3f6964aa72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147f78cc-380a-581c-9a8a-580c07129338/147f78cc-380a-581c-9a8a-580c07129338_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_08ad668c8e630bf380465b294cdead5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147f78cc-380a-581c-9a8a-580c07129338/147f78cc-380a-581c-9a8a-580c07129338_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/e5/2be5407945cc2d5ff1b7d4b07729bcde/pa/NS10029_29463a2a37261532ecf49499c5338e6f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.4 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2010}
2026-03-28 09:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS10029%27 HTTP/1.1" 200 None
2026-03-28 09:00:23 [auto1.it] INFO: Saving data for NS10029: {'created_time': 1774688423.953285, 'last_price_update_time': 1774688423.953297, 'auction_closing_time': 1774885643.0}
2026-03-28 09:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NS10029') HTTP/1.1" 204 0
2026-03-28 09:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1363d362-26a5-5b06-9d73-858bc7619dd2 with identifier: BG29864
2026-03-28 09:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1363d362-26a5-5b06-9d73-858bc7619dd2 with scrape type 1
2026-03-28 09:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1363d362-26a5-5b06-9d73-858bc7619dd2
2026-03-28 09:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_91dc51e11253209fc633cdd827b15531.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_91dc51e11253209fc633cdd827b15531.jpg not downloaded yet
2026-03-28 09:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d with identifier: SX47374
2026-03-28 09:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d with scrape type 1
2026-03-28 09:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d
2026-03-28 09:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F81%252Fc98171d743ebf3395a794454480f49b2%252Fpa%252FSX47374_5713c0fb6161d973a3c49c50f07539b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_5713c0fb6161d973a3c49c50f07539b6.jpg already downloaded
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F81%252Fc98171d743ebf3395a794454480f49b2%252Fpa%252FSX47374_e412ab1714ebb0a55bee7e42840d576f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_e412ab1714ebb0a55bee7e42840d576f.jpg already downloaded
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F81%252Fc98171d743ebf3395a794454480f49b2%252Fpa%252FSX47374_e1380b4f69f397d19c1a1ddc109dc88c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_e1380b4f69f397d19c1a1ddc109dc88c.jpg already downloaded
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F81%252Fc98171d743ebf3395a794454480f49b2%252Fpa%252FSX47374_5f2ae5fc04cfda197593fbe1f6867000.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_5f2ae5fc04cfda197593fbe1f6867000.jpg already downloaded
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F81%252Fc98171d743ebf3395a794454480f49b2%252Fpa%252FSX47374_491701b31025af20ef99298b57967947.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_491701b31025af20ef99298b57967947.jpg already downloaded
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F81%252Fc98171d743ebf3395a794454480f49b2%252Fpa%252FSX47374_12de0c3d32e11c275a640ad7a269aa4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_12de0c3d32e11c275a640ad7a269aa4e.jpg already downloaded
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F81%252Fc98171d743ebf3395a794454480f49b2%252Fpa%252FSX47374_e9feb420d1aca093cba4811619ac12f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_e9feb420d1aca093cba4811619ac12f0.jpg already downloaded
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F81%252Fc98171d743ebf3395a794454480f49b2%252Fpa%252FSX47374_15a00f595df558d6e6ae266da3355c4a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_15a00f595df558d6e6ae266da3355c4a.jpg already downloaded
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F81%252Fc98171d743ebf3395a794454480f49b2%252Fpa%252FSX47374_ccbb47a21388a9a068ec06819307bff9.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_ccbb47a21388a9a068ec06819307bff9.jpg already downloaded
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F81%252Fc98171d743ebf3395a794454480f49b2%252Fpa%252FSX47374_1cd4261eea4fd9add3610c12ac9a4950.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_1cd4261eea4fd9add3610c12ac9a4950.jpg already downloaded
2026-03-28 09:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d, identifier: SX47374
2026-03-28 09:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2239071-2862-5308-b0b3-5e4ce38dcaa3 with identifier: UD99211
2026-03-28 09:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2239071-2862-5308-b0b3-5e4ce38dcaa3 with scrape type 1
2026-03-28 09:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2239071-2862-5308-b0b3-5e4ce38dcaa3
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_be99a6ee59117a9932519a11694fa1e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_be99a6ee59117a9932519a11694fa1e2.jpg not downloaded yet
2026-03-28 09:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_a583372cec7be71aaf34663205de0f2e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_c99a033cd70834bdffa403f1188cc3db.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_c99a033cd70834bdffa403f1188cc3db.jpg not downloaded yet
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F70%252F35703302a944b1d17ba43a473719da68%252Fpa%252FTW88152_8538bb50739c122ec5e01411be1d3431.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_8538bb50739c122ec5e01411be1d3431.jpg not downloaded yet
2026-03-28 09:00:24 [auto1.it] INFO: Found listing with ID: FV28373
2026-03-28 09:00:24 [auto1.it] INFO: Found listing with ID: WM91137
2026-03-28 09:00:24 [auto1.it] INFO: Found listing with ID: BU89130
2026-03-28 09:00:24 [auto1.it] INFO: Found listing with ID: MR74044
2026-03-28 09:00:24 [auto1.it] INFO: Found listing with ID: JB83443
2026-03-28 09:00:24 [auto1.it] INFO: Found listing with ID: PB47164
2026-03-28 09:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d with identifier: SX47374
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 09:00:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d with identifier: SX47374
2026-03-28 09:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d with identifier: SX47374 to the API
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SX47374>
{'auction_title': '',
 'c_o_2_emission_value': 93,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:06:02Z',
 'fuel_type': 'diesel',
 'id': '8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX47374',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 208445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_5713c0fb6161d973a3c49c50f07539b6.jpg',
                'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_e412ab1714ebb0a55bee7e42840d576f.jpg',
                'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_e1380b4f69f397d19c1a1ddc109dc88c.jpg',
                'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_5f2ae5fc04cfda197593fbe1f6867000.jpg',
                'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_491701b31025af20ef99298b57967947.jpg',
                'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_12de0c3d32e11c275a640ad7a269aa4e.jpg',
                'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_e9feb420d1aca093cba4811619ac12f0.jpg',
                'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_15a00f595df558d6e6ae266da3355c4a.jpg',
                'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_ccbb47a21388a9a068ec06819307bff9.jpg',
                'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_1cd4261eea4fd9add3610c12ac9a4950.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d/8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_5713c0fb6161d973a3c49c50f07539b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d/8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_e412ab1714ebb0a55bee7e42840d576f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d/8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_e1380b4f69f397d19c1a1ddc109dc88c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d/8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_5f2ae5fc04cfda197593fbe1f6867000.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d/8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_491701b31025af20ef99298b57967947.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d/8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_12de0c3d32e11c275a640ad7a269aa4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d/8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_e9feb420d1aca093cba4811619ac12f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d/8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_15a00f595df558d6e6ae266da3355c4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d/8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_ccbb47a21388a9a068ec06819307bff9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d/8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/81/c98171d743ebf3395a794454480f49b2/pa/SX47374_1cd4261eea4fd9add3610c12ac9a4950.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2018}
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX47374%27 HTTP/1.1" 200 None
2026-03-28 09:00:24 [auto1.it] INFO: Saving data for SX47374: {'created_time': 1774688424.931988, 'last_price_update_time': 1774688424.932, 'auction_closing_time': 1774883162.0}
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SX47374') HTTP/1.1" 204 0
2026-03-28 09:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_721b6ec3871601f4b8c710e9dc8e6f09.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:24 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/PB47164/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_62c856e2d707b2a64ca6d28f109e4853.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_62c856e2d707b2a64ca6d28f109e4853.jpg not downloaded yet
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_4b3b1bb97a1bdbab29055b6ce0183ede.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_4b3b1bb97a1bdbab29055b6ce0183ede.jpg not downloaded yet
2026-03-28 09:00:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b44910>
2026-03-28 09:00:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb1755c-dcc1-5901-ad6a-8691b825311c/dbb1755c-dcc1-5901-ad6a-8691b825311c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F80%252Fc2801e2f9b5c9f9b1514a6f7bf29242d%252Fpa%252FPB47164_ee9a9d3bf135f36c34ed0eefd4dc7e0c.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_ee9a9d3bf135f36c34ed0eefd4dc7e0c.jpg saved to cache
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbb1755c-dcc1-5901-ad6a-8691b825311c
2026-03-28 09:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_b56ffebe8260bdb6b0a683b6933df93f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_d3260c01eebde9cbf6c36fb252e9c9f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_d3260c01eebde9cbf6c36fb252e9c9f1.jpg not downloaded yet
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F70%252F35703302a944b1d17ba43a473719da68%252Fpa%252FTW88152_11ecd8fe055a3319ebf504b1db46f0c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_11ecd8fe055a3319ebf504b1db46f0c0.jpg not downloaded yet
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: RU74019
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: GT62268
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_8d760b4a03097a468a7e761f30b02ac2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_8d760b4a03097a468a7e761f30b02ac2.jpg not downloaded yet
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_9aba20db4fa9153ba9cb2a5842eac617.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_9aba20db4fa9153ba9cb2a5842eac617.jpg not downloaded yet
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6e8910>
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb1755c-dcc1-5901-ad6a-8691b825311c/dbb1755c-dcc1-5901-ad6a-8691b825311c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F80%252Fc2801e2f9b5c9f9b1514a6f7bf29242d%252Fpa%252FPB47164_a583372cec7be71aaf34663205de0f2e.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_a583372cec7be71aaf34663205de0f2e.jpg saved to cache
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbb1755c-dcc1-5901-ad6a-8691b825311c
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_44a4242edecb9b7569fcc829c1b8e905.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_44a4242edecb9b7569fcc829c1b8e905.jpg not downloaded yet
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F70%252F35703302a944b1d17ba43a473719da68%252Fpa%252FTW88152_baf40643686f6818c157cdf0b9b6b567.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_baf40643686f6818c157cdf0b9b6b567.jpg not downloaded yet
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: NY06096
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: DD11193
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: TU55073
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: JC52693
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: BA37529
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: PR63683
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: KC74563
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: JD73354
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD73354%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [auto1.it] INFO: Scrape type for JD73354: 0
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: MB22824
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: NW35507
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: AG64342
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: RC92896
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: WK68121
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: DR04246
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: MM70792
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: RF74009
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF74009%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [auto1.it] INFO: Scrape type for RF74009: 0
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: FD11952
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD11952%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [auto1.it] INFO: Scrape type for FD11952: 0
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: VP67579
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: VM60926
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: RY72509
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: UE94474
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: FC17573
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: LG11591
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG11591%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [auto1.it] INFO: Scrape type for LG11591: 0
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: UD99211
2026-03-28 09:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_2e40bef95a80d9a00604c161fae2c0b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_ba510151e4b2f98e7baa7f1e21cc89ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_1ec44c7a1e6e8c353e0d02a2ba10fbb2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_1ec44c7a1e6e8c353e0d02a2ba10fbb2.jpg not downloaded yet
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_99a2eaa8304310b46afaa6e5e2276240.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_99a2eaa8304310b46afaa6e5e2276240.jpg not downloaded yet
2026-03-28 09:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_be99a6ee59117a9932519a11694fa1e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_91dc51e11253209fc633cdd827b15531.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_dc66fa5f45a4dd8ab610bc80371ecf69.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_dc66fa5f45a4dd8ab610bc80371ecf69.jpg not downloaded yet
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F70%252F35703302a944b1d17ba43a473719da68%252Fpa%252FTW88152_bfa855f01b77a42b567fc6d298cf702c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_bfa855f01b77a42b567fc6d298cf702c.jpg not downloaded yet
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: SX47374
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX47374%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [auto1.it] INFO: Scrape type for SX47374: 0
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: AP90035
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: NS10029
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS10029%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [auto1.it] INFO: Scrape type for NS10029: 0
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: BY89134
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: TW88152
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19bb8f90>
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb1755c-dcc1-5901-ad6a-8691b825311c/dbb1755c-dcc1-5901-ad6a-8691b825311c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F80%252Fc2801e2f9b5c9f9b1514a6f7bf29242d%252Fpa%252FPB47164_721b6ec3871601f4b8c710e9dc8e6f09.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_721b6ec3871601f4b8c710e9dc8e6f09.jpg saved to cache
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbb1755c-dcc1-5901-ad6a-8691b825311c
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19daba50>
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb1755c-dcc1-5901-ad6a-8691b825311c/dbb1755c-dcc1-5901-ad6a-8691b825311c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F80%252Fc2801e2f9b5c9f9b1514a6f7bf29242d%252Fpa%252FPB47164_b56ffebe8260bdb6b0a683b6933df93f.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_b56ffebe8260bdb6b0a683b6933df93f.jpg saved to cache
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbb1755c-dcc1-5901-ad6a-8691b825311c
2026-03-28 09:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_8538bb50739c122ec5e01411be1d3431.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_8c295cbce2a26d79a16a8f20c2b33a00.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_8c295cbce2a26d79a16a8f20c2b33a00.jpg not downloaded yet
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_c356cf309fc710138d8e730969e410d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_c356cf309fc710138d8e730969e410d0.jpg not downloaded yet
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_7f319eb0ddb4162d0f295ebcd9f95d1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_7f319eb0ddb4162d0f295ebcd9f95d1b.jpg not downloaded yet
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: MU21056
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: BG29864
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_9b9150ac1bac51317d9bd947f3ecf439.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_9b9150ac1bac51317d9bd947f3ecf439.jpg not downloaded yet
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_18cf66913e396fb57ad2233ef4dd1b40.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_18cf66913e396fb57ad2233ef4dd1b40.jpg not downloaded yet
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1ca45d50>
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb1755c-dcc1-5901-ad6a-8691b825311c/dbb1755c-dcc1-5901-ad6a-8691b825311c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F80%252Fc2801e2f9b5c9f9b1514a6f7bf29242d%252Fpa%252FPB47164_2e40bef95a80d9a00604c161fae2c0b1.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_2e40bef95a80d9a00604c161fae2c0b1.jpg saved to cache
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbb1755c-dcc1-5901-ad6a-8691b825311c
2026-03-28 09:00:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbb1755c-dcc1-5901-ad6a-8691b825311c, skipping ID generation
2026-03-28 09:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbb1755c-dcc1-5901-ad6a-8691b825311c with scrape type 1
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbb1755c-dcc1-5901-ad6a-8691b825311c sending to next pipeline
2026-03-28 09:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dbb1755c-dcc1-5901-ad6a-8691b825311c, identifier: PB47164
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a62be90>
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1a92a41-4229-59b0-9860-e8d72eee9698/f1a92a41-4229-59b0-9860-e8d72eee9698_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F70%252F35703302a944b1d17ba43a473719da68%252Fpa%252FTW88152_ba510151e4b2f98e7baa7f1e21cc89ca.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_ba510151e4b2f98e7baa7f1e21cc89ca.jpg saved to cache
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f1a92a41-4229-59b0-9860-e8d72eee9698
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c38210>
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_be99a6ee59117a9932519a11694fa1e2.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_be99a6ee59117a9932519a11694fa1e2.jpg saved to cache
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2239071-2862-5308-b0b3-5e4ce38dcaa3
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cbaed0>
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_91dc51e11253209fc633cdd827b15531.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_91dc51e11253209fc633cdd827b15531.jpg saved to cache
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1363d362-26a5-5b06-9d73-858bc7619dd2
2026-03-28 09:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_11ecd8fe055a3319ebf504b1db46f0c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_a8f0e1aa0b68afb5802141e2be907b77.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_a8f0e1aa0b68afb5802141e2be907b77.jpg not downloaded yet
2026-03-28 09:00:25 [auto1.it] INFO: Found listing with ID: XE56181
2026-03-28 09:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dbb1755c-dcc1-5901-ad6a-8691b825311c with identifier: PB47164
2026-03-28 09:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dbb1755c-dcc1-5901-ad6a-8691b825311c with identifier: PB47164
2026-03-28 09:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dbb1755c-dcc1-5901-ad6a-8691b825311c with identifier: PB47164 to the API
2026-03-28 09:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_2e40bef95a80d9a00604c161fae2c0b1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:12:19Z',
 'fuel_type': 'petrol',
 'id': 'dbb1755c-dcc1-5901-ad6a-8691b825311c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB47164',
 'listing': 'auction',
 'location': 'IT, Villasanta',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 213129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbb1755c-dcc1-5901-ad6a-8691b825311c/dbb1755c-dcc1-5901-ad6a-8691b825311c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_ee9a9d3bf135f36c34ed0eefd4dc7e0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbb1755c-dcc1-5901-ad6a-8691b825311c/dbb1755c-dcc1-5901-ad6a-8691b825311c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_721b6ec3871601f4b8c710e9dc8e6f09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbb1755c-dcc1-5901-ad6a-8691b825311c/dbb1755c-dcc1-5901-ad6a-8691b825311c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_a583372cec7be71aaf34663205de0f2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbb1755c-dcc1-5901-ad6a-8691b825311c/dbb1755c-dcc1-5901-ad6a-8691b825311c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_b56ffebe8260bdb6b0a683b6933df93f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbb1755c-dcc1-5901-ad6a-8691b825311c/dbb1755c-dcc1-5901-ad6a-8691b825311c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/80/c2801e2f9b5c9f9b1514a6f7bf29242d/pa/PB47164_2e40bef95a80d9a00604c161fae2c0b1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 B-Color',
 'transmission': 'manual',
 'trim': 'B-Color',
 'year': 2017}
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB47164%27 HTTP/1.1" 200 None
2026-03-28 09:00:27 [auto1.it] INFO: Saving data for PB47164: {'created_time': 1774688427.044509, 'last_price_update_time': 1774688427.044522, 'auction_closing_time': 1774883539.0}
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PB47164') HTTP/1.1" 204 0
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_62c856e2d707b2a64ca6d28f109e4853.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_4948a4ba6d32bc99a64663ce683284d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_4948a4ba6d32bc99a64663ce683284d1.jpg not downloaded yet
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_29188603264045a40d107f443bcbca72.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_29188603264045a40d107f443bcbca72.jpg not downloaded yet
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_4b3b1bb97a1bdbab29055b6ce0183ede.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_6afd5793c4fb2a5b2b90341ffd2e200e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_6afd5793c4fb2a5b2b90341ffd2e200e.jpg not downloaded yet
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_a13ee7a8ec65d983c4717ab565d0e4c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_a13ee7a8ec65d983c4717ab565d0e4c9.jpg not downloaded yet
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_b4d26a92be32a7a03a8aa3ed193d9616.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_b4d26a92be32a7a03a8aa3ed193d9616.jpg not downloaded yet
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b1e9d0>
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1a92a41-4229-59b0-9860-e8d72eee9698/f1a92a41-4229-59b0-9860-e8d72eee9698_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F70%252F35703302a944b1d17ba43a473719da68%252Fpa%252FTW88152_8538bb50739c122ec5e01411be1d3431.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_8538bb50739c122ec5e01411be1d3431.jpg saved to cache
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f1a92a41-4229-59b0-9860-e8d72eee9698
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c58910>
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1a92a41-4229-59b0-9860-e8d72eee9698/f1a92a41-4229-59b0-9860-e8d72eee9698_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F70%252F35703302a944b1d17ba43a473719da68%252Fpa%252FTW88152_11ecd8fe055a3319ebf504b1db46f0c0.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_11ecd8fe055a3319ebf504b1db46f0c0.jpg saved to cache
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f1a92a41-4229-59b0-9860-e8d72eee9698
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_2a1de426d592ce34a1109721584df840.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_2a1de426d592ce34a1109721584df840.jpg not downloaded yet
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_1a5105cfa72399c44cc48ce6a3bb71c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_1a5105cfa72399c44cc48ce6a3bb71c2.jpg not downloaded yet
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_baf40643686f6818c157cdf0b9b6b567.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_9aba20db4fa9153ba9cb2a5842eac617.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a653550>
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_62c856e2d707b2a64ca6d28f109e4853.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_62c856e2d707b2a64ca6d28f109e4853.jpg saved to cache
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1363d362-26a5-5b06-9d73-858bc7619dd2
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1ca45ad0>
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_4b3b1bb97a1bdbab29055b6ce0183ede.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_4b3b1bb97a1bdbab29055b6ce0183ede.jpg saved to cache
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2239071-2862-5308-b0b3-5e4ce38dcaa3
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_25c2edb1f3719c1689e77f7f1182c27b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_25c2edb1f3719c1689e77f7f1182c27b.jpg not downloaded yet
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_3bdc744e5aa5cbffe077e970d0aa8bed.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_3bdc744e5aa5cbffe077e970d0aa8bed.jpg not downloaded yet
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b308d0>
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1a92a41-4229-59b0-9860-e8d72eee9698/f1a92a41-4229-59b0-9860-e8d72eee9698_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F70%252F35703302a944b1d17ba43a473719da68%252Fpa%252FTW88152_baf40643686f6818c157cdf0b9b6b567.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_baf40643686f6818c157cdf0b9b6b567.jpg saved to cache
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f1a92a41-4229-59b0-9860-e8d72eee9698
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b28a50>
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_9aba20db4fa9153ba9cb2a5842eac617.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_9aba20db4fa9153ba9cb2a5842eac617.jpg saved to cache
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2239071-2862-5308-b0b3-5e4ce38dcaa3
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_8d760b4a03097a468a7e761f30b02ac2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_0d40e163c9cc296e3646bc73092f582e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_e6ee723163d66985622658fa41fcf3ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_c99a033cd70834bdffa403f1188cc3db.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_d2dab5236750dc9b568cd3e61ad81bff.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_44a4242edecb9b7569fcc829c1b8e905.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_d3260c01eebde9cbf6c36fb252e9c9f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_b4d26a92be32a7a03a8aa3ed193d9616.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_99a2eaa8304310b46afaa6e5e2276240.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_18cf66913e396fb57ad2233ef4dd1b40.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_9b9150ac1bac51317d9bd947f3ecf439.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_bfa855f01b77a42b567fc6d298cf702c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_1ec44c7a1e6e8c353e0d02a2ba10fbb2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_a13ee7a8ec65d983c4717ab565d0e4c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b31050>
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_8d760b4a03097a468a7e761f30b02ac2.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_8d760b4a03097a468a7e761f30b02ac2.jpg saved to cache
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1363d362-26a5-5b06-9d73-858bc7619dd2
2026-03-28 09:00:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b25a50>
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_0d40e163c9cc296e3646bc73092f582e.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_0d40e163c9cc296e3646bc73092f582e.jpg saved to cache
2026-03-28 09:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 215da4ae-ea25-5460-b688-baeacd31392c
2026-03-28 09:00:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6e0290>
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_e6ee723163d66985622658fa41fcf3ef.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_e6ee723163d66985622658fa41fcf3ef.jpg saved to cache
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 215da4ae-ea25-5460-b688-baeacd31392c
2026-03-28 09:00:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6865d0>
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_c99a033cd70834bdffa403f1188cc3db.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_c99a033cd70834bdffa403f1188cc3db.jpg saved to cache
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 215da4ae-ea25-5460-b688-baeacd31392c
2026-03-28 09:00:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a68d0d0>
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_d2dab5236750dc9b568cd3e61ad81bff.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_d2dab5236750dc9b568cd3e61ad81bff.jpg saved to cache
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 215da4ae-ea25-5460-b688-baeacd31392c
2026-03-28 09:00:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6e31d0>
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_44a4242edecb9b7569fcc829c1b8e905.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_44a4242edecb9b7569fcc829c1b8e905.jpg saved to cache
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 215da4ae-ea25-5460-b688-baeacd31392c
2026-03-28 09:00:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a684b90>
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_d3260c01eebde9cbf6c36fb252e9c9f1.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_d3260c01eebde9cbf6c36fb252e9c9f1.jpg saved to cache
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 215da4ae-ea25-5460-b688-baeacd31392c
2026-03-28 09:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_3bdc744e5aa5cbffe077e970d0aa8bed.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cab450>
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_b4d26a92be32a7a03a8aa3ed193d9616.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_b4d26a92be32a7a03a8aa3ed193d9616.jpg saved to cache
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2239071-2862-5308-b0b3-5e4ce38dcaa3
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cb7450>
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_99a2eaa8304310b46afaa6e5e2276240.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_99a2eaa8304310b46afaa6e5e2276240.jpg saved to cache
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2239071-2862-5308-b0b3-5e4ce38dcaa3
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19dd6910>
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_18cf66913e396fb57ad2233ef4dd1b40.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_18cf66913e396fb57ad2233ef4dd1b40.jpg saved to cache
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2239071-2862-5308-b0b3-5e4ce38dcaa3
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19bba350>
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_9b9150ac1bac51317d9bd947f3ecf439.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_9b9150ac1bac51317d9bd947f3ecf439.jpg saved to cache
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1363d362-26a5-5b06-9d73-858bc7619dd2
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1c858050>
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1a92a41-4229-59b0-9860-e8d72eee9698/f1a92a41-4229-59b0-9860-e8d72eee9698_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F70%252F35703302a944b1d17ba43a473719da68%252Fpa%252FTW88152_bfa855f01b77a42b567fc6d298cf702c.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_bfa855f01b77a42b567fc6d298cf702c.jpg saved to cache
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f1a92a41-4229-59b0-9860-e8d72eee9698
2026-03-28 09:00:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1a92a41-4229-59b0-9860-e8d72eee9698, skipping ID generation
2026-03-28 09:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1a92a41-4229-59b0-9860-e8d72eee9698 with scrape type 1
2026-03-28 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f1a92a41-4229-59b0-9860-e8d72eee9698 sending to next pipeline
2026-03-28 09:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f1a92a41-4229-59b0-9860-e8d72eee9698, identifier: TW88152
2026-03-28 09:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a653f10>
2026-03-28 09:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_1ec44c7a1e6e8c353e0d02a2ba10fbb2.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_1ec44c7a1e6e8c353e0d02a2ba10fbb2.jpg saved to cache
2026-03-28 09:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1363d362-26a5-5b06-9d73-858bc7619dd2
2026-03-28 09:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b31ed0>
2026-03-28 09:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_a13ee7a8ec65d983c4717ab565d0e4c9.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_a13ee7a8ec65d983c4717ab565d0e4c9.jpg saved to cache
2026-03-28 09:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1363d362-26a5-5b06-9d73-858bc7619dd2
2026-03-28 09:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f1a92a41-4229-59b0-9860-e8d72eee9698 with identifier: TW88152
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 09:00:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f1a92a41-4229-59b0-9860-e8d72eee9698 with identifier: TW88152
2026-03-28 09:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f1a92a41-4229-59b0-9860-e8d72eee9698 with identifier: TW88152 to the API
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_bfa855f01b77a42b567fc6d298cf702c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:39:18Z',
 'fuel_type': 'diesel',
 'id': 'f1a92a41-4229-59b0-9860-e8d72eee9698',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW88152',
 'listing': 'auction',
 'location': 'IT, Caltanissetta',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 192909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1a92a41-4229-59b0-9860-e8d72eee9698/f1a92a41-4229-59b0-9860-e8d72eee9698_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_ba510151e4b2f98e7baa7f1e21cc89ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1a92a41-4229-59b0-9860-e8d72eee9698/f1a92a41-4229-59b0-9860-e8d72eee9698_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_8538bb50739c122ec5e01411be1d3431.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1a92a41-4229-59b0-9860-e8d72eee9698/f1a92a41-4229-59b0-9860-e8d72eee9698_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_11ecd8fe055a3319ebf504b1db46f0c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1a92a41-4229-59b0-9860-e8d72eee9698/f1a92a41-4229-59b0-9860-e8d72eee9698_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_baf40643686f6818c157cdf0b9b6b567.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1a92a41-4229-59b0-9860-e8d72eee9698/f1a92a41-4229-59b0-9860-e8d72eee9698_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/70/35703302a944b1d17ba43a473719da68/pa/TW88152_bfa855f01b77a42b567fc6d298cf702c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW88152%27 HTTP/1.1" 200 None
2026-03-28 09:00:29 [auto1.it] INFO: Saving data for TW88152: {'created_time': 1774688429.864679, 'last_price_update_time': 1774688429.864691, 'auction_closing_time': 1774885158.0}
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TW88152') HTTP/1.1" 204 0
2026-03-28 09:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_4948a4ba6d32bc99a64663ce683284d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_25c2edb1f3719c1689e77f7f1182c27b.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_1a5105cfa72399c44cc48ce6a3bb71c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_29188603264045a40d107f443bcbca72.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_2a1de426d592ce34a1109721584df840.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19e0dc90>
2026-03-28 09:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_3bdc744e5aa5cbffe077e970d0aa8bed.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_3bdc744e5aa5cbffe077e970d0aa8bed.jpg saved to cache
2026-03-28 09:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b2239071-2862-5308-b0b3-5e4ce38dcaa3
2026-03-28 09:00:29 [auto1.it] INFO: Channel: 24h | Page: 2 | totalHits: 3429 | hits on page: 40
2026-03-28 09:00:29 [auto1.it] INFO: Found listing with ID: WY26414
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY26414%27 HTTP/1.1" 200 None
2026-03-28 09:00:29 [auto1.it] INFO: Scrape type for WY26414: 1
2026-03-28 09:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:29 [auto1.it] INFO: Found listing with ID: CP34925
2026-03-28 09:00:29 [auto1.it] INFO: Found listing with ID: UB84582
2026-03-28 09:00:29 [auto1.it] INFO: Found listing with ID: HY41860
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY41860%27 HTTP/1.1" 200 None
2026-03-28 09:00:29 [auto1.it] INFO: Scrape type for HY41860: 1
2026-03-28 09:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:29 [auto1.it] INFO: Found listing with ID: CB28979
2026-03-28 09:00:29 [auto1.it] INFO: Found listing with ID: FD69176
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD69176%27 HTTP/1.1" 200 None
2026-03-28 09:00:29 [auto1.it] INFO: Scrape type for FD69176: 1
2026-03-28 09:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:29 [auto1.it] INFO: Found listing with ID: RG05236
2026-03-28 09:00:29 [auto1.it] INFO: Found listing with ID: MN63848
2026-03-28 09:00:29 [auto1.it] INFO: Found listing with ID: GC15950
2026-03-28 09:00:29 [auto1.it] INFO: Found listing with ID: ZU87038
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU87038%27 HTTP/1.1" 200 None
2026-03-28 09:00:30 [auto1.it] INFO: Scrape type for ZU87038: 1
2026-03-28 09:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a629190>
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_4948a4ba6d32bc99a64663ce683284d1.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_4948a4ba6d32bc99a64663ce683284d1.jpg saved to cache
2026-03-28 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1363d362-26a5-5b06-9d73-858bc7619dd2
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a7d1610>
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_25c2edb1f3719c1689e77f7f1182c27b.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_25c2edb1f3719c1689e77f7f1182c27b.jpg saved to cache
2026-03-28 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1363d362-26a5-5b06-9d73-858bc7619dd2
2026-03-28 09:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_a8f0e1aa0b68afb5802141e2be907b77.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_8c295cbce2a26d79a16a8f20c2b33a00.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:30 [auto1.it] INFO: Found listing with ID: YR71782
2026-03-28 09:00:30 [auto1.it] INFO: Found listing with ID: RX70685
2026-03-28 09:00:30 [auto1.it] INFO: Found listing with ID: ZG33148
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG33148%27 HTTP/1.1" 200 None
2026-03-28 09:00:30 [auto1.it] INFO: Scrape type for ZG33148: 1
2026-03-28 09:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a75aad0>
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_1a5105cfa72399c44cc48ce6a3bb71c2.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_1a5105cfa72399c44cc48ce6a3bb71c2.jpg saved to cache
2026-03-28 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b2239071-2862-5308-b0b3-5e4ce38dcaa3
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b446d0>
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_29188603264045a40d107f443bcbca72.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_29188603264045a40d107f443bcbca72.jpg saved to cache
2026-03-28 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2239071-2862-5308-b0b3-5e4ce38dcaa3
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a782490>
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_2a1de426d592ce34a1109721584df840.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_2a1de426d592ce34a1109721584df840.jpg saved to cache
2026-03-28 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1363d362-26a5-5b06-9d73-858bc7619dd2
2026-03-28 09:00:30 [auto1.it] INFO: Found listing with ID: JP42061
2026-03-28 09:00:30 [auto1.it] INFO: Found listing with ID: PR59695
2026-03-28 09:00:30 [auto1.it] INFO: Found listing with ID: YC40082
2026-03-28 09:00:30 [auto1.it] INFO: Found listing with ID: AL09653
2026-03-28 09:00:30 [auto1.it] INFO: Found listing with ID: DK55043
2026-03-28 09:00:30 [auto1.it] INFO: Found listing with ID: AG82147
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG82147%27 HTTP/1.1" 200 None
2026-03-28 09:00:30 [auto1.it] INFO: Scrape type for AG82147: 1
2026-03-28 09:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_c356cf309fc710138d8e730969e410d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:30 [auto1.it] INFO: Found listing with ID: RG79014
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG79014%27 HTTP/1.1" 200 None
2026-03-28 09:00:30 [auto1.it] INFO: Scrape type for RG79014: 1
2026-03-28 09:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19daa410>
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_a8f0e1aa0b68afb5802141e2be907b77.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_a8f0e1aa0b68afb5802141e2be907b77.jpg saved to cache
2026-03-28 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 215da4ae-ea25-5460-b688-baeacd31392c
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a77d810>
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Ff6%252F75f6a09da4fc4b68d58341c0f3d15ce5%252Fpa%252FBG29864_8c295cbce2a26d79a16a8f20c2b33a00.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_8c295cbce2a26d79a16a8f20c2b33a00.jpg saved to cache
2026-03-28 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1363d362-26a5-5b06-9d73-858bc7619dd2
2026-03-28 09:00:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1363d362-26a5-5b06-9d73-858bc7619dd2, skipping ID generation
2026-03-28 09:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1363d362-26a5-5b06-9d73-858bc7619dd2 with scrape type 1
2026-03-28 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1363d362-26a5-5b06-9d73-858bc7619dd2 sending to next pipeline
2026-03-28 09:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1363d362-26a5-5b06-9d73-858bc7619dd2, identifier: BG29864
2026-03-28 09:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1363d362-26a5-5b06-9d73-858bc7619dd2 with identifier: BG29864
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 09:00:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1363d362-26a5-5b06-9d73-858bc7619dd2 with identifier: BG29864
2026-03-28 09:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1363d362-26a5-5b06-9d73-858bc7619dd2 with identifier: BG29864 to the API
2026-03-28 09:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_8c295cbce2a26d79a16a8f20c2b33a00.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:17:09Z',
 'fuel_type': 'petrol',
 'id': '1363d362-26a5-5b06-9d73-858bc7619dd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG29864',
 'listing': 'auction',
 'location': 'IT, Cesano Maderno',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 119769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_91dc51e11253209fc633cdd827b15531.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_62c856e2d707b2a64ca6d28f109e4853.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_8d760b4a03097a468a7e761f30b02ac2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_1ec44c7a1e6e8c353e0d02a2ba10fbb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_8c295cbce2a26d79a16a8f20c2b33a00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_9b9150ac1bac51317d9bd947f3ecf439.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_4948a4ba6d32bc99a64663ce683284d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_a13ee7a8ec65d983c4717ab565d0e4c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_2a1de426d592ce34a1109721584df840.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1363d362-26a5-5b06-9d73-858bc7619dd2/1363d362-26a5-5b06-9d73-858bc7619dd2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/f6/75f6a09da4fc4b68d58341c0f3d15ce5/pa/BG29864_25c2edb1f3719c1689e77f7f1182c27b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500L 1.4 Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2015}
2026-03-28 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG29864%27 HTTP/1.1" 200 None
2026-03-28 09:00:31 [auto1.it] INFO: Saving data for BG29864: {'created_time': 1774688431.983523, 'last_price_update_time': 1774688431.983534, 'auction_closing_time': 1774883829.0}
2026-03-28 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BG29864') HTTP/1.1" 204 0
2026-03-28 09:00:32 [auto1.it] INFO: Found listing with ID: NU26591
2026-03-28 09:00:32 [auto1.it] INFO: Found listing with ID: UB42424
2026-03-28 09:00:32 [auto1.it] INFO: Found listing with ID: RV63380
2026-03-28 09:00:32 [auto1.it] INFO: Found listing with ID: JE70672
2026-03-28 09:00:32 [auto1.it] INFO: Found listing with ID: KL44785
2026-03-28 09:00:32 [auto1.it] INFO: Found listing with ID: TU59167
2026-03-28 09:00:32 [auto1.it] INFO: Found listing with ID: TD04886
2026-03-28 09:00:32 [auto1.it] INFO: Found listing with ID: NK26905
2026-03-28 09:00:32 [auto1.it] INFO: Found listing with ID: PL47981
2026-03-28 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL47981%27 HTTP/1.1" 200 None
2026-03-28 09:00:32 [auto1.it] INFO: Scrape type for PL47981: 1
2026-03-28 09:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:32 [auto1.it] INFO: Found listing with ID: EP64063
2026-03-28 09:00:32 [auto1.it] INFO: Found listing with ID: XS31843
2026-03-28 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS31843%27 HTTP/1.1" 200 None
2026-03-28 09:00:32 [auto1.it] INFO: Scrape type for XS31843: 1
2026-03-28 09:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b45d90>
2026-03-28 09:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fe7%252Fbde7f506425bc2fac1a1970a2bf07d59%252Fpa%252FUD99211_c356cf309fc710138d8e730969e410d0.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_c356cf309fc710138d8e730969e410d0.jpg saved to cache
2026-03-28 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2239071-2862-5308-b0b3-5e4ce38dcaa3
2026-03-28 09:00:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2239071-2862-5308-b0b3-5e4ce38dcaa3, skipping ID generation
2026-03-28 09:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2239071-2862-5308-b0b3-5e4ce38dcaa3 with scrape type 1
2026-03-28 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2239071-2862-5308-b0b3-5e4ce38dcaa3 sending to next pipeline
2026-03-28 09:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b2239071-2862-5308-b0b3-5e4ce38dcaa3, identifier: UD99211
2026-03-28 09:00:32 [auto1.it] INFO: Found listing with ID: DP98022
2026-03-28 09:00:32 [auto1.it] INFO: Found listing with ID: TZ57511
2026-03-28 09:00:32 [auto1.it] INFO: Found listing with ID: XF75286
2026-03-28 09:00:32 [auto1.it] INFO: Found listing with ID: MN96094
2026-03-28 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN96094%27 HTTP/1.1" 200 None
2026-03-28 09:00:32 [auto1.it] INFO: Scrape type for MN96094: 2
2026-03-28 09:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f4453a-fce6-56ce-a906-1d6d34763870 with identifier: MN96094
2026-03-28 09:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f4453a-fce6-56ce-a906-1d6d34763870 with scrape type 2
2026-03-28 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17f4453a-fce6-56ce-a906-1d6d34763870 with scrape type 2
2026-03-28 09:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 17f4453a-fce6-56ce-a906-1d6d34763870, identifier: MN96094
2026-03-28 09:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b2239071-2862-5308-b0b3-5e4ce38dcaa3 with identifier: UD99211
2026-03-28 09:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b2239071-2862-5308-b0b3-5e4ce38dcaa3 with identifier: UD99211
2026-03-28 09:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b2239071-2862-5308-b0b3-5e4ce38dcaa3 with identifier: UD99211 to the API
2026-03-28 09:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_c356cf309fc710138d8e730969e410d0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:42:43Z',
 'fuel_type': 'diesel',
 'id': 'b2239071-2862-5308-b0b3-5e4ce38dcaa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD99211',
 'listing': 'auction',
 'location': 'IT, Genova',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 164500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_be99a6ee59117a9932519a11694fa1e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_4b3b1bb97a1bdbab29055b6ce0183ede.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_9aba20db4fa9153ba9cb2a5842eac617.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_99a2eaa8304310b46afaa6e5e2276240.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_c356cf309fc710138d8e730969e410d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_18cf66913e396fb57ad2233ef4dd1b40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_29188603264045a40d107f443bcbca72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_b4d26a92be32a7a03a8aa3ed193d9616.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_1a5105cfa72399c44cc48ce6a3bb71c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2239071-2862-5308-b0b3-5e4ce38dcaa3/b2239071-2862-5308-b0b3-5e4ce38dcaa3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/e7/bde7f506425bc2fac1a1970a2bf07d59/pa/UD99211_3bdc744e5aa5cbffe077e970d0aa8bed.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 dCi N-Tec 4x4',
 'transmission': 'manual',
 'trim': 'N-Tec 4x4',
 'year': 2011}
2026-03-28 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD99211%27 HTTP/1.1" 200 None
2026-03-28 09:00:32 [auto1.it] INFO: Saving data for UD99211: {'created_time': 1774688432.821066, 'last_price_update_time': 1774688432.821079, 'auction_closing_time': 1774885363.0}
2026-03-28 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UD99211') HTTP/1.1" 204 0
2026-03-28 09:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 17f4453a-fce6-56ce-a906-1d6d34763870 with identifier: MN96094
2026-03-28 09:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 17f4453a-fce6-56ce-a906-1d6d34763870 with identifier: MN96094
2026-03-28 09:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 17f4453a-fce6-56ce-a906-1d6d34763870 with identifier: MN96094 to the API
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:53:26Z',
 'fuel_type': 'petrol',
 'id': '17f4453a-fce6-56ce-a906-1d6d34763870',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN96094',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 93974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-04',
 'seller_name': None,
 'title': 'Skoda Roomster 1.2 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2007}
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN96094%27 HTTP/1.1" 200 None
2026-03-28 09:00:33 [auto1.it] INFO: Saving data for MN96094: {'auction_closing_time': 1774886006.0, 'created_time': 1774342924.722371, 'last_price_update_time': 1774688433.237388}
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MN96094') HTTP/1.1" 204 0
2026-03-28 09:00:33 [auto1.it] INFO: Found listing with ID: YD21144
2026-03-28 09:00:33 [auto1.it] INFO: Found listing with ID: RT57270
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT57270%27 HTTP/1.1" 200 None
2026-03-28 09:00:33 [auto1.it] INFO: Scrape type for RT57270: 1
2026-03-28 09:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY26414/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY41860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD69176/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU87038/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:33 [auto1.it] INFO: Found listing with ID: JC99655
2026-03-28 09:00:33 [auto1.it] INFO: Found listing with ID: YN59096
2026-03-28 09:00:33 [auto1.it] INFO: Found listing with ID: PC10641
2026-03-28 09:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_6afd5793c4fb2a5b2b90341ffd2e200e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_7f319eb0ddb4162d0f295ebcd9f95d1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_dc66fa5f45a4dd8ab610bc80371ecf69.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:33 [auto1.it] INFO: Channel: 24h | Page: 3 | totalHits: 3430 | hits on page: 40
2026-03-28 09:00:33 [auto1.it] INFO: Found listing with ID: PC10641
2026-03-28 09:00:33 [auto1.it] INFO: Found listing with ID: MH04778
2026-03-28 09:00:33 [auto1.it] INFO: Found listing with ID: HG07035
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG07035%27 HTTP/1.1" 200 None
2026-03-28 09:00:33 [auto1.it] INFO: Scrape type for HG07035: 1
2026-03-28 09:00:33 [auto1.it] INFO: Found listing with ID: RB57838
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB57838%27 HTTP/1.1" 200 None
2026-03-28 09:00:33 [auto1.it] INFO: Scrape type for RB57838: 1
2026-03-28 09:00:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c84050>
2026-03-28 09:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_6afd5793c4fb2a5b2b90341ffd2e200e.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_6afd5793c4fb2a5b2b90341ffd2e200e.jpg saved to cache
2026-03-28 09:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 215da4ae-ea25-5460-b688-baeacd31392c
2026-03-28 09:00:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cd6a50>
2026-03-28 09:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_7f319eb0ddb4162d0f295ebcd9f95d1b.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_7f319eb0ddb4162d0f295ebcd9f95d1b.jpg saved to cache
2026-03-28 09:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 215da4ae-ea25-5460-b688-baeacd31392c
2026-03-28 09:00:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cbec90>
2026-03-28 09:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3a%252Fd73aed2ab4e15a8dda82649bba9d1beb%252Fpa%252FGT62268_dc66fa5f45a4dd8ab610bc80371ecf69.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_dc66fa5f45a4dd8ab610bc80371ecf69.jpg saved to cache
2026-03-28 09:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 215da4ae-ea25-5460-b688-baeacd31392c
2026-03-28 09:00:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 215da4ae-ea25-5460-b688-baeacd31392c, skipping ID generation
2026-03-28 09:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 215da4ae-ea25-5460-b688-baeacd31392c with scrape type 1
2026-03-28 09:00:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 215da4ae-ea25-5460-b688-baeacd31392c sending to next pipeline
2026-03-28 09:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 215da4ae-ea25-5460-b688-baeacd31392c, identifier: GT62268
2026-03-28 09:00:33 [auto1.it] INFO: Found listing with ID: UW00940
2026-03-28 09:00:33 [auto1.it] INFO: Found listing with ID: CR16346
2026-03-28 09:00:33 [auto1.it] INFO: Found listing with ID: PD21393
2026-03-28 09:00:33 [auto1.it] INFO: Found listing with ID: AU50392
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU50392%27 HTTP/1.1" 200 None
2026-03-28 09:00:33 [auto1.it] INFO: Scrape type for AU50392: 1
2026-03-28 09:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 215da4ae-ea25-5460-b688-baeacd31392c with identifier: GT62268
2026-03-28 09:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 215da4ae-ea25-5460-b688-baeacd31392c with identifier: GT62268
2026-03-28 09:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 215da4ae-ea25-5460-b688-baeacd31392c with identifier: GT62268 to the API
2026-03-28 09:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_dc66fa5f45a4dd8ab610bc80371ecf69.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:44:44Z',
 'fuel_type': 'petrol',
 'id': '215da4ae-ea25-5460-b688-baeacd31392c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT62268',
 'listing': 'auction',
 'location': 'IT, Ardea (RM)',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 92908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2451164,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_0d40e163c9cc296e3646bc73092f582e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2352138,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_e6ee723163d66985622658fa41fcf3ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2247756,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_d2dab5236750dc9b568cd3e61ad81bff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1886168,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_c99a033cd70834bdffa403f1188cc3db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2199601,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_d3260c01eebde9cbf6c36fb252e9c9f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2224928,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_44a4242edecb9b7569fcc829c1b8e905.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2007789,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_dc66fa5f45a4dd8ab610bc80371ecf69.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2405480,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_7f319eb0ddb4162d0f295ebcd9f95d1b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2257424,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_a8f0e1aa0b68afb5802141e2be907b77.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215da4ae-ea25-5460-b688-baeacd31392c/215da4ae-ea25-5460-b688-baeacd31392c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1903485,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3a/d73aed2ab4e15a8dda82649bba9d1beb/pa/GT62268_6afd5793c4fb2a5b2b90341ffd2e200e.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500L 1.4 Cross',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2021}
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT62268%27 HTTP/1.1" 200 None
2026-03-28 09:00:34 [auto1.it] INFO: Saving data for GT62268: {'created_time': 1774688434.222088, 'last_price_update_time': 1774688434.222099, 'auction_closing_time': 1774885484.0}
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GT62268') HTTP/1.1" 204 0
2026-03-28 09:00:34 [auto1.it] INFO: Found listing with ID: XK62729
2026-03-28 09:00:34 [auto1.it] INFO: Found listing with ID: BD17279
2026-03-28 09:00:34 [auto1.it] INFO: Found listing with ID: VV69855
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV69855%27 HTTP/1.1" 200 None
2026-03-28 09:00:34 [auto1.it] INFO: Scrape type for VV69855: 1
2026-03-28 09:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG79014/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG33148/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:34 [auto1.it] INFO: Found listing with ID: WP22813
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP22813%27 HTTP/1.1" 200 None
2026-03-28 09:00:34 [auto1.it] INFO: Scrape type for WP22813: 1
2026-03-28 09:00:34 [auto1.it] INFO: Found listing with ID: PZ74443
2026-03-28 09:00:34 [auto1.it] INFO: Found listing with ID: DF91853
2026-03-28 09:00:34 [auto1.it] INFO: Found listing with ID: KA05234
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA05234%27 HTTP/1.1" 200 None
2026-03-28 09:00:34 [auto1.it] INFO: Scrape type for KA05234: 1
2026-03-28 09:00:34 [auto1.it] INFO: Found listing with ID: NA17081
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA17081%27 HTTP/1.1" 200 None
2026-03-28 09:00:34 [auto1.it] INFO: Scrape type for NA17081: 2
2026-03-28 09:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a6cd56f-c27f-56ed-ac38-0429846fcb07 with identifier: NA17081
2026-03-28 09:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a6cd56f-c27f-56ed-ac38-0429846fcb07 with scrape type 2
2026-03-28 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a6cd56f-c27f-56ed-ac38-0429846fcb07 with scrape type 2
2026-03-28 09:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7a6cd56f-c27f-56ed-ac38-0429846fcb07, identifier: NA17081
2026-03-28 09:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7a6cd56f-c27f-56ed-ac38-0429846fcb07 with identifier: NA17081
2026-03-28 09:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7a6cd56f-c27f-56ed-ac38-0429846fcb07 with identifier: NA17081
2026-03-28 09:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7a6cd56f-c27f-56ed-ac38-0429846fcb07 with identifier: NA17081 to the API
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:24:06Z',
 'fuel_type': 'diesel',
 'id': '7a6cd56f-c27f-56ed-ac38-0429846fcb07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA17081',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40 Cross Country',
 'odometer': 235670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-29',
 'seller_name': None,
 'title': 'Volvo V40 Cross Country 1.6 D2 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2014}
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA17081%27 HTTP/1.1" 200 None
2026-03-28 09:00:34 [auto1.it] INFO: Saving data for NA17081: {'auction_closing_time': 1774884246.0, 'created_time': 1773954602.019342, 'last_price_update_time': 1774688434.892699}
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NA17081') HTTP/1.1" 204 0
2026-03-28 09:00:34 [auto1.it] INFO: Found listing with ID: XL36522
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL36522%27 HTTP/1.1" 200 None
2026-03-28 09:00:34 [auto1.it] INFO: Scrape type for XL36522: 1
2026-03-28 09:00:34 [auto1.it] INFO: Found listing with ID: WJ93918
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ93918%27 HTTP/1.1" 200 None
2026-03-28 09:00:34 [auto1.it] INFO: Scrape type for WJ93918: 1
2026-03-28 09:00:34 [auto1.it] INFO: Found listing with ID: PW21371
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW21371%27 HTTP/1.1" 200 None
2026-03-28 09:00:34 [auto1.it] INFO: Scrape type for PW21371: 1
2026-03-28 09:00:34 [auto1.it] INFO: Found listing with ID: TR54078
2026-03-28 09:00:34 [auto1.it] INFO: Found listing with ID: LG70821
2026-03-28 09:00:34 [auto1.it] INFO: Found listing with ID: TL02972
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL02972%27 HTTP/1.1" 200 None
2026-03-28 09:00:34 [auto1.it] INFO: Scrape type for TL02972: 1
2026-03-28 09:00:34 [auto1.it] INFO: Found listing with ID: PD30072
2026-03-28 09:00:34 [auto1.it] INFO: Found listing with ID: PN93360
2026-03-28 09:00:34 [auto1.it] INFO: Found listing with ID: WH30921
2026-03-28 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH30921%27 HTTP/1.1" 200 None
2026-03-28 09:00:35 [auto1.it] INFO: Scrape type for WH30921: 1
2026-03-28 09:00:35 [auto1.it] INFO: Found listing with ID: WC55302
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC55302%27 HTTP/1.1" 200 None
2026-03-28 09:00:35 [auto1.it] INFO: Scrape type for WC55302: 0
2026-03-28 09:00:35 [auto1.it] INFO: Found listing with ID: GP46420
2026-03-28 09:00:35 [auto1.it] INFO: Found listing with ID: LD02725
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD02725%27 HTTP/1.1" 200 None
2026-03-28 09:00:35 [auto1.it] INFO: Scrape type for LD02725: 1
2026-03-28 09:00:35 [auto1.it] INFO: Found listing with ID: SB80667
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB80667%27 HTTP/1.1" 200 None
2026-03-28 09:00:35 [auto1.it] INFO: Scrape type for SB80667: 1
2026-03-28 09:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT57270/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS31843/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:35 [auto1.it] INFO: Found listing with ID: HW51602
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW51602%27 HTTP/1.1" 200 None
2026-03-28 09:00:35 [auto1.it] INFO: Scrape type for HW51602: 2
2026-03-28 09:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40a2c263-e989-5bc4-a2c9-e32a95466934 with identifier: HW51602
2026-03-28 09:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a2c263-e989-5bc4-a2c9-e32a95466934 with scrape type 2
2026-03-28 09:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40a2c263-e989-5bc4-a2c9-e32a95466934 with scrape type 2
2026-03-28 09:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 40a2c263-e989-5bc4-a2c9-e32a95466934, identifier: HW51602
2026-03-28 09:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 40a2c263-e989-5bc4-a2c9-e32a95466934 with identifier: HW51602
2026-03-28 09:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 40a2c263-e989-5bc4-a2c9-e32a95466934 with identifier: HW51602
2026-03-28 09:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 40a2c263-e989-5bc4-a2c9-e32a95466934 with identifier: HW51602 to the API
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:33:45Z',
 'fuel_type': 'petrol',
 'id': '40a2c263-e989-5bc4-a2c9-e32a95466934',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW51602',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206+',
 'odometer': 97190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-09',
 'seller_name': None,
 'title': 'Peugeot 206+ 1.1 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2010}
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW51602%27 HTTP/1.1" 200 None
2026-03-28 09:00:35 [auto1.it] INFO: Saving data for HW51602: {'auction_closing_time': 1774884825.0, 'created_time': 1773131449.60831, 'last_price_update_time': 1774688435.52383}
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HW51602') HTTP/1.1" 204 0
2026-03-28 09:00:35 [auto1.it] INFO: Found listing with ID: DX75497
2026-03-28 09:00:35 [auto1.it] INFO: Found listing with ID: KF97174
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF97174%27 HTTP/1.1" 200 None
2026-03-28 09:00:35 [auto1.it] INFO: Scrape type for KF97174: 2
2026-03-28 09:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 281d033e-4d3e-51ca-a99f-e830a319a8cc with identifier: KF97174
2026-03-28 09:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 281d033e-4d3e-51ca-a99f-e830a319a8cc with scrape type 2
2026-03-28 09:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 281d033e-4d3e-51ca-a99f-e830a319a8cc with scrape type 2
2026-03-28 09:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 281d033e-4d3e-51ca-a99f-e830a319a8cc, identifier: KF97174
2026-03-28 09:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 281d033e-4d3e-51ca-a99f-e830a319a8cc with identifier: KF97174
2026-03-28 09:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 281d033e-4d3e-51ca-a99f-e830a319a8cc with identifier: KF97174
2026-03-28 09:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 281d033e-4d3e-51ca-a99f-e830a319a8cc with identifier: KF97174 to the API
2026-03-28 09:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:38:34Z',
 'fuel_type': 'diesel',
 'id': '281d033e-4d3e-51ca-a99f-e830a319a8cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF97174',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 186459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-08',
 'seller_name': None,
 'title': 'Opel Corsa 1.5 CDTI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2019}
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF97174%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [auto1.it] INFO: Saving data for KF97174: {'auction_closing_time': 1774885114.0, 'created_time': 1773132931.747749, 'last_price_update_time': 1774688436.134163}
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KF97174') HTTP/1.1" 204 0
2026-03-28 09:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PL47981/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:36 [auto1.it] INFO: Found listing with ID: UT33269
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT33269%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [auto1.it] INFO: Scrape type for UT33269: 1
2026-03-28 09:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:36 [auto1.it] INFO: Found listing with ID: GJ33186
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ33186%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [auto1.it] INFO: Scrape type for GJ33186: 1
2026-03-28 09:00:36 [auto1.it] INFO: Found listing with ID: CJ50775
2026-03-28 09:00:36 [auto1.it] INFO: Found listing with ID: YB09690
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB09690%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [auto1.it] INFO: Scrape type for YB09690: 1
2026-03-28 09:00:36 [auto1.it] INFO: Found listing with ID: UC99700
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC99700%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [auto1.it] INFO: Scrape type for UC99700: 2
2026-03-28 09:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04649e58-e4e7-5901-8ebe-129b7367272c with identifier: UC99700
2026-03-28 09:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04649e58-e4e7-5901-8ebe-129b7367272c with scrape type 2
2026-03-28 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04649e58-e4e7-5901-8ebe-129b7367272c with scrape type 2
2026-03-28 09:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 04649e58-e4e7-5901-8ebe-129b7367272c, identifier: UC99700
2026-03-28 09:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 04649e58-e4e7-5901-8ebe-129b7367272c with identifier: UC99700
2026-03-28 09:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 04649e58-e4e7-5901-8ebe-129b7367272c with identifier: UC99700
2026-03-28 09:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 04649e58-e4e7-5901-8ebe-129b7367272c with identifier: UC99700 to the API
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:31:51Z',
 'fuel_type': 'diesel',
 'id': '04649e58-e4e7-5901-8ebe-129b7367272c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC99700',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 201343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-30',
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2009}
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC99700%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [auto1.it] INFO: Saving data for UC99700: {'auction_closing_time': 1774884711.0, 'created_time': 1773954771.982805, 'last_price_update_time': 1774688436.609499}
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UC99700') HTTP/1.1" 204 0
2026-03-28 09:00:36 [auto1.it] INFO: Found listing with ID: EG31110
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG31110%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [auto1.it] INFO: Scrape type for EG31110: 1
2026-03-28 09:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RB57838/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:36 [auto1.it] INFO: Found listing with ID: SK62476
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK62476%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [auto1.it] INFO: Scrape type for SK62476: 1
2026-03-28 09:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU87038> (referer: https://www.auto1.com/v1/car-details-view/ZU87038/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU50392/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD69176> (referer: https://www.auto1.com/v1/car-details-view/FD69176/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:36 [auto1.it] INFO: Found listing with ID: KR24813
2026-03-28 09:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1828b9e-02e9-519e-b209-ff64bf547566 with identifier: ZU87038
2026-03-28 09:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1828b9e-02e9-519e-b209-ff64bf547566 with scrape type 1
2026-03-28 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a1828b9e-02e9-519e-b209-ff64bf547566
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F7b%252F817b2d3f725286cfe5c1d0b8777b2bb0%252Fpa%252FZU87038_8e5353670ebf594eb3acbfd1a1872114.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_8e5353670ebf594eb3acbfd1a1872114.jpg not downloaded yet
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F7b%252F817b2d3f725286cfe5c1d0b8777b2bb0%252Fpa%252FZU87038_09f122d7b78b758f670d8664a71cc588.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_09f122d7b78b758f670d8664a71cc588.jpg not downloaded yet
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F7b%252F817b2d3f725286cfe5c1d0b8777b2bb0%252Fpa%252FZU87038_9435cb2f27f8a2f234a223578db648ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_9435cb2f27f8a2f234a223578db648ae.jpg not downloaded yet
2026-03-28 09:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 272a2abb-ea00-5227-86d6-27f128f3fc71 with identifier: FD69176
2026-03-28 09:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 272a2abb-ea00-5227-86d6-27f128f3fc71 with scrape type 1
2026-03-28 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 272a2abb-ea00-5227-86d6-27f128f3fc71
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_dc59c3886c151d54de40a5e325c17cdc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_dc59c3886c151d54de40a5e325c17cdc.jpg not downloaded yet
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F7b%252F817b2d3f725286cfe5c1d0b8777b2bb0%252Fpa%252FZU87038_f4665a75955a80322ff3887891e6f93e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_f4665a75955a80322ff3887891e6f93e.jpg not downloaded yet
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_72cbc59b709c1f6980e89a4bdca31296.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_72cbc59b709c1f6980e89a4bdca31296.jpg not downloaded yet
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F7b%252F817b2d3f725286cfe5c1d0b8777b2bb0%252Fpa%252FZU87038_b51c0e2860881b47fa756377c8b8e248.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_b51c0e2860881b47fa756377c8b8e248.jpg not downloaded yet
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_5e5feffbacae790f025705a63bb9c6bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_5e5feffbacae790f025705a63bb9c6bd.jpg not downloaded yet
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_3ee46cecd1d0d29af1db23df24f95b9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_3ee46cecd1d0d29af1db23df24f95b9e.jpg not downloaded yet
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_08c49b390c972e648a9b0bf1ada35642.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_08c49b390c972e648a9b0bf1ada35642.jpg not downloaded yet
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_e850e1c8bd8a36a602c142442f0cf471.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_e850e1c8bd8a36a602c142442f0cf471.jpg not downloaded yet
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_cf9b2088ed14dc010d264446b2c2321f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_cf9b2088ed14dc010d264446b2c2321f.jpg not downloaded yet
2026-03-28 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_ab2521d99b9a1451668644b14cd31d94.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_ab2521d99b9a1451668644b14cd31d94.jpg not downloaded yet
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_8529ba88f5d1e213c7b553b877b006f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_8529ba88f5d1e213c7b553b877b006f1.jpg not downloaded yet
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_aef8c987645b2006b0dcd05eef97d988.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_aef8c987645b2006b0dcd05eef97d988.jpg not downloaded yet
2026-03-28 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG82147/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_aef8c987645b2006b0dcd05eef97d988.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_8529ba88f5d1e213c7b553b877b006f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1c9159d0>
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_aef8c987645b2006b0dcd05eef97d988.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_aef8c987645b2006b0dcd05eef97d988.jpg saved to cache
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 272a2abb-ea00-5227-86d6-27f128f3fc71
2026-03-28 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HG07035/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a7fcf90>
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_8529ba88f5d1e213c7b553b877b006f1.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_8529ba88f5d1e213c7b553b877b006f1.jpg saved to cache
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 272a2abb-ea00-5227-86d6-27f128f3fc71
2026-03-28 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_ab2521d99b9a1451668644b14cd31d94.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6ce910>
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_ab2521d99b9a1451668644b14cd31d94.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_ab2521d99b9a1451668644b14cd31d94.jpg saved to cache
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 272a2abb-ea00-5227-86d6-27f128f3fc71
2026-03-28 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_cf9b2088ed14dc010d264446b2c2321f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY26414> (referer: https://www.auto1.com/v1/car-details-view/WY26414/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1c8583d0>
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_cf9b2088ed14dc010d264446b2c2321f.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_cf9b2088ed14dc010d264446b2c2321f.jpg saved to cache
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 272a2abb-ea00-5227-86d6-27f128f3fc71
2026-03-28 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KA05234/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_e850e1c8bd8a36a602c142442f0cf471.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c671b85-f866-5acd-8d39-772f2c4e4d58 with identifier: WY26414
2026-03-28 09:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c671b85-f866-5acd-8d39-772f2c4e4d58 with scrape type 1
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_434785d63e95b6abcca047e84b7a1972.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_434785d63e95b6abcca047e84b7a1972.jpg not downloaded yet
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_74675b61766b7963603e48846c55349e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_74675b61766b7963603e48846c55349e.jpg not downloaded yet
2026-03-28 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_08c49b390c972e648a9b0bf1ada35642.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_ddec2bacb879432ba7427bc6934e763f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_ddec2bacb879432ba7427bc6934e763f.jpg not downloaded yet
2026-03-28 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_3ee46cecd1d0d29af1db23df24f95b9e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_5e5feffbacae790f025705a63bb9c6bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_067799b861078ffd940af1a7743f9b2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_067799b861078ffd940af1a7743f9b2b.jpg not downloaded yet
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_e5d7256f3814c56e551512236205f30c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_e5d7256f3814c56e551512236205f30c.jpg not downloaded yet
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a68b810>
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_e850e1c8bd8a36a602c142442f0cf471.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_e850e1c8bd8a36a602c142442f0cf471.jpg saved to cache
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 272a2abb-ea00-5227-86d6-27f128f3fc71
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_c8a1917cc0bdc82378f6d7420e4a6e7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_c8a1917cc0bdc82378f6d7420e4a6e7a.jpg not downloaded yet
2026-03-28 09:00:37 [auto1.it] INFO: Channel: 24h | Page: 4 | totalHits: 3430 | hits on page: 40
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_12e0ea780bdb80bb12f76fe3b0ece8a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_12e0ea780bdb80bb12f76fe3b0ece8a3.jpg not downloaded yet
2026-03-28 09:00:37 [auto1.it] INFO: Found listing with ID: WL53741
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL53741%27 HTTP/1.1" 200 None
2026-03-28 09:00:38 [auto1.it] INFO: Scrape type for WL53741: 1
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_1fa8bb3fedd56fe4fab1962b33dcc680.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_1fa8bb3fedd56fe4fab1962b33dcc680.jpg not downloaded yet
2026-03-28 09:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c15990>
2026-03-28 09:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_08c49b390c972e648a9b0bf1ada35642.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_08c49b390c972e648a9b0bf1ada35642.jpg saved to cache
2026-03-28 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 272a2abb-ea00-5227-86d6-27f128f3fc71
2026-03-28 09:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19dea350>
2026-03-28 09:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_3ee46cecd1d0d29af1db23df24f95b9e.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_3ee46cecd1d0d29af1db23df24f95b9e.jpg saved to cache
2026-03-28 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 272a2abb-ea00-5227-86d6-27f128f3fc71
2026-03-28 09:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19daa410>
2026-03-28 09:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_5e5feffbacae790f025705a63bb9c6bd.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_5e5feffbacae790f025705a63bb9c6bd.jpg saved to cache
2026-03-28 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 272a2abb-ea00-5227-86d6-27f128f3fc71
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: KK99486
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: XW14976
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: CV32353
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: RB84694
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB84694%27 HTTP/1.1" 200 None
2026-03-28 09:00:38 [auto1.it] INFO: Scrape type for RB84694: 2
2026-03-28 09:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c7a7acf-98b8-543a-bafa-a4d168e82eb0 with identifier: RB84694
2026-03-28 09:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c7a7acf-98b8-543a-bafa-a4d168e82eb0 with scrape type 2
2026-03-28 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c7a7acf-98b8-543a-bafa-a4d168e82eb0 with scrape type 2
2026-03-28 09:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8c7a7acf-98b8-543a-bafa-a4d168e82eb0, identifier: RB84694
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_c9d7aac908d7711e5a9b130540c5cdf4.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_c9d7aac908d7711e5a9b130540c5cdf4.jpg not downloaded yet
2026-03-28 09:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8c7a7acf-98b8-543a-bafa-a4d168e82eb0 with identifier: RB84694
2026-03-28 09:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8c7a7acf-98b8-543a-bafa-a4d168e82eb0 with identifier: RB84694
2026-03-28 09:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8c7a7acf-98b8-543a-bafa-a4d168e82eb0 with identifier: RB84694 to the API
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:32:34Z',
 'fuel_type': 'petrol',
 'id': '8c7a7acf-98b8-543a-bafa-a4d168e82eb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB84694',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 51772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2022}
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB84694%27 HTTP/1.1" 200 None
2026-03-28 09:00:38 [auto1.it] INFO: Saving data for RB84694: {'auction_closing_time': 1774884754.0, 'created_time': 1773954599.135732, 'last_price_update_time': 1774688438.647239}
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RB84694') HTTP/1.1" 204 0
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: YE49798
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: DJ31826
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ31826%27 HTTP/1.1" 200 None
2026-03-28 09:00:38 [auto1.it] INFO: Scrape type for DJ31826: 1
2026-03-28 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG33148> (referer: https://www.auto1.com/v1/car-details-view/ZG33148/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_7e021cab6c2ac7635ed477b3e7e638a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_7e021cab6c2ac7635ed477b3e7e638a2.jpg not downloaded yet
2026-03-28 09:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP22813/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: UL30423
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: MT45417
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT45417%27 HTTP/1.1" 200 None
2026-03-28 09:00:38 [auto1.it] INFO: Scrape type for MT45417: 1
2026-03-28 09:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB80667/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LD02725/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: FV07755
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV07755%27 HTTP/1.1" 200 None
2026-03-28 09:00:38 [auto1.it] INFO: Scrape type for FV07755: 1
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: SW75734
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: HJ71706
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ71706%27 HTTP/1.1" 200 None
2026-03-28 09:00:38 [auto1.it] INFO: Scrape type for HJ71706: 0
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: XV92434
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV92434%27 HTTP/1.1" 200 None
2026-03-28 09:00:38 [auto1.it] INFO: Scrape type for XV92434: 0
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: UK64691
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: ZY56429
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY56429%27 HTTP/1.1" 200 None
2026-03-28 09:00:38 [auto1.it] INFO: Scrape type for ZY56429: 0
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: AN61279
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: LT86375
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: TP07930
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP07930%27 HTTP/1.1" 200 None
2026-03-28 09:00:38 [auto1.it] INFO: Scrape type for TP07930: 0
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: TY62021
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: EH51725
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: HC48656
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC48656%27 HTTP/1.1" 200 None
2026-03-28 09:00:38 [auto1.it] INFO: Scrape type for HC48656: 0
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: NL55256
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: FG90237
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG90237%27 HTTP/1.1" 200 None
2026-03-28 09:00:38 [auto1.it] INFO: Scrape type for FG90237: 0
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: YH23554
2026-03-28 09:00:38 [auto1.it] INFO: Found listing with ID: NK99622
2026-03-28 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK99622%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [auto1.it] INFO: Scrape type for NK99622: 0
2026-03-28 09:00:39 [auto1.it] INFO: Found listing with ID: JF19899
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF19899%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [auto1.it] INFO: Scrape type for JF19899: 0
2026-03-28 09:00:39 [auto1.it] INFO: Found listing with ID: YN45355
2026-03-28 09:00:39 [auto1.it] INFO: Found listing with ID: GK54745
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK54745%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [auto1.it] INFO: Scrape type for GK54745: 0
2026-03-28 09:00:39 [auto1.it] INFO: Found listing with ID: SR88948
2026-03-28 09:00:39 [auto1.it] INFO: Found listing with ID: NR71125
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR71125%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [auto1.it] INFO: Scrape type for NR71125: 0
2026-03-28 09:00:39 [auto1.it] INFO: Found listing with ID: NS64988
2026-03-28 09:00:39 [auto1.it] INFO: Found listing with ID: HT01283
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT01283%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [auto1.it] INFO: Scrape type for HT01283: 0
2026-03-28 09:00:39 [auto1.it] INFO: Found listing with ID: HV13929
2026-03-28 09:00:39 [auto1.it] INFO: Found listing with ID: GV28161
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV28161%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [auto1.it] INFO: Scrape type for GV28161: 2
2026-03-28 09:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 287d6382-14a2-5bab-9f33-8b8f9032f653 with identifier: GV28161
2026-03-28 09:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 287d6382-14a2-5bab-9f33-8b8f9032f653 with scrape type 2
2026-03-28 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 287d6382-14a2-5bab-9f33-8b8f9032f653 with scrape type 2
2026-03-28 09:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 287d6382-14a2-5bab-9f33-8b8f9032f653, identifier: GV28161
2026-03-28 09:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 287d6382-14a2-5bab-9f33-8b8f9032f653 with identifier: GV28161
2026-03-28 09:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 287d6382-14a2-5bab-9f33-8b8f9032f653 with identifier: GV28161
2026-03-28 09:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 287d6382-14a2-5bab-9f33-8b8f9032f653 with identifier: GV28161 to the API
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:46:11Z',
 'fuel_type': 'diesel',
 'id': '287d6382-14a2-5bab-9f33-8b8f9032f653',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV28161',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 201604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-30',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Premium',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Premium',
 'year': 2017}
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV28161%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [auto1.it] INFO: Saving data for GV28161: {'auction_closing_time': 1774716371.0, 'created_time': 1773824487.576457, 'last_price_update_time': 1774688439.541156}
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GV28161') HTTP/1.1" 204 0
2026-03-28 09:00:39 [auto1.it] INFO: Found listing with ID: AE80998
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE80998%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [auto1.it] INFO: Scrape type for AE80998: 0
2026-03-28 09:00:39 [auto1.it] INFO: Found listing with ID: PD66788
2026-03-28 09:00:39 [auto1.it] INFO: Found listing with ID: EY62849
2026-03-28 09:00:39 [auto1.it] INFO: Found listing with ID: LB25951
2026-03-28 09:00:39 [auto1.it] INFO: Found listing with ID: MJ44765
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ44765%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [auto1.it] INFO: Scrape type for MJ44765: 0
2026-03-28 09:00:39 [auto1.it] INFO: Found listing with ID: TM47514
2026-03-28 09:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_c9d7aac908d7711e5a9b130540c5cdf4.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV69855/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f06a38f-00e0-537d-8b5c-91f81f010173 with identifier: ZG33148
2026-03-28 09:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f06a38f-00e0-537d-8b5c-91f81f010173 with scrape type 1
2026-03-28 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f06a38f-00e0-537d-8b5c-91f81f010173
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_4c59a6ffdd97bc289adca2b95a1f641b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_4c59a6ffdd97bc289adca2b95a1f641b.jpg not downloaded yet
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_f8164706d4fb8f68214be58669461006.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_f8164706d4fb8f68214be58669461006.jpg not downloaded yet
2026-03-28 09:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PL47981> (referer: https://www.auto1.com/v1/car-details-view/PL47981/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_8d859e6f92fd362d91000aae2c838a7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_8d859e6f92fd362d91000aae2c838a7f.jpg not downloaded yet
2026-03-28 09:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_f1cabc0ce39aaa6488553ceeccd472a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_f1cabc0ce39aaa6488553ceeccd472a0.jpg not downloaded yet
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_25920878e737790cae905aa0918c3c36.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_25920878e737790cae905aa0918c3c36.jpg not downloaded yet
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_8d8ce44e8fe97f9e4c62ea227d22c36e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_8d8ce44e8fe97f9e4c62ea227d22c36e.jpg not downloaded yet
2026-03-28 09:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cc1850>
2026-03-28 09:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_c9d7aac908d7711e5a9b130540c5cdf4.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_c9d7aac908d7711e5a9b130540c5cdf4.jpg saved to cache
2026-03-28 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_466b79042746af898a20b78e9c8aa0fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_466b79042746af898a20b78e9c8aa0fe.jpg not downloaded yet
2026-03-28 09:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_f8164706d4fb8f68214be58669461006.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_5f257680b71cd542476fc15bce59ca40.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_5f257680b71cd542476fc15bce59ca40.jpg not downloaded yet
2026-03-28 09:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_ddec2bacb879432ba7427bc6934e763f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_74675b61766b7963603e48846c55349e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_796a869420a109b5f184dc9807cc28c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_796a869420a109b5f184dc9807cc28c5.jpg not downloaded yet
2026-03-28 09:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b10f1009-142e-5ef2-a38b-d15c49bfd732 with identifier: PL47981
2026-03-28 09:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b10f1009-142e-5ef2-a38b-d15c49bfd732 with scrape type 1
2026-03-28 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b10f1009-142e-5ef2-a38b-d15c49bfd732
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fe3%252F78e32f5f05a9a7a1fdce3943c716fb71%252Fpa%252FPL47981_9c1c7a96bc2a1ef3925ca7434dc05717.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_9c1c7a96bc2a1ef3925ca7434dc05717.jpg not downloaded yet
2026-03-28 09:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_434785d63e95b6abcca047e84b7a1972.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_a557728d9ebe6cc2ac842279c975fb21.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_a557728d9ebe6cc2ac842279c975fb21.jpg not downloaded yet
2026-03-28 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fe3%252F78e32f5f05a9a7a1fdce3943c716fb71%252Fpa%252FPL47981_037a20fb0c5bae6bd2d0245475fa094f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_037a20fb0c5bae6bd2d0245475fa094f.jpg not downloaded yet
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fe3%252F78e32f5f05a9a7a1fdce3943c716fb71%252Fpa%252FPL47981_276543795c0196b07ea5d2c6e3318123.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_276543795c0196b07ea5d2c6e3318123.jpg not downloaded yet
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c62110>
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_f8164706d4fb8f68214be58669461006.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_f8164706d4fb8f68214be58669461006.jpg saved to cache
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f06a38f-00e0-537d-8b5c-91f81f010173
2026-03-28 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_5f257680b71cd542476fc15bce59ca40.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fe3%252F78e32f5f05a9a7a1fdce3943c716fb71%252Fpa%252FPL47981_32215e74fb933b94650127736c1d1bc6.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_32215e74fb933b94650127736c1d1bc6.jpg not downloaded yet
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fe3%252F78e32f5f05a9a7a1fdce3943c716fb71%252Fpa%252FPL47981_52b5a50f4abf02a6658e17a391604b17.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_52b5a50f4abf02a6658e17a391604b17.jpg not downloaded yet
2026-03-28 09:00:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a795b90>
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_ddec2bacb879432ba7427bc6934e763f.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_ddec2bacb879432ba7427bc6934e763f.jpg saved to cache
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-03-28 09:00:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6fe290>
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_74675b61766b7963603e48846c55349e.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_74675b61766b7963603e48846c55349e.jpg saved to cache
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-03-28 09:00:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b233d0>
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_434785d63e95b6abcca047e84b7a1972.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_434785d63e95b6abcca047e84b7a1972.jpg saved to cache
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-03-28 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_466b79042746af898a20b78e9c8aa0fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6cca90>
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_5f257680b71cd542476fc15bce59ca40.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_5f257680b71cd542476fc15bce59ca40.jpg saved to cache
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f06a38f-00e0-537d-8b5c-91f81f010173
2026-03-28 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_7e021cab6c2ac7635ed477b3e7e638a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_1fa8bb3fedd56fe4fab1962b33dcc680.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG31110/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c36250>
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_466b79042746af898a20b78e9c8aa0fe.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_466b79042746af898a20b78e9c8aa0fe.jpg saved to cache
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f06a38f-00e0-537d-8b5c-91f81f010173
2026-03-28 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_9c1c7a96bc2a1ef3925ca7434dc05717.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_a557728d9ebe6cc2ac842279c975fb21.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_037a20fb0c5bae6bd2d0245475fa094f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cbaa50>
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_7e021cab6c2ac7635ed477b3e7e638a2.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_7e021cab6c2ac7635ed477b3e7e638a2.jpg saved to cache
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-03-28 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_32215e74fb933b94650127736c1d1bc6.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_52b5a50f4abf02a6658e17a391604b17.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_8d8ce44e8fe97f9e4c62ea227d22c36e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_796a869420a109b5f184dc9807cc28c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG82147> (referer: https://www.auto1.com/v1/car-details-view/AG82147/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB09690/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b3d4d0>
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_1fa8bb3fedd56fe4fab1962b33dcc680.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_1fa8bb3fedd56fe4fab1962b33dcc680.jpg saved to cache
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19d2a350>
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f1009-142e-5ef2-a38b-d15c49bfd732/b10f1009-142e-5ef2-a38b-d15c49bfd732_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fe3%252F78e32f5f05a9a7a1fdce3943c716fb71%252Fpa%252FPL47981_9c1c7a96bc2a1ef3925ca7434dc05717.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_9c1c7a96bc2a1ef3925ca7434dc05717.jpg saved to cache
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b10f1009-142e-5ef2-a38b-d15c49bfd732
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b3ad50>
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_a557728d9ebe6cc2ac842279c975fb21.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_a557728d9ebe6cc2ac842279c975fb21.jpg saved to cache
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f06a38f-00e0-537d-8b5c-91f81f010173
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a688290>
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f1009-142e-5ef2-a38b-d15c49bfd732/b10f1009-142e-5ef2-a38b-d15c49bfd732_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fe3%252F78e32f5f05a9a7a1fdce3943c716fb71%252Fpa%252FPL47981_037a20fb0c5bae6bd2d0245475fa094f.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_037a20fb0c5bae6bd2d0245475fa094f.jpg saved to cache
2026-03-28 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b10f1009-142e-5ef2-a38b-d15c49bfd732
2026-03-28 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_276543795c0196b07ea5d2c6e3318123.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_25920878e737790cae905aa0918c3c36.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GJ33186/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ31826/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b3add0>
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f1009-142e-5ef2-a38b-d15c49bfd732/b10f1009-142e-5ef2-a38b-d15c49bfd732_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fe3%252F78e32f5f05a9a7a1fdce3943c716fb71%252Fpa%252FPL47981_32215e74fb933b94650127736c1d1bc6.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_32215e74fb933b94650127736c1d1bc6.jpg saved to cache
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b10f1009-142e-5ef2-a38b-d15c49bfd732
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cd35d0>
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f1009-142e-5ef2-a38b-d15c49bfd732/b10f1009-142e-5ef2-a38b-d15c49bfd732_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fe3%252F78e32f5f05a9a7a1fdce3943c716fb71%252Fpa%252FPL47981_52b5a50f4abf02a6658e17a391604b17.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_52b5a50f4abf02a6658e17a391604b17.jpg saved to cache
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b10f1009-142e-5ef2-a38b-d15c49bfd732
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c36050>
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_8d8ce44e8fe97f9e4c62ea227d22c36e.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_8d8ce44e8fe97f9e4c62ea227d22c36e.jpg saved to cache
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f06a38f-00e0-537d-8b5c-91f81f010173
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a7c7310>
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_796a869420a109b5f184dc9807cc28c5.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_796a869420a109b5f184dc9807cc28c5.jpg saved to cache
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f06a38f-00e0-537d-8b5c-91f81f010173
2026-03-28 09:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df2e52db-61dc-5a76-9435-08d746d02bef with identifier: AG82147
2026-03-28 09:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df2e52db-61dc-5a76-9435-08d746d02bef with scrape type 1
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item df2e52db-61dc-5a76-9435-08d746d02bef
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F17%252F06171d8cb3f743305f07cb856a6eaadb%252Fpa%252FAG82147_c88f308dee5133ea9686efaf1bbb4f2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_c88f308dee5133ea9686efaf1bbb4f2b.jpg not downloaded yet
2026-03-28 09:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_8d859e6f92fd362d91000aae2c838a7f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HG07035> (referer: https://www.auto1.com/v1/car-details-view/HG07035/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_f1cabc0ce39aaa6488553ceeccd472a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F17%252F06171d8cb3f743305f07cb856a6eaadb%252Fpa%252FAG82147_309ba8e37ba6cc0a4e8d5b634eead64d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_309ba8e37ba6cc0a4e8d5b634eead64d.jpg not downloaded yet
2026-03-28 09:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_4c59a6ffdd97bc289adca2b95a1f641b.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F17%252F06171d8cb3f743305f07cb856a6eaadb%252Fpa%252FAG82147_648e9fbad74f3bbd28e3029db5b1b486.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_648e9fbad74f3bbd28e3029db5b1b486.jpg not downloaded yet
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c9fc10>
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f1009-142e-5ef2-a38b-d15c49bfd732/b10f1009-142e-5ef2-a38b-d15c49bfd732_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fe3%252F78e32f5f05a9a7a1fdce3943c716fb71%252Fpa%252FPL47981_276543795c0196b07ea5d2c6e3318123.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_276543795c0196b07ea5d2c6e3318123.jpg saved to cache
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b10f1009-142e-5ef2-a38b-d15c49bfd732
2026-03-28 09:00:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b10f1009-142e-5ef2-a38b-d15c49bfd732, skipping ID generation
2026-03-28 09:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b10f1009-142e-5ef2-a38b-d15c49bfd732 with scrape type 1
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b10f1009-142e-5ef2-a38b-d15c49bfd732 sending to next pipeline
2026-03-28 09:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b10f1009-142e-5ef2-a38b-d15c49bfd732, identifier: PL47981
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1b458810>
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_25920878e737790cae905aa0918c3c36.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_25920878e737790cae905aa0918c3c36.jpg saved to cache
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f06a38f-00e0-537d-8b5c-91f81f010173
2026-03-28 09:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b10f1009-142e-5ef2-a38b-d15c49bfd732 with identifier: PL47981
2026-03-28 09:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b10f1009-142e-5ef2-a38b-d15c49bfd732 with identifier: PL47981
2026-03-28 09:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b10f1009-142e-5ef2-a38b-d15c49bfd732 with identifier: PL47981 to the API
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_276543795c0196b07ea5d2c6e3318123.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:04:32Z',
 'fuel_type': 'diesel',
 'id': 'b10f1009-142e-5ef2-a38b-d15c49bfd732',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL47981',
 'listing': 'auction',
 'location': 'IT, Desenzano del Garda',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 331683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f1009-142e-5ef2-a38b-d15c49bfd732/b10f1009-142e-5ef2-a38b-d15c49bfd732_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_9c1c7a96bc2a1ef3925ca7434dc05717.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f1009-142e-5ef2-a38b-d15c49bfd732/b10f1009-142e-5ef2-a38b-d15c49bfd732_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_037a20fb0c5bae6bd2d0245475fa094f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f1009-142e-5ef2-a38b-d15c49bfd732/b10f1009-142e-5ef2-a38b-d15c49bfd732_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_276543795c0196b07ea5d2c6e3318123.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f1009-142e-5ef2-a38b-d15c49bfd732/b10f1009-142e-5ef2-a38b-d15c49bfd732_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_32215e74fb933b94650127736c1d1bc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f1009-142e-5ef2-a38b-d15c49bfd732/b10f1009-142e-5ef2-a38b-d15c49bfd732_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/e3/78e32f5f05a9a7a1fdce3943c716fb71/pa/PL47981_52b5a50f4abf02a6658e17a391604b17.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2003}
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL47981%27 HTTP/1.1" 200 None
2026-03-28 09:00:41 [auto1.it] INFO: Saving data for PL47981: {'created_time': 1774688441.927889, 'last_price_update_time': 1774688441.927903, 'auction_closing_time': 1774883072.0}
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PL47981') HTTP/1.1" 204 0
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F17%252F06171d8cb3f743305f07cb856a6eaadb%252Fpa%252FAG82147_baf8727c0d811603040f676fc6f1f096.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_baf8727c0d811603040f676fc6f1f096.jpg not downloaded yet
2026-03-28 09:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_c88f308dee5133ea9686efaf1bbb4f2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WH30921/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c46610>
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_8d859e6f92fd362d91000aae2c838a7f.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_8d859e6f92fd362d91000aae2c838a7f.jpg saved to cache
2026-03-28 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f06a38f-00e0-537d-8b5c-91f81f010173
2026-03-28 09:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f063555-c039-5a3b-af5d-128cb95a9954 with identifier: HG07035
2026-03-28 09:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f063555-c039-5a3b-af5d-128cb95a9954 with scrape type 1
2026-03-28 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8f063555-c039-5a3b-af5d-128cb95a9954
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2e%252F722e6e33e0a9aaa5b172cfbf7a046fdc%252Fpa%252FHG07035_cd95c064756711e5f70461945563d100.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_cd95c064756711e5f70461945563d100.jpg not downloaded yet
2026-03-28 09:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19dd35d0>
2026-03-28 09:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_f1cabc0ce39aaa6488553ceeccd472a0.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_f1cabc0ce39aaa6488553ceeccd472a0.jpg saved to cache
2026-03-28 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f06a38f-00e0-537d-8b5c-91f81f010173
2026-03-28 09:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b56790>
2026-03-28 09:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F94%252F349493f501a098f5737e1c6913116b8a%252Fpa%252FZG33148_4c59a6ffdd97bc289adca2b95a1f641b.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_4c59a6ffdd97bc289adca2b95a1f641b.jpg saved to cache
2026-03-28 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f06a38f-00e0-537d-8b5c-91f81f010173
2026-03-28 09:00:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f06a38f-00e0-537d-8b5c-91f81f010173, skipping ID generation
2026-03-28 09:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f06a38f-00e0-537d-8b5c-91f81f010173 with scrape type 1
2026-03-28 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f06a38f-00e0-537d-8b5c-91f81f010173 sending to next pipeline
2026-03-28 09:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9f06a38f-00e0-537d-8b5c-91f81f010173, identifier: ZG33148
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F17%252F06171d8cb3f743305f07cb856a6eaadb%252Fpa%252FAG82147_5d83dd28622cf999bed76c69b51dd6f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_5d83dd28622cf999bed76c69b51dd6f4.jpg not downloaded yet
2026-03-28 09:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9f06a38f-00e0-537d-8b5c-91f81f010173 with identifier: ZG33148
2026-03-28 09:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9f06a38f-00e0-537d-8b5c-91f81f010173 with identifier: ZG33148
2026-03-28 09:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9f06a38f-00e0-537d-8b5c-91f81f010173 with identifier: ZG33148 to the API
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_4c59a6ffdd97bc289adca2b95a1f641b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:44:50Z',
 'fuel_type': 'petrol',
 'id': '9f06a38f-00e0-537d-8b5c-91f81f010173',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG33148',
 'listing': 'auction',
 'location': 'IT, Bologna',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 113114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_4c59a6ffdd97bc289adca2b95a1f641b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_f8164706d4fb8f68214be58669461006.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_8d859e6f92fd362d91000aae2c838a7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_f1cabc0ce39aaa6488553ceeccd472a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_25920878e737790cae905aa0918c3c36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_8d8ce44e8fe97f9e4c62ea227d22c36e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_466b79042746af898a20b78e9c8aa0fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_5f257680b71cd542476fc15bce59ca40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_796a869420a109b5f184dc9807cc28c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f06a38f-00e0-537d-8b5c-91f81f010173/9f06a38f-00e0-537d-8b5c-91f81f010173_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/94/349493f501a098f5737e1c6913116b8a/pa/ZG33148_a557728d9ebe6cc2ac842279c975fb21.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive pulse',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive pulse',
 'year': 2013}
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG33148%27 HTTP/1.1" 200 None
2026-03-28 09:00:42 [auto1.it] INFO: Saving data for ZG33148: {'created_time': 1774688442.613058, 'last_price_update_time': 1774688442.613069, 'auction_closing_time': 1774885490.0}
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZG33148') HTTP/1.1" 204 0
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2e%252F722e6e33e0a9aaa5b172cfbf7a046fdc%252Fpa%252FHG07035_0a5a6b21bbd7ee97e0143bbaff92d446.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_0a5a6b21bbd7ee97e0143bbaff92d446.jpg not downloaded yet
2026-03-28 09:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6a26d0>
2026-03-28 09:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F17%252F06171d8cb3f743305f07cb856a6eaadb%252Fpa%252FAG82147_c88f308dee5133ea9686efaf1bbb4f2b.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_c88f308dee5133ea9686efaf1bbb4f2b.jpg saved to cache
2026-03-28 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df2e52db-61dc-5a76-9435-08d746d02bef
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2e%252F722e6e33e0a9aaa5b172cfbf7a046fdc%252Fpa%252FHG07035_90010a4229302db4989b450d0ff324f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_90010a4229302db4989b450d0ff324f2.jpg not downloaded yet
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2e%252F722e6e33e0a9aaa5b172cfbf7a046fdc%252Fpa%252FHG07035_9f9f37bed9b64274f078205476ce0b1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_9f9f37bed9b64274f078205476ce0b1e.jpg not downloaded yet
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2e%252F722e6e33e0a9aaa5b172cfbf7a046fdc%252Fpa%252FHG07035_fddbc8bdb11a1edc87c039b46e46be83.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_fddbc8bdb11a1edc87c039b46e46be83.jpg not downloaded yet
2026-03-28 09:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_12e0ea780bdb80bb12f76fe3b0ece8a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_c8a1917cc0bdc82378f6d7420e4a6e7a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_e5d7256f3814c56e551512236205f30c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_9f9f37bed9b64274f078205476ce0b1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MT45417/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_fddbc8bdb11a1edc87c039b46e46be83.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV69855> (referer: https://www.auto1.com/v1/car-details-view/VV69855/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_baf8727c0d811603040f676fc6f1f096.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cc8990>
2026-03-28 09:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_12e0ea780bdb80bb12f76fe3b0ece8a3.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_12e0ea780bdb80bb12f76fe3b0ece8a3.jpg saved to cache
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-03-28 09:00:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cbad10>
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_c8a1917cc0bdc82378f6d7420e4a6e7a.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_c8a1917cc0bdc82378f6d7420e4a6e7a.jpg saved to cache
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-03-28 09:00:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c97450>
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_e5d7256f3814c56e551512236205f30c.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_e5d7256f3814c56e551512236205f30c.jpg saved to cache
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c465d0>
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f063555-c039-5a3b-af5d-128cb95a9954/8f063555-c039-5a3b-af5d-128cb95a9954_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2e%252F722e6e33e0a9aaa5b172cfbf7a046fdc%252Fpa%252FHG07035_9f9f37bed9b64274f078205476ce0b1e.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_9f9f37bed9b64274f078205476ce0b1e.jpg saved to cache
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f063555-c039-5a3b-af5d-128cb95a9954
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1c91fe10>
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f063555-c039-5a3b-af5d-128cb95a9954/8f063555-c039-5a3b-af5d-128cb95a9954_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2e%252F722e6e33e0a9aaa5b172cfbf7a046fdc%252Fpa%252FHG07035_fddbc8bdb11a1edc87c039b46e46be83.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_fddbc8bdb11a1edc87c039b46e46be83.jpg saved to cache
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f063555-c039-5a3b-af5d-128cb95a9954
2026-03-28 09:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 736efd31-a741-58bc-ba47-075110b051d8 with identifier: VV69855
2026-03-28 09:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 736efd31-a741-58bc-ba47-075110b051d8 with scrape type 1
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 736efd31-a741-58bc-ba47-075110b051d8
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_bce220cdf8faeeafd22a32bd2d7998f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_bce220cdf8faeeafd22a32bd2d7998f0.jpg not downloaded yet
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c4b5d0>
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F17%252F06171d8cb3f743305f07cb856a6eaadb%252Fpa%252FAG82147_baf8727c0d811603040f676fc6f1f096.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_baf8727c0d811603040f676fc6f1f096.jpg saved to cache
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df2e52db-61dc-5a76-9435-08d746d02bef
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_8096d4bee469e42e5f147a19bfc51170.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_8096d4bee469e42e5f147a19bfc51170.jpg not downloaded yet
2026-03-28 09:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB80667> (referer: https://www.auto1.com/v1/car-details-view/SB80667/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_7847ed21c1a2c710b3fd85f2e21ffe20.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_7847ed21c1a2c710b3fd85f2e21ffe20.jpg not downloaded yet
2026-03-28 09:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP22813> (referer: https://www.auto1.com/v1/car-details-view/WP22813/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_e3de91e16028db0e8d3c82a2f61bb432.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_e3de91e16028db0e8d3c82a2f61bb432.jpg not downloaded yet
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_e9091a446f964009b0c31a18b7200b92.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_e9091a446f964009b0c31a18b7200b92.jpg not downloaded yet
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_2d350aaeb5cb62e2c221f9be36ec6514.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_2d350aaeb5cb62e2c221f9be36ec6514.jpg not downloaded yet
2026-03-28 09:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_0a5a6b21bbd7ee97e0143bbaff92d446.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_90010a4229302db4989b450d0ff324f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_cd95c064756711e5f70461945563d100.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_3382cbcbc9eb7e0aa1f1ac62b95b35c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_3382cbcbc9eb7e0aa1f1ac62b95b35c3.jpg not downloaded yet
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_2fdf2edb228f081f140776c4f8ee2808.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_2fdf2edb228f081f140776c4f8ee2808.jpg not downloaded yet
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_13843b4a445e6744fa8bf9e61cd9f39d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_13843b4a445e6744fa8bf9e61cd9f39d.jpg not downloaded yet
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_59f60eedf61c9a7ec514c7604ec9f867.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_59f60eedf61c9a7ec514c7604ec9f867.jpg not downloaded yet
2026-03-28 09:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88e63003-a893-577a-aebd-a60df651d726 with identifier: SB80667
2026-03-28 09:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88e63003-a893-577a-aebd-a60df651d726 with scrape type 1
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 88e63003-a893-577a-aebd-a60df651d726
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ff0%252F02f051c9a4ccaa83be654ad39ae43139%252Fpa%252FSB80667_b4b230e3c1a4c01274b8b945cd28f258.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_b4b230e3c1a4c01274b8b945cd28f258.jpg not downloaded yet
2026-03-28 09:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LD02725> (referer: https://www.auto1.com/v1/car-details-view/LD02725/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_5d83dd28622cf999bed76c69b51dd6f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ff0%252F02f051c9a4ccaa83be654ad39ae43139%252Fpa%252FSB80667_3f5a0450b864b30fb579e92276e5b43b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_3f5a0450b864b30fb579e92276e5b43b.jpg not downloaded yet
2026-03-28 09:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73204430-20b8-5743-81ef-4bebb2f6f628 with identifier: WP22813
2026-03-28 09:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73204430-20b8-5743-81ef-4bebb2f6f628 with scrape type 1
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73204430-20b8-5743-81ef-4bebb2f6f628
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc5%252Fdbc57a65fd58f28406e791572bcbd6a2%252Fpa%252FWP22813_d366db74ca3e253e59a4442bccaa1055.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_d366db74ca3e253e59a4442bccaa1055.jpg already downloaded
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc5%252Fdbc57a65fd58f28406e791572bcbd6a2%252Fpa%252FWP22813_3dc53579b73d50ad76b2b3811d4ae02e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_3dc53579b73d50ad76b2b3811d4ae02e.jpg already downloaded
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc5%252Fdbc57a65fd58f28406e791572bcbd6a2%252Fpa%252FWP22813_07cd11f945008158d78e3d1fb0c7010d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_07cd11f945008158d78e3d1fb0c7010d.jpg already downloaded
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc5%252Fdbc57a65fd58f28406e791572bcbd6a2%252Fpa%252FWP22813_4fb74cf0fa411545d80559e96ab36fec.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_4fb74cf0fa411545d80559e96ab36fec.jpg already downloaded
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc5%252Fdbc57a65fd58f28406e791572bcbd6a2%252Fpa%252FWP22813_1b5d3ec7e5c054804ae83097ff259444.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_1b5d3ec7e5c054804ae83097ff259444.jpg already downloaded
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc5%252Fdbc57a65fd58f28406e791572bcbd6a2%252Fpa%252FWP22813_bab79ae77aeb427cb831b5f3a4bbc270.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_bab79ae77aeb427cb831b5f3a4bbc270.jpg already downloaded
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc5%252Fdbc57a65fd58f28406e791572bcbd6a2%252Fpa%252FWP22813_8797fc597d25c6008f8c0de238550857.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_8797fc597d25c6008f8c0de238550857.jpg already downloaded
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc5%252Fdbc57a65fd58f28406e791572bcbd6a2%252Fpa%252FWP22813_f678b2c6436b4ec3337cb05a0e9eb98f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_f678b2c6436b4ec3337cb05a0e9eb98f.jpg already downloaded
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc5%252Fdbc57a65fd58f28406e791572bcbd6a2%252Fpa%252FWP22813_ee00e7e137eb9778da17e2149ffa8f3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_ee00e7e137eb9778da17e2149ffa8f3a.jpg already downloaded
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc5%252Fdbc57a65fd58f28406e791572bcbd6a2%252Fpa%252FWP22813_c0d15ede48b9d3695fe850f07c589732.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_c0d15ede48b9d3695fe850f07c589732.jpg already downloaded
2026-03-28 09:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 73204430-20b8-5743-81ef-4bebb2f6f628, identifier: WP22813
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ff0%252F02f051c9a4ccaa83be654ad39ae43139%252Fpa%252FSB80667_4e05897e63ac204aa7c4dcc93dfe4189.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_4e05897e63ac204aa7c4dcc93dfe4189.jpg not downloaded yet
2026-03-28 09:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 73204430-20b8-5743-81ef-4bebb2f6f628 with identifier: WP22813
2026-03-28 09:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 09:00:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 73204430-20b8-5743-81ef-4bebb2f6f628 with identifier: WP22813
2026-03-28 09:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 73204430-20b8-5743-81ef-4bebb2f6f628 with identifier: WP22813 to the API
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WP22813>
{'auction_title': '',
 'c_o_2_emission_value': 40,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:47:09Z',
 'fuel_type': 'hybrid',
 'id': '73204430-20b8-5743-81ef-4bebb2f6f628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP22813',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 93918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_d366db74ca3e253e59a4442bccaa1055.jpg',
                'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_3dc53579b73d50ad76b2b3811d4ae02e.jpg',
                'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_07cd11f945008158d78e3d1fb0c7010d.jpg',
                'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_4fb74cf0fa411545d80559e96ab36fec.jpg',
                'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_1b5d3ec7e5c054804ae83097ff259444.jpg',
                'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_bab79ae77aeb427cb831b5f3a4bbc270.jpg',
                'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_8797fc597d25c6008f8c0de238550857.jpg',
                'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_f678b2c6436b4ec3337cb05a0e9eb98f.jpg',
                'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_ee00e7e137eb9778da17e2149ffa8f3a.jpg',
                'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_c0d15ede48b9d3695fe850f07c589732.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73204430-20b8-5743-81ef-4bebb2f6f628/73204430-20b8-5743-81ef-4bebb2f6f628_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2041491,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_d366db74ca3e253e59a4442bccaa1055.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73204430-20b8-5743-81ef-4bebb2f6f628/73204430-20b8-5743-81ef-4bebb2f6f628_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_3dc53579b73d50ad76b2b3811d4ae02e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73204430-20b8-5743-81ef-4bebb2f6f628/73204430-20b8-5743-81ef-4bebb2f6f628_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_07cd11f945008158d78e3d1fb0c7010d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73204430-20b8-5743-81ef-4bebb2f6f628/73204430-20b8-5743-81ef-4bebb2f6f628_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_4fb74cf0fa411545d80559e96ab36fec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73204430-20b8-5743-81ef-4bebb2f6f628/73204430-20b8-5743-81ef-4bebb2f6f628_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_1b5d3ec7e5c054804ae83097ff259444.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73204430-20b8-5743-81ef-4bebb2f6f628/73204430-20b8-5743-81ef-4bebb2f6f628_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_bab79ae77aeb427cb831b5f3a4bbc270.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73204430-20b8-5743-81ef-4bebb2f6f628/73204430-20b8-5743-81ef-4bebb2f6f628_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_8797fc597d25c6008f8c0de238550857.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73204430-20b8-5743-81ef-4bebb2f6f628/73204430-20b8-5743-81ef-4bebb2f6f628_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_f678b2c6436b4ec3337cb05a0e9eb98f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73204430-20b8-5743-81ef-4bebb2f6f628/73204430-20b8-5743-81ef-4bebb2f6f628_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_ee00e7e137eb9778da17e2149ffa8f3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73204430-20b8-5743-81ef-4bebb2f6f628/73204430-20b8-5743-81ef-4bebb2f6f628_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c5/dbc57a65fd58f28406e791572bcbd6a2/pa/WP22813_c0d15ede48b9d3695fe850f07c589732.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2018}
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP22813%27 HTTP/1.1" 200 None
2026-03-28 09:00:44 [auto1.it] INFO: Saving data for WP22813: {'created_time': 1774688444.40334, 'last_price_update_time': 1774688444.403351, 'auction_closing_time': 1774885629.0}
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WP22813') HTTP/1.1" 204 0
2026-03-28 09:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_e9091a446f964009b0c31a18b7200b92.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ff0%252F02f051c9a4ccaa83be654ad39ae43139%252Fpa%252FSB80667_929e97567c42669cbf819050bc236b55.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_929e97567c42669cbf819050bc236b55.jpg not downloaded yet
2026-03-28 09:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FV07755/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19dd78d0>
2026-03-28 09:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f063555-c039-5a3b-af5d-128cb95a9954/8f063555-c039-5a3b-af5d-128cb95a9954_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2e%252F722e6e33e0a9aaa5b172cfbf7a046fdc%252Fpa%252FHG07035_0a5a6b21bbd7ee97e0143bbaff92d446.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_0a5a6b21bbd7ee97e0143bbaff92d446.jpg saved to cache
2026-03-28 09:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f063555-c039-5a3b-af5d-128cb95a9954
2026-03-28 09:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b794d0>
2026-03-28 09:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f063555-c039-5a3b-af5d-128cb95a9954/8f063555-c039-5a3b-af5d-128cb95a9954_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2e%252F722e6e33e0a9aaa5b172cfbf7a046fdc%252Fpa%252FHG07035_90010a4229302db4989b450d0ff324f2.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_90010a4229302db4989b450d0ff324f2.jpg saved to cache
2026-03-28 09:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f063555-c039-5a3b-af5d-128cb95a9954
2026-03-28 09:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c9f810>
2026-03-28 09:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f063555-c039-5a3b-af5d-128cb95a9954/8f063555-c039-5a3b-af5d-128cb95a9954_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2e%252F722e6e33e0a9aaa5b172cfbf7a046fdc%252Fpa%252FHG07035_cd95c064756711e5f70461945563d100.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_cd95c064756711e5f70461945563d100.jpg saved to cache
2026-03-28 09:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f063555-c039-5a3b-af5d-128cb95a9954
2026-03-28 09:00:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f063555-c039-5a3b-af5d-128cb95a9954, skipping ID generation
2026-03-28 09:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f063555-c039-5a3b-af5d-128cb95a9954 with scrape type 1
2026-03-28 09:00:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f063555-c039-5a3b-af5d-128cb95a9954 sending to next pipeline
2026-03-28 09:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8f063555-c039-5a3b-af5d-128cb95a9954, identifier: HG07035
2026-03-28 09:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3bca683-eb7a-598b-a351-d4dfa7e848d6 with identifier: LD02725
2026-03-28 09:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3bca683-eb7a-598b-a351-d4dfa7e848d6 with scrape type 1
2026-03-28 09:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e3bca683-eb7a-598b-a351-d4dfa7e848d6
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fbc%252F25bc53c09861154264a0595efcbf3774%252Fpa%252FLD02725_ed4fda2384e95df11c423182e17b6b87.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_ed4fda2384e95df11c423182e17b6b87.jpg already downloaded
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fbc%252F25bc53c09861154264a0595efcbf3774%252Fpa%252FLD02725_f00e31f48f762e51cf2b62ff49a754bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_f00e31f48f762e51cf2b62ff49a754bf.jpg already downloaded
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fbc%252F25bc53c09861154264a0595efcbf3774%252Fpa%252FLD02725_fb2487175f1c2171b55cdca3d00d4618.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_fb2487175f1c2171b55cdca3d00d4618.jpg already downloaded
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fbc%252F25bc53c09861154264a0595efcbf3774%252Fpa%252FLD02725_3f48bb90e5da92da6250cbad67f3d5a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_3f48bb90e5da92da6250cbad67f3d5a7.jpg already downloaded
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fbc%252F25bc53c09861154264a0595efcbf3774%252Fpa%252FLD02725_79e0cb3e24ea3f285812f617cb91f5ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_79e0cb3e24ea3f285812f617cb91f5ee.jpg already downloaded
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fbc%252F25bc53c09861154264a0595efcbf3774%252Fpa%252FLD02725_812a01bdfdd47e3e81c6b8499d651272.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_812a01bdfdd47e3e81c6b8499d651272.jpg already downloaded
2026-03-28 09:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e3bca683-eb7a-598b-a351-d4dfa7e848d6, identifier: LD02725
2026-03-28 09:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b3ce90>
2026-03-28 09:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F17%252F06171d8cb3f743305f07cb856a6eaadb%252Fpa%252FAG82147_5d83dd28622cf999bed76c69b51dd6f4.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_5d83dd28622cf999bed76c69b51dd6f4.jpg saved to cache
2026-03-28 09:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df2e52db-61dc-5a76-9435-08d746d02bef
2026-03-28 09:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB09690> (referer: https://www.auto1.com/v1/car-details-view/YB09690/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG31110> (referer: https://www.auto1.com/v1/car-details-view/EG31110/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8f063555-c039-5a3b-af5d-128cb95a9954 with identifier: HG07035
2026-03-28 09:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8f063555-c039-5a3b-af5d-128cb95a9954 with identifier: HG07035
2026-03-28 09:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8f063555-c039-5a3b-af5d-128cb95a9954 with identifier: HG07035 to the API
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_cd95c064756711e5f70461945563d100.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:00:45Z',
 'fuel_type': 'petrol',
 'id': '8f063555-c039-5a3b-af5d-128cb95a9954',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG07035',
 'listing': 'auction',
 'location': 'IT, Legnano',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 115403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f063555-c039-5a3b-af5d-128cb95a9954/8f063555-c039-5a3b-af5d-128cb95a9954_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_cd95c064756711e5f70461945563d100.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f063555-c039-5a3b-af5d-128cb95a9954/8f063555-c039-5a3b-af5d-128cb95a9954_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_0a5a6b21bbd7ee97e0143bbaff92d446.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f063555-c039-5a3b-af5d-128cb95a9954/8f063555-c039-5a3b-af5d-128cb95a9954_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_90010a4229302db4989b450d0ff324f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f063555-c039-5a3b-af5d-128cb95a9954/8f063555-c039-5a3b-af5d-128cb95a9954_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_9f9f37bed9b64274f078205476ce0b1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f063555-c039-5a3b-af5d-128cb95a9954/8f063555-c039-5a3b-af5d-128cb95a9954_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/2e/722e6e33e0a9aaa5b172cfbf7a046fdc/pa/HG07035_fddbc8bdb11a1edc87c039b46e46be83.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2008}
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG07035%27 HTTP/1.1" 200 None
2026-03-28 09:00:45 [auto1.it] INFO: Saving data for HG07035: {'created_time': 1774688445.270092, 'last_price_update_time': 1774688445.270103, 'auction_closing_time': 1774882845.0}
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HG07035') HTTP/1.1" 204 0
2026-03-28 09:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e3bca683-eb7a-598b-a351-d4dfa7e848d6 with identifier: LD02725
2026-03-28 09:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e3bca683-eb7a-598b-a351-d4dfa7e848d6 with identifier: LD02725
2026-03-28 09:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e3bca683-eb7a-598b-a351-d4dfa7e848d6 with identifier: LD02725 to the API
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LD02725>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:53:27Z',
 'fuel_type': 'diesel',
 'id': 'e3bca683-eb7a-598b-a351-d4dfa7e848d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD02725',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 207158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_ed4fda2384e95df11c423182e17b6b87.jpg',
                'https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_f00e31f48f762e51cf2b62ff49a754bf.jpg',
                'https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_fb2487175f1c2171b55cdca3d00d4618.jpg',
                'https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_3f48bb90e5da92da6250cbad67f3d5a7.jpg',
                'https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_79e0cb3e24ea3f285812f617cb91f5ee.jpg',
                'https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_812a01bdfdd47e3e81c6b8499d651272.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3bca683-eb7a-598b-a351-d4dfa7e848d6/e3bca683-eb7a-598b-a351-d4dfa7e848d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_ed4fda2384e95df11c423182e17b6b87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3bca683-eb7a-598b-a351-d4dfa7e848d6/e3bca683-eb7a-598b-a351-d4dfa7e848d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_f00e31f48f762e51cf2b62ff49a754bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3bca683-eb7a-598b-a351-d4dfa7e848d6/e3bca683-eb7a-598b-a351-d4dfa7e848d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_fb2487175f1c2171b55cdca3d00d4618.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3bca683-eb7a-598b-a351-d4dfa7e848d6/e3bca683-eb7a-598b-a351-d4dfa7e848d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_3f48bb90e5da92da6250cbad67f3d5a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3bca683-eb7a-598b-a351-d4dfa7e848d6/e3bca683-eb7a-598b-a351-d4dfa7e848d6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_79e0cb3e24ea3f285812f617cb91f5ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3bca683-eb7a-598b-a351-d4dfa7e848d6/e3bca683-eb7a-598b-a351-d4dfa7e848d6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/bc/25bc53c09861154264a0595efcbf3774/pa/LD02725_812a01bdfdd47e3e81c6b8499d651272.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Business Nav',
 'transmission': 'automatic',
 'trim': 'Business Nav',
 'year': 2013}
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD02725%27 HTTP/1.1" 200 None
2026-03-28 09:00:45 [auto1.it] INFO: Saving data for LD02725: {'created_time': 1774688445.601606, 'last_price_update_time': 1774688445.601622, 'auction_closing_time': 1774886007.0}
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LD02725') HTTP/1.1" 204 0
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ff0%252F02f051c9a4ccaa83be654ad39ae43139%252Fpa%252FSB80667_ed81fd469c225e8764e0e8702b58c333.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_ed81fd469c225e8764e0e8702b58c333.jpg not downloaded yet
2026-03-28 09:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_b4b230e3c1a4c01274b8b945cd28f258.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ31826> (referer: https://www.auto1.com/v1/car-details-view/DJ31826/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19e0f6d0>
2026-03-28 09:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_e9091a446f964009b0c31a18b7200b92.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_e9091a446f964009b0c31a18b7200b92.jpg saved to cache
2026-03-28 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 736efd31-a741-58bc-ba47-075110b051d8
2026-03-28 09:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa394b43-4395-5682-9888-3f1841eb488e with identifier: YB09690
2026-03-28 09:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa394b43-4395-5682-9888-3f1841eb488e with scrape type 1
2026-03-28 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa394b43-4395-5682-9888-3f1841eb488e
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe6%252Fbee6878f6a72452245e75d001dcb35ce%252Fpa%252FYB09690_689f19306a9c474ec4eb258a795789e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_689f19306a9c474ec4eb258a795789e9.jpg already downloaded
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe6%252Fbee6878f6a72452245e75d001dcb35ce%252Fpa%252FYB09690_d2ccc6fd96d599fd688ca7e88251ef6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_d2ccc6fd96d599fd688ca7e88251ef6d.jpg already downloaded
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe6%252Fbee6878f6a72452245e75d001dcb35ce%252Fpa%252FYB09690_25a9c6ba5ff4ec93440ca79072a7902c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_25a9c6ba5ff4ec93440ca79072a7902c.jpg already downloaded
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe6%252Fbee6878f6a72452245e75d001dcb35ce%252Fpa%252FYB09690_2e190ff775956cdcd43321d3889e1499.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_2e190ff775956cdcd43321d3889e1499.jpg already downloaded
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe6%252Fbee6878f6a72452245e75d001dcb35ce%252Fpa%252FYB09690_32bdede8339f158ad49b6ff758a264ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_32bdede8339f158ad49b6ff758a264ff.jpg already downloaded
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe6%252Fbee6878f6a72452245e75d001dcb35ce%252Fpa%252FYB09690_e665d7b110adc480fc14414c2c15540a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_e665d7b110adc480fc14414c2c15540a.jpg already downloaded
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe6%252Fbee6878f6a72452245e75d001dcb35ce%252Fpa%252FYB09690_775e410a7e5fcce1ce44bb13b482ef09.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_775e410a7e5fcce1ce44bb13b482ef09.jpg already downloaded
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe6%252Fbee6878f6a72452245e75d001dcb35ce%252Fpa%252FYB09690_a059a01d345ababc69dda1ad31150d99.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_a059a01d345ababc69dda1ad31150d99.jpg already downloaded
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe6%252Fbee6878f6a72452245e75d001dcb35ce%252Fpa%252FYB09690_08bb8286fe7b710b36b74f1d51b6c580.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_08bb8286fe7b710b36b74f1d51b6c580.jpg already downloaded
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe6%252Fbee6878f6a72452245e75d001dcb35ce%252Fpa%252FYB09690_1f760a11fc18c64942aac140b26f3ad7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_1f760a11fc18c64942aac140b26f3ad7.jpg already downloaded
2026-03-28 09:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa394b43-4395-5682-9888-3f1841eb488e, identifier: YB09690
2026-03-28 09:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8378a5eb-70c7-5357-a7eb-5ef2700fd036 with identifier: EG31110
2026-03-28 09:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8378a5eb-70c7-5357-a7eb-5ef2700fd036 with scrape type 1
2026-03-28 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8378a5eb-70c7-5357-a7eb-5ef2700fd036
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe0%252F11e08043ce03cbd2c059e1fa25958cdf%252Fpa%252FEG31110_fbea424b0e9871b99829c05098cd932a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_fbea424b0e9871b99829c05098cd932a.jpg already downloaded
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe0%252F11e08043ce03cbd2c059e1fa25958cdf%252Fpa%252FEG31110_613417f03f38661d5f64c72d64133ac0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_613417f03f38661d5f64c72d64133ac0.jpg already downloaded
2026-03-28 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe0%252F11e08043ce03cbd2c059e1fa25958cdf%252Fpa%252FEG31110_deb212347cb01c585bd8b3456c79a058.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_deb212347cb01c585bd8b3456c79a058.jpg already downloaded
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe0%252F11e08043ce03cbd2c059e1fa25958cdf%252Fpa%252FEG31110_370e9a871f4cd39ecb3b7b1b983b2ed5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_370e9a871f4cd39ecb3b7b1b983b2ed5.jpg already downloaded
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe0%252F11e08043ce03cbd2c059e1fa25958cdf%252Fpa%252FEG31110_c081adc9e8cc708bfb3d5bda09e14d6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_c081adc9e8cc708bfb3d5bda09e14d6c.jpg already downloaded
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe0%252F11e08043ce03cbd2c059e1fa25958cdf%252Fpa%252FEG31110_596e7831f5f1f82dd80003f3d3cb9f1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_596e7831f5f1f82dd80003f3d3cb9f1c.jpg already downloaded
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe0%252F11e08043ce03cbd2c059e1fa25958cdf%252Fpa%252FEG31110_02c1a969a56967269b4da89056f59b5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_02c1a969a56967269b4da89056f59b5b.jpg already downloaded
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe0%252F11e08043ce03cbd2c059e1fa25958cdf%252Fpa%252FEG31110_3d6995244eafc011d0eefb173bc20c42.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_3d6995244eafc011d0eefb173bc20c42.jpg already downloaded
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe0%252F11e08043ce03cbd2c059e1fa25958cdf%252Fpa%252FEG31110_636091b643ec448b03a5a99387d618dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_636091b643ec448b03a5a99387d618dc.jpg already downloaded
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe0%252F11e08043ce03cbd2c059e1fa25958cdf%252Fpa%252FEG31110_2a4339c1482da65e96251a7d947e73f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_2a4339c1482da65e96251a7d947e73f5.jpg already downloaded
2026-03-28 09:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8378a5eb-70c7-5357-a7eb-5ef2700fd036, identifier: EG31110
2026-03-28 09:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa394b43-4395-5682-9888-3f1841eb488e with identifier: YB09690
2026-03-28 09:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa394b43-4395-5682-9888-3f1841eb488e with identifier: YB09690
2026-03-28 09:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fa394b43-4395-5682-9888-3f1841eb488e with identifier: YB09690 to the API
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YB09690>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:55:09Z',
 'fuel_type': 'petrol',
 'id': 'fa394b43-4395-5682-9888-3f1841eb488e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB09690',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 138134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_689f19306a9c474ec4eb258a795789e9.jpg',
                'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_d2ccc6fd96d599fd688ca7e88251ef6d.jpg',
                'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_25a9c6ba5ff4ec93440ca79072a7902c.jpg',
                'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_2e190ff775956cdcd43321d3889e1499.jpg',
                'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_32bdede8339f158ad49b6ff758a264ff.jpg',
                'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_e665d7b110adc480fc14414c2c15540a.jpg',
                'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_775e410a7e5fcce1ce44bb13b482ef09.jpg',
                'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_a059a01d345ababc69dda1ad31150d99.jpg',
                'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_08bb8286fe7b710b36b74f1d51b6c580.jpg',
                'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_1f760a11fc18c64942aac140b26f3ad7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa394b43-4395-5682-9888-3f1841eb488e/fa394b43-4395-5682-9888-3f1841eb488e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2425907,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_689f19306a9c474ec4eb258a795789e9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa394b43-4395-5682-9888-3f1841eb488e/fa394b43-4395-5682-9888-3f1841eb488e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2602041,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_d2ccc6fd96d599fd688ca7e88251ef6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa394b43-4395-5682-9888-3f1841eb488e/fa394b43-4395-5682-9888-3f1841eb488e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2571956,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_25a9c6ba5ff4ec93440ca79072a7902c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa394b43-4395-5682-9888-3f1841eb488e/fa394b43-4395-5682-9888-3f1841eb488e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2536199,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_2e190ff775956cdcd43321d3889e1499.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa394b43-4395-5682-9888-3f1841eb488e/fa394b43-4395-5682-9888-3f1841eb488e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2533807,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_32bdede8339f158ad49b6ff758a264ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa394b43-4395-5682-9888-3f1841eb488e/fa394b43-4395-5682-9888-3f1841eb488e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2597433,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_e665d7b110adc480fc14414c2c15540a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa394b43-4395-5682-9888-3f1841eb488e/fa394b43-4395-5682-9888-3f1841eb488e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2524528,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_775e410a7e5fcce1ce44bb13b482ef09.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa394b43-4395-5682-9888-3f1841eb488e/fa394b43-4395-5682-9888-3f1841eb488e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2528201,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_a059a01d345ababc69dda1ad31150d99.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa394b43-4395-5682-9888-3f1841eb488e/fa394b43-4395-5682-9888-3f1841eb488e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2436836,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_08bb8286fe7b710b36b74f1d51b6c580.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa394b43-4395-5682-9888-3f1841eb488e/fa394b43-4395-5682-9888-3f1841eb488e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2573580,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e6/bee6878f6a72452245e75d001dcb35ce/pa/YB09690_1f760a11fc18c64942aac140b26f3ad7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo City Cross',
 'transmission': 'manual',
 'trim': 'City Cross',
 'year': 2019}
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB09690%27 HTTP/1.1" 200 None
2026-03-28 09:00:46 [auto1.it] INFO: Saving data for YB09690: {'created_time': 1774688446.595289, 'last_price_update_time': 1774688446.5953, 'auction_closing_time': 1774886109.0}
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YB09690') HTTP/1.1" 204 0
2026-03-28 09:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8378a5eb-70c7-5357-a7eb-5ef2700fd036 with identifier: EG31110
2026-03-28 09:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8378a5eb-70c7-5357-a7eb-5ef2700fd036 with identifier: EG31110
2026-03-28 09:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8378a5eb-70c7-5357-a7eb-5ef2700fd036 with identifier: EG31110 to the API
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EG31110>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:39:29Z',
 'fuel_type': 'diesel',
 'id': '8378a5eb-70c7-5357-a7eb-5ef2700fd036',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG31110',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 133145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_fbea424b0e9871b99829c05098cd932a.jpg',
                'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_613417f03f38661d5f64c72d64133ac0.jpg',
                'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_deb212347cb01c585bd8b3456c79a058.jpg',
                'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_370e9a871f4cd39ecb3b7b1b983b2ed5.jpg',
                'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_c081adc9e8cc708bfb3d5bda09e14d6c.jpg',
                'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_596e7831f5f1f82dd80003f3d3cb9f1c.jpg',
                'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_02c1a969a56967269b4da89056f59b5b.jpg',
                'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_3d6995244eafc011d0eefb173bc20c42.jpg',
                'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_636091b643ec448b03a5a99387d618dc.jpg',
                'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_2a4339c1482da65e96251a7d947e73f5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8378a5eb-70c7-5357-a7eb-5ef2700fd036/8378a5eb-70c7-5357-a7eb-5ef2700fd036_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_fbea424b0e9871b99829c05098cd932a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8378a5eb-70c7-5357-a7eb-5ef2700fd036/8378a5eb-70c7-5357-a7eb-5ef2700fd036_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_613417f03f38661d5f64c72d64133ac0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8378a5eb-70c7-5357-a7eb-5ef2700fd036/8378a5eb-70c7-5357-a7eb-5ef2700fd036_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_deb212347cb01c585bd8b3456c79a058.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8378a5eb-70c7-5357-a7eb-5ef2700fd036/8378a5eb-70c7-5357-a7eb-5ef2700fd036_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_370e9a871f4cd39ecb3b7b1b983b2ed5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8378a5eb-70c7-5357-a7eb-5ef2700fd036/8378a5eb-70c7-5357-a7eb-5ef2700fd036_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2362843,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_c081adc9e8cc708bfb3d5bda09e14d6c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8378a5eb-70c7-5357-a7eb-5ef2700fd036/8378a5eb-70c7-5357-a7eb-5ef2700fd036_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_596e7831f5f1f82dd80003f3d3cb9f1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8378a5eb-70c7-5357-a7eb-5ef2700fd036/8378a5eb-70c7-5357-a7eb-5ef2700fd036_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_02c1a969a56967269b4da89056f59b5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8378a5eb-70c7-5357-a7eb-5ef2700fd036/8378a5eb-70c7-5357-a7eb-5ef2700fd036_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_3d6995244eafc011d0eefb173bc20c42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8378a5eb-70c7-5357-a7eb-5ef2700fd036/8378a5eb-70c7-5357-a7eb-5ef2700fd036_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_636091b643ec448b03a5a99387d618dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8378a5eb-70c7-5357-a7eb-5ef2700fd036/8378a5eb-70c7-5357-a7eb-5ef2700fd036_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e0/11e08043ce03cbd2c059e1fa25958cdf/pa/EG31110_2a4339c1482da65e96251a7d947e73f5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG31110%27 HTTP/1.1" 200 None
2026-03-28 09:00:46 [auto1.it] INFO: Saving data for EG31110: {'created_time': 1774688446.977273, 'last_price_update_time': 1774688446.977284, 'auction_closing_time': 1774885169.0}
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EG31110') HTTP/1.1" 204 0
2026-03-28 09:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_4e05897e63ac204aa7c4dcc93dfe4189.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_929e97567c42669cbf819050bc236b55.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_3f5a0450b864b30fb579e92276e5b43b.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WH30921> (referer: https://www.auto1.com/v1/car-details-view/WH30921/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WL53741/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a650150>
2026-03-28 09:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e63003-a893-577a-aebd-a60df651d726/88e63003-a893-577a-aebd-a60df651d726_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ff0%252F02f051c9a4ccaa83be654ad39ae43139%252Fpa%252FSB80667_b4b230e3c1a4c01274b8b945cd28f258.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_b4b230e3c1a4c01274b8b945cd28f258.jpg saved to cache
2026-03-28 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88e63003-a893-577a-aebd-a60df651d726
2026-03-28 09:00:47 [auto1.it] INFO: Channel: 24h | Page: 5 | totalHits: 3430 | hits on page: 40
2026-03-28 09:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fba7d46d-84d7-558f-9097-bf737e569eca with identifier: DJ31826
2026-03-28 09:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fba7d46d-84d7-558f-9097-bf737e569eca with scrape type 1
2026-03-28 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fba7d46d-84d7-558f-9097-bf737e569eca
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F7b%252F517b518511da616536e964e6f938be87%252Fpa%252FDJ31826_fd5cd169e3a9ccb3f9d4f41838f41e90.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_fd5cd169e3a9ccb3f9d4f41838f41e90.jpg already downloaded
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F7b%252F517b518511da616536e964e6f938be87%252Fpa%252FDJ31826_57535f51d91adf2afe8d08daf5032731.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_57535f51d91adf2afe8d08daf5032731.jpg already downloaded
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F7b%252F517b518511da616536e964e6f938be87%252Fpa%252FDJ31826_24783b90f9320f157a96bf842a120acc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_24783b90f9320f157a96bf842a120acc.jpg already downloaded
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F7b%252F517b518511da616536e964e6f938be87%252Fpa%252FDJ31826_60bcfab83f166d2ebe58522f218192b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_60bcfab83f166d2ebe58522f218192b8.jpg already downloaded
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F7b%252F517b518511da616536e964e6f938be87%252Fpa%252FDJ31826_78d6c44d5663d02c091c8145bf6e041b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_78d6c44d5663d02c091c8145bf6e041b.jpg already downloaded
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F7b%252F517b518511da616536e964e6f938be87%252Fpa%252FDJ31826_2e85d72cb9622fd521435a52f9391057.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_2e85d72cb9622fd521435a52f9391057.jpg already downloaded
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F7b%252F517b518511da616536e964e6f938be87%252Fpa%252FDJ31826_d4924c4b431b1b45be6f310b59b45d6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_d4924c4b431b1b45be6f310b59b45d6b.jpg already downloaded
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F7b%252F517b518511da616536e964e6f938be87%252Fpa%252FDJ31826_b4f67f8e8163997e265928852e85c5b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_b4f67f8e8163997e265928852e85c5b7.jpg already downloaded
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F7b%252F517b518511da616536e964e6f938be87%252Fpa%252FDJ31826_2b3898987943dba0b6dbbc81aede314e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_2b3898987943dba0b6dbbc81aede314e.jpg already downloaded
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F7b%252F517b518511da616536e964e6f938be87%252Fpa%252FDJ31826_50a0530afbf609cd732e7515167208bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_50a0530afbf609cd732e7515167208bd.jpg already downloaded
2026-03-28 09:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fba7d46d-84d7-558f-9097-bf737e569eca, identifier: DJ31826
2026-03-28 09:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fba7d46d-84d7-558f-9097-bf737e569eca with identifier: DJ31826
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 09:00:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fba7d46d-84d7-558f-9097-bf737e569eca with identifier: DJ31826
2026-03-28 09:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fba7d46d-84d7-558f-9097-bf737e569eca with identifier: DJ31826 to the API
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DJ31826>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': 'Rental',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:45:38Z',
 'fuel_type': 'diesel',
 'id': 'fba7d46d-84d7-558f-9097-bf737e569eca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ31826',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 178025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_fd5cd169e3a9ccb3f9d4f41838f41e90.jpg',
                'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_57535f51d91adf2afe8d08daf5032731.jpg',
                'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_24783b90f9320f157a96bf842a120acc.jpg',
                'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_60bcfab83f166d2ebe58522f218192b8.jpg',
                'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_78d6c44d5663d02c091c8145bf6e041b.jpg',
                'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_2e85d72cb9622fd521435a52f9391057.jpg',
                'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_d4924c4b431b1b45be6f310b59b45d6b.jpg',
                'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_b4f67f8e8163997e265928852e85c5b7.jpg',
                'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_2b3898987943dba0b6dbbc81aede314e.jpg',
                'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_50a0530afbf609cd732e7515167208bd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba7d46d-84d7-558f-9097-bf737e569eca/fba7d46d-84d7-558f-9097-bf737e569eca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_fd5cd169e3a9ccb3f9d4f41838f41e90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba7d46d-84d7-558f-9097-bf737e569eca/fba7d46d-84d7-558f-9097-bf737e569eca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_57535f51d91adf2afe8d08daf5032731.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba7d46d-84d7-558f-9097-bf737e569eca/fba7d46d-84d7-558f-9097-bf737e569eca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_24783b90f9320f157a96bf842a120acc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba7d46d-84d7-558f-9097-bf737e569eca/fba7d46d-84d7-558f-9097-bf737e569eca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_60bcfab83f166d2ebe58522f218192b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba7d46d-84d7-558f-9097-bf737e569eca/fba7d46d-84d7-558f-9097-bf737e569eca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_78d6c44d5663d02c091c8145bf6e041b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba7d46d-84d7-558f-9097-bf737e569eca/fba7d46d-84d7-558f-9097-bf737e569eca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_2e85d72cb9622fd521435a52f9391057.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba7d46d-84d7-558f-9097-bf737e569eca/fba7d46d-84d7-558f-9097-bf737e569eca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2989987,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_d4924c4b431b1b45be6f310b59b45d6b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba7d46d-84d7-558f-9097-bf737e569eca/fba7d46d-84d7-558f-9097-bf737e569eca_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_b4f67f8e8163997e265928852e85c5b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba7d46d-84d7-558f-9097-bf737e569eca/fba7d46d-84d7-558f-9097-bf737e569eca_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_2b3898987943dba0b6dbbc81aede314e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba7d46d-84d7-558f-9097-bf737e569eca/fba7d46d-84d7-558f-9097-bf737e569eca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3278830,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/7b/517b518511da616536e964e6f938be87/pa/DJ31826_50a0530afbf609cd732e7515167208bd.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper D ALL4',
 'transmission': 'manual',
 'trim': 'ALL4',
 'year': 2011}
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ31826%27 HTTP/1.1" 200 None
2026-03-28 09:00:47 [auto1.it] INFO: Saving data for DJ31826: {'created_time': 1774688447.781092, 'last_price_update_time': 1774688447.781102, 'auction_closing_time': 1774885538.0}
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DJ31826') HTTP/1.1" 204 0
2026-03-28 09:00:47 [auto1.it] INFO: Found listing with ID: PB29949
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB29949%27 HTTP/1.1" 200 None
2026-03-28 09:00:47 [auto1.it] INFO: Scrape type for PB29949: 0
2026-03-28 09:00:47 [auto1.it] INFO: Found listing with ID: CE18152
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE18152%27 HTTP/1.1" 200 None
2026-03-28 09:00:47 [auto1.it] INFO: Scrape type for CE18152: 2
2026-03-28 09:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93f16dff-5ba7-533d-ae74-9d6869bbb811 with identifier: CE18152
2026-03-28 09:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93f16dff-5ba7-533d-ae74-9d6869bbb811 with scrape type 2
2026-03-28 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93f16dff-5ba7-533d-ae74-9d6869bbb811 with scrape type 2
2026-03-28 09:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 93f16dff-5ba7-533d-ae74-9d6869bbb811, identifier: CE18152
2026-03-28 09:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_ed81fd469c225e8764e0e8702b58c333.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 93f16dff-5ba7-533d-ae74-9d6869bbb811 with identifier: CE18152
2026-03-28 09:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 93f16dff-5ba7-533d-ae74-9d6869bbb811 with identifier: CE18152
2026-03-28 09:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 93f16dff-5ba7-533d-ae74-9d6869bbb811 with identifier: CE18152 to the API
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:06:56Z',
 'fuel_type': 'diesel',
 'id': '93f16dff-5ba7-533d-ae74-9d6869bbb811',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE18152',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 80681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-23',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Super',
 'transmission': 'automatic',
 'trim': 'Super',
 'year': 2017}
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE18152%27 HTTP/1.1" 200 None
2026-03-28 09:00:48 [auto1.it] INFO: Saving data for CE18152: {'auction_closing_time': 1774714016.0, 'created_time': 1773130618.338913, 'last_price_update_time': 1774688448.319662}
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CE18152') HTTP/1.1" 204 0
2026-03-28 09:00:48 [auto1.it] INFO: Found listing with ID: ER01593
2026-03-28 09:00:48 [auto1.it] INFO: Found listing with ID: PN94289
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN94289%27 HTTP/1.1" 200 None
2026-03-28 09:00:48 [auto1.it] INFO: Scrape type for PN94289: 2
2026-03-28 09:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88ac986b-a2e7-53ee-b511-dbe3d881ad4d with identifier: PN94289
2026-03-28 09:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88ac986b-a2e7-53ee-b511-dbe3d881ad4d with scrape type 2
2026-03-28 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88ac986b-a2e7-53ee-b511-dbe3d881ad4d with scrape type 2
2026-03-28 09:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 88ac986b-a2e7-53ee-b511-dbe3d881ad4d, identifier: PN94289
2026-03-28 09:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY41860> (referer: https://www.auto1.com/v1/car-details-view/HY41860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 88ac986b-a2e7-53ee-b511-dbe3d881ad4d with identifier: PN94289
2026-03-28 09:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 88ac986b-a2e7-53ee-b511-dbe3d881ad4d with identifier: PN94289
2026-03-28 09:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 88ac986b-a2e7-53ee-b511-dbe3d881ad4d with identifier: PN94289 to the API
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:15:12Z',
 'fuel_type': 'diesel',
 'id': '88ac986b-a2e7-53ee-b511-dbe3d881ad4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN94289',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 68115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-24',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN94289%27 HTTP/1.1" 200 None
2026-03-28 09:00:48 [auto1.it] INFO: Saving data for PN94289: {'auction_closing_time': 1774714512.0, 'created_time': 1773130383.445259, 'last_price_update_time': 1774688448.863859}
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PN94289') HTTP/1.1" 204 0
2026-03-28 09:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c34510>
2026-03-28 09:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e63003-a893-577a-aebd-a60df651d726/88e63003-a893-577a-aebd-a60df651d726_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ff0%252F02f051c9a4ccaa83be654ad39ae43139%252Fpa%252FSB80667_4e05897e63ac204aa7c4dcc93dfe4189.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_4e05897e63ac204aa7c4dcc93dfe4189.jpg saved to cache
2026-03-28 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88e63003-a893-577a-aebd-a60df651d726
2026-03-28 09:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b21a10>
2026-03-28 09:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e63003-a893-577a-aebd-a60df651d726/88e63003-a893-577a-aebd-a60df651d726_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ff0%252F02f051c9a4ccaa83be654ad39ae43139%252Fpa%252FSB80667_929e97567c42669cbf819050bc236b55.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_929e97567c42669cbf819050bc236b55.jpg saved to cache
2026-03-28 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88e63003-a893-577a-aebd-a60df651d726
2026-03-28 09:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b27d10>
2026-03-28 09:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e63003-a893-577a-aebd-a60df651d726/88e63003-a893-577a-aebd-a60df651d726_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ff0%252F02f051c9a4ccaa83be654ad39ae43139%252Fpa%252FSB80667_3f5a0450b864b30fb579e92276e5b43b.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_3f5a0450b864b30fb579e92276e5b43b.jpg saved to cache
2026-03-28 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88e63003-a893-577a-aebd-a60df651d726
2026-03-28 09:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 186bb506-7a70-5713-b211-f145610d42d4 with identifier: WH30921
2026-03-28 09:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 186bb506-7a70-5713-b211-f145610d42d4 with scrape type 1
2026-03-28 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 186bb506-7a70-5713-b211-f145610d42d4
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_11d7a6d595b0397b43a77841a97bb74c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_11d7a6d595b0397b43a77841a97bb74c.jpg not downloaded yet
2026-03-28 09:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_3382cbcbc9eb7e0aa1f1ac62b95b35c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:49 [auto1.it] INFO: Found listing with ID: YY00281
2026-03-28 09:00:49 [auto1.it] INFO: Found listing with ID: UR28230
2026-03-28 09:00:49 [auto1.it] INFO: Found listing with ID: YE38738
2026-03-28 09:00:49 [auto1.it] INFO: Found listing with ID: AT20318
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT20318%27 HTTP/1.1" 200 None
2026-03-28 09:00:49 [auto1.it] INFO: Scrape type for AT20318: 2
2026-03-28 09:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 331d4894-b3ce-54f5-ab8c-b0a4a219ef2e with identifier: AT20318
2026-03-28 09:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 331d4894-b3ce-54f5-ab8c-b0a4a219ef2e with scrape type 2
2026-03-28 09:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 331d4894-b3ce-54f5-ab8c-b0a4a219ef2e with scrape type 2
2026-03-28 09:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 331d4894-b3ce-54f5-ab8c-b0a4a219ef2e, identifier: AT20318
2026-03-28 09:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 331d4894-b3ce-54f5-ab8c-b0a4a219ef2e with identifier: AT20318
2026-03-28 09:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 331d4894-b3ce-54f5-ab8c-b0a4a219ef2e with identifier: AT20318
2026-03-28 09:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 331d4894-b3ce-54f5-ab8c-b0a4a219ef2e with identifier: AT20318 to the API
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:40:43Z',
 'fuel_type': 'diesel',
 'id': '331d4894-b3ce-54f5-ab8c-b0a4a219ef2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT20318',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 60265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-13',
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet L2H2 RS: 3450 mm',
 'transmission': 'manual',
 'trim': 'L2H2 RS: 3450 mm',
 'year': 2022}
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT20318%27 HTTP/1.1" 200 None
2026-03-28 09:00:49 [auto1.it] INFO: Saving data for AT20318: {'auction_closing_time': 1774716043.0, 'created_time': 1773130918.766614, 'last_price_update_time': 1774688449.49629}
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AT20318') HTTP/1.1" 204 0
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_f2f981df5630df591937ed77aee9bf40.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_f2f981df5630df591937ed77aee9bf40.jpg not downloaded yet
2026-03-28 09:00:49 [auto1.it] INFO: Found listing with ID: RG08819
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG08819%27 HTTP/1.1" 200 None
2026-03-28 09:00:49 [auto1.it] INFO: Scrape type for RG08819: 0
2026-03-28 09:00:49 [auto1.it] INFO: Found listing with ID: KZ05620
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ05620%27 HTTP/1.1" 200 None
2026-03-28 09:00:49 [auto1.it] INFO: Scrape type for KZ05620: 2
2026-03-28 09:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ba55fcf-377c-5b84-a04c-fef80e31b529 with identifier: KZ05620
2026-03-28 09:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ba55fcf-377c-5b84-a04c-fef80e31b529 with scrape type 2
2026-03-28 09:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ba55fcf-377c-5b84-a04c-fef80e31b529 with scrape type 2
2026-03-28 09:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6ba55fcf-377c-5b84-a04c-fef80e31b529, identifier: KZ05620
2026-03-28 09:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GJ33186> (referer: https://www.auto1.com/v1/car-details-view/GJ33186/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a692950>
2026-03-28 09:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e63003-a893-577a-aebd-a60df651d726/88e63003-a893-577a-aebd-a60df651d726_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ff0%252F02f051c9a4ccaa83be654ad39ae43139%252Fpa%252FSB80667_ed81fd469c225e8764e0e8702b58c333.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_ed81fd469c225e8764e0e8702b58c333.jpg saved to cache
2026-03-28 09:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88e63003-a893-577a-aebd-a60df651d726
2026-03-28 09:00:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88e63003-a893-577a-aebd-a60df651d726, skipping ID generation
2026-03-28 09:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88e63003-a893-577a-aebd-a60df651d726 with scrape type 1
2026-03-28 09:00:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88e63003-a893-577a-aebd-a60df651d726 sending to next pipeline
2026-03-28 09:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 88e63003-a893-577a-aebd-a60df651d726, identifier: SB80667
2026-03-28 09:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f2c3dce-5942-5608-8b87-e8147630bbdb with identifier: HY41860
2026-03-28 09:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f2c3dce-5942-5608-8b87-e8147630bbdb with scrape type 1
2026-03-28 09:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9f2c3dce-5942-5608-8b87-e8147630bbdb
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F1b%252F441be1d9c8e06e9fd59c1c32823a0a23%252Fpa%252FHY41860_288ee1712ff7ff4d48dbb6268c067d6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_288ee1712ff7ff4d48dbb6268c067d6b.jpg not downloaded yet
2026-03-28 09:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_7847ed21c1a2c710b3fd85f2e21ffe20.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6ba55fcf-377c-5b84-a04c-fef80e31b529 with identifier: KZ05620
2026-03-28 09:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6ba55fcf-377c-5b84-a04c-fef80e31b529 with identifier: KZ05620
2026-03-28 09:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6ba55fcf-377c-5b84-a04c-fef80e31b529 with identifier: KZ05620 to the API
2026-03-28 09:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:09:06Z',
 'fuel_type': 'diesel',
 'id': '6ba55fcf-377c-5b84-a04c-fef80e31b529',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ05620',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 171804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-29',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 B-Tech',
 'transmission': 'automatic',
 'trim': 'Q4 B-Tech',
 'year': 2019}
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ05620%27 HTTP/1.1" 200 None
2026-03-28 09:00:50 [auto1.it] INFO: Saving data for KZ05620: {'auction_closing_time': 1774714146.0, 'created_time': 1773130504.824613, 'last_price_update_time': 1774688450.287219}
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KZ05620') HTTP/1.1" 204 0
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_a44ed01b8fd950a2efbd4ba8b90da3be.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_a44ed01b8fd950a2efbd4ba8b90da3be.jpg not downloaded yet
2026-03-28 09:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 88e63003-a893-577a-aebd-a60df651d726 with identifier: SB80667
2026-03-28 09:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 88e63003-a893-577a-aebd-a60df651d726 with identifier: SB80667
2026-03-28 09:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 88e63003-a893-577a-aebd-a60df651d726 with identifier: SB80667 to the API
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_ed81fd469c225e8764e0e8702b58c333.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 197,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:50Z',
 'fuel_type': 'petrol',
 'id': '88e63003-a893-577a-aebd-a60df651d726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB80667',
 'listing': 'auction',
 'location': 'IT, Pordenone',
 'make': 'Volkswagen',
 'model': 'New Beetle',
 'odometer': 170422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e63003-a893-577a-aebd-a60df651d726/88e63003-a893-577a-aebd-a60df651d726_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_b4b230e3c1a4c01274b8b945cd28f258.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e63003-a893-577a-aebd-a60df651d726/88e63003-a893-577a-aebd-a60df651d726_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_3f5a0450b864b30fb579e92276e5b43b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e63003-a893-577a-aebd-a60df651d726/88e63003-a893-577a-aebd-a60df651d726_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_4e05897e63ac204aa7c4dcc93dfe4189.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e63003-a893-577a-aebd-a60df651d726/88e63003-a893-577a-aebd-a60df651d726_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_929e97567c42669cbf819050bc236b55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e63003-a893-577a-aebd-a60df651d726/88e63003-a893-577a-aebd-a60df651d726_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/f0/02f051c9a4ccaa83be654ad39ae43139/pa/SB80667_ed81fd469c225e8764e0e8702b58c333.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-02-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen New Beetle 1.8 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB80667%27 HTTP/1.1" 200 None
2026-03-28 09:00:50 [auto1.it] INFO: Saving data for SB80667: {'created_time': 1774688450.700195, 'last_price_update_time': 1774688450.700206, 'auction_closing_time': 1774885610.0}
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SB80667') HTTP/1.1" 204 0
2026-03-28 09:00:50 [auto1.it] INFO: Found listing with ID: FC17087
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC17087%27 HTTP/1.1" 200 None
2026-03-28 09:00:50 [auto1.it] INFO: Scrape type for FC17087: 2
2026-03-28 09:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9978eb76-8b05-5493-9953-70f7862c57a0 with identifier: FC17087
2026-03-28 09:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9978eb76-8b05-5493-9953-70f7862c57a0 with scrape type 2
2026-03-28 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9978eb76-8b05-5493-9953-70f7862c57a0 with scrape type 2
2026-03-28 09:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9978eb76-8b05-5493-9953-70f7862c57a0, identifier: FC17087
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F1b%252F441be1d9c8e06e9fd59c1c32823a0a23%252Fpa%252FHY41860_3972e44df8a84ea5fd71d6bc8513c07e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_3972e44df8a84ea5fd71d6bc8513c07e.jpg not downloaded yet
2026-03-28 09:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1c715b50>
2026-03-28 09:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_3382cbcbc9eb7e0aa1f1ac62b95b35c3.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_3382cbcbc9eb7e0aa1f1ac62b95b35c3.jpg saved to cache
2026-03-28 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 736efd31-a741-58bc-ba47-075110b051d8
2026-03-28 09:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9978eb76-8b05-5493-9953-70f7862c57a0 with identifier: FC17087
2026-03-28 09:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9978eb76-8b05-5493-9953-70f7862c57a0 with identifier: FC17087
2026-03-28 09:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9978eb76-8b05-5493-9953-70f7862c57a0 with identifier: FC17087 to the API
2026-03-28 09:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:16:10Z',
 'fuel_type': 'diesel',
 'id': '9978eb76-8b05-5493-9953-70f7862c57a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC17087',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 140240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-27',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC17087%27 HTTP/1.1" 200 None
2026-03-28 09:00:51 [auto1.it] INFO: Saving data for FC17087: {'auction_closing_time': 1774714570.0, 'created_time': 1773130844.762391, 'last_price_update_time': 1774688451.282753}
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FC17087') HTTP/1.1" 204 0
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_2ddbe13ffe0b6f638f46c9c874fc6948.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_2ddbe13ffe0b6f638f46c9c874fc6948.jpg not downloaded yet
2026-03-28 09:00:51 [auto1.it] INFO: Found listing with ID: CD48597
2026-03-28 09:00:51 [auto1.it] INFO: Found listing with ID: ML74945
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML74945%27 HTTP/1.1" 200 None
2026-03-28 09:00:51 [auto1.it] INFO: Scrape type for ML74945: 0
2026-03-28 09:00:51 [auto1.it] INFO: Found listing with ID: SD37804
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD37804%27 HTTP/1.1" 200 None
2026-03-28 09:00:51 [auto1.it] INFO: Scrape type for SD37804: 2
2026-03-28 09:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbacb7c2-4e5c-50b5-9b66-75166ece1dae with identifier: SD37804
2026-03-28 09:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbacb7c2-4e5c-50b5-9b66-75166ece1dae with scrape type 2
2026-03-28 09:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbacb7c2-4e5c-50b5-9b66-75166ece1dae with scrape type 2
2026-03-28 09:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bbacb7c2-4e5c-50b5-9b66-75166ece1dae, identifier: SD37804
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F1b%252F441be1d9c8e06e9fd59c1c32823a0a23%252Fpa%252FHY41860_f9db332936362d856abb83c029eb4310.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_f9db332936362d856abb83c029eb4310.jpg not downloaded yet
2026-03-28 09:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bbacb7c2-4e5c-50b5-9b66-75166ece1dae with identifier: SD37804
2026-03-28 09:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bbacb7c2-4e5c-50b5-9b66-75166ece1dae with identifier: SD37804
2026-03-28 09:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bbacb7c2-4e5c-50b5-9b66-75166ece1dae with identifier: SD37804 to the API
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:14:49Z',
 'fuel_type': 'petrol',
 'id': 'bbacb7c2-4e5c-50b5-9b66-75166ece1dae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD37804',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 197120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-29',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Progression',
 'transmission': 'manual',
 'trim': 'Progression',
 'year': 2016}
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD37804%27 HTTP/1.1" 200 None
2026-03-28 09:00:51 [auto1.it] INFO: Saving data for SD37804: {'auction_closing_time': 1774714489.0, 'created_time': 1773824479.616738, 'last_price_update_time': 1774688451.828869}
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SD37804') HTTP/1.1" 204 0
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_0df9ab565899c42233172beaefb97161.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_0df9ab565899c42233172beaefb97161.jpg not downloaded yet
2026-03-28 09:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5050bb6b-6380-5594-88f1-a5521d3a6102 with identifier: GJ33186
2026-03-28 09:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5050bb6b-6380-5594-88f1-a5521d3a6102 with scrape type 1
2026-03-28 09:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5050bb6b-6380-5594-88f1-a5521d3a6102
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F56%252Fbc568338cf2dfc9f83cc283ed12f8deb%252Fpa%252FGJ33186_d96c9b52a5f757bbdc1a96cd9c1e516f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_d96c9b52a5f757bbdc1a96cd9c1e516f.jpg already downloaded
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F56%252Fbc568338cf2dfc9f83cc283ed12f8deb%252Fpa%252FGJ33186_b0926274a3247c8c6f742b6e37104ea8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_b0926274a3247c8c6f742b6e37104ea8.jpg already downloaded
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F56%252Fbc568338cf2dfc9f83cc283ed12f8deb%252Fpa%252FGJ33186_a99834276d29bfcb0dd71efdd8b7aef9.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_a99834276d29bfcb0dd71efdd8b7aef9.jpg already downloaded
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F56%252Fbc568338cf2dfc9f83cc283ed12f8deb%252Fpa%252FGJ33186_c45788deb6ed2ba0858baf452339240a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_c45788deb6ed2ba0858baf452339240a.jpg already downloaded
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F56%252Fbc568338cf2dfc9f83cc283ed12f8deb%252Fpa%252FGJ33186_d76f44bf4664e4a01fe72fa254435d9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_d76f44bf4664e4a01fe72fa254435d9d.jpg already downloaded
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F56%252Fbc568338cf2dfc9f83cc283ed12f8deb%252Fpa%252FGJ33186_3e37db84c4081c7fa8877ea2b0a982d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_3e37db84c4081c7fa8877ea2b0a982d3.jpg already downloaded
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F56%252Fbc568338cf2dfc9f83cc283ed12f8deb%252Fpa%252FGJ33186_f71f977a41c44650d72c8fd0c49ec213.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_f71f977a41c44650d72c8fd0c49ec213.jpg already downloaded
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F56%252Fbc568338cf2dfc9f83cc283ed12f8deb%252Fpa%252FGJ33186_8e87cf24c24e190b36a8d58569a0d2ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_8e87cf24c24e190b36a8d58569a0d2ce.jpg already downloaded
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F56%252Fbc568338cf2dfc9f83cc283ed12f8deb%252Fpa%252FGJ33186_838e3e109d1980221e14f9ea9dcb86bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_838e3e109d1980221e14f9ea9dcb86bc.jpg already downloaded
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F56%252Fbc568338cf2dfc9f83cc283ed12f8deb%252Fpa%252FGJ33186_fd24b8aa4fd263bdc8c2ff9cee9bdfaa.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_fd24b8aa4fd263bdc8c2ff9cee9bdfaa.jpg already downloaded
2026-03-28 09:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5050bb6b-6380-5594-88f1-a5521d3a6102, identifier: GJ33186
2026-03-28 09:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cfc290>
2026-03-28 09:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_7847ed21c1a2c710b3fd85f2e21ffe20.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_7847ed21c1a2c710b3fd85f2e21ffe20.jpg saved to cache
2026-03-28 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 736efd31-a741-58bc-ba47-075110b051d8
2026-03-28 09:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_648e9fbad74f3bbd28e3029db5b1b486.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:52 [auto1.it] INFO: Found listing with ID: LR48777
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR48777%27 HTTP/1.1" 200 None
2026-03-28 09:00:52 [auto1.it] INFO: Scrape type for LR48777: 0
2026-03-28 09:00:52 [auto1.it] INFO: Found listing with ID: GU75904
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU75904%27 HTTP/1.1" 200 None
2026-03-28 09:00:52 [auto1.it] INFO: Scrape type for GU75904: 0
2026-03-28 09:00:52 [auto1.it] INFO: Found listing with ID: WK43313
2026-03-28 09:00:52 [auto1.it] INFO: Found listing with ID: BK04078
2026-03-28 09:00:52 [auto1.it] INFO: Found listing with ID: XY04064
2026-03-28 09:00:52 [auto1.it] INFO: Found listing with ID: ML03059
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML03059%27 HTTP/1.1" 200 None
2026-03-28 09:00:52 [auto1.it] INFO: Scrape type for ML03059: 2
2026-03-28 09:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9efd03bc-1d36-5754-a24f-d07ca5f4010f with identifier: ML03059
2026-03-28 09:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9efd03bc-1d36-5754-a24f-d07ca5f4010f with scrape type 2
2026-03-28 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9efd03bc-1d36-5754-a24f-d07ca5f4010f with scrape type 2
2026-03-28 09:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9efd03bc-1d36-5754-a24f-d07ca5f4010f, identifier: ML03059
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F1b%252F441be1d9c8e06e9fd59c1c32823a0a23%252Fpa%252FHY41860_c931e44c5e7c69ab7512a688cd14e8a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_c931e44c5e7c69ab7512a688cd14e8a0.jpg not downloaded yet
2026-03-28 09:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5050bb6b-6380-5594-88f1-a5521d3a6102 with identifier: GJ33186
2026-03-28 09:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5050bb6b-6380-5594-88f1-a5521d3a6102 with identifier: GJ33186
2026-03-28 09:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5050bb6b-6380-5594-88f1-a5521d3a6102 with identifier: GJ33186 to the API
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GJ33186>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:32:05Z',
 'fuel_type': 'petrol',
 'id': '5050bb6b-6380-5594-88f1-a5521d3a6102',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ33186',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 80842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_d96c9b52a5f757bbdc1a96cd9c1e516f.jpg',
                'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_b0926274a3247c8c6f742b6e37104ea8.jpg',
                'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_a99834276d29bfcb0dd71efdd8b7aef9.jpg',
                'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_c45788deb6ed2ba0858baf452339240a.jpg',
                'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_d76f44bf4664e4a01fe72fa254435d9d.jpg',
                'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_3e37db84c4081c7fa8877ea2b0a982d3.jpg',
                'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_f71f977a41c44650d72c8fd0c49ec213.jpg',
                'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_8e87cf24c24e190b36a8d58569a0d2ce.jpg',
                'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_838e3e109d1980221e14f9ea9dcb86bc.jpg',
                'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_fd24b8aa4fd263bdc8c2ff9cee9bdfaa.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5050bb6b-6380-5594-88f1-a5521d3a6102/5050bb6b-6380-5594-88f1-a5521d3a6102_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_d96c9b52a5f757bbdc1a96cd9c1e516f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5050bb6b-6380-5594-88f1-a5521d3a6102/5050bb6b-6380-5594-88f1-a5521d3a6102_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_b0926274a3247c8c6f742b6e37104ea8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5050bb6b-6380-5594-88f1-a5521d3a6102/5050bb6b-6380-5594-88f1-a5521d3a6102_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_a99834276d29bfcb0dd71efdd8b7aef9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5050bb6b-6380-5594-88f1-a5521d3a6102/5050bb6b-6380-5594-88f1-a5521d3a6102_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_c45788deb6ed2ba0858baf452339240a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5050bb6b-6380-5594-88f1-a5521d3a6102/5050bb6b-6380-5594-88f1-a5521d3a6102_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_d76f44bf4664e4a01fe72fa254435d9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5050bb6b-6380-5594-88f1-a5521d3a6102/5050bb6b-6380-5594-88f1-a5521d3a6102_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_3e37db84c4081c7fa8877ea2b0a982d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5050bb6b-6380-5594-88f1-a5521d3a6102/5050bb6b-6380-5594-88f1-a5521d3a6102_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_f71f977a41c44650d72c8fd0c49ec213.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5050bb6b-6380-5594-88f1-a5521d3a6102/5050bb6b-6380-5594-88f1-a5521d3a6102_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_8e87cf24c24e190b36a8d58569a0d2ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5050bb6b-6380-5594-88f1-a5521d3a6102/5050bb6b-6380-5594-88f1-a5521d3a6102_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_838e3e109d1980221e14f9ea9dcb86bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5050bb6b-6380-5594-88f1-a5521d3a6102/5050bb6b-6380-5594-88f1-a5521d3a6102_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/56/bc568338cf2dfc9f83cc283ed12f8deb/pa/GJ33186_fd24b8aa4fd263bdc8c2ff9cee9bdfaa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Luxe',
 'transmission': 'manual',
 'trim': 'Luxe',
 'year': 2010}
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ33186%27 HTTP/1.1" 200 None
2026-03-28 09:00:52 [auto1.it] INFO: Saving data for GJ33186: {'created_time': 1774688452.677512, 'last_price_update_time': 1774688452.677523, 'auction_closing_time': 1774884725.0}
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GJ33186') HTTP/1.1" 204 0
2026-03-28 09:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9efd03bc-1d36-5754-a24f-d07ca5f4010f with identifier: ML03059
2026-03-28 09:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9efd03bc-1d36-5754-a24f-d07ca5f4010f with identifier: ML03059
2026-03-28 09:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9efd03bc-1d36-5754-a24f-d07ca5f4010f with identifier: ML03059 to the API
2026-03-28 09:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-28T16:32:20Z',
 'fuel_type': 'petrol',
 'id': '9efd03bc-1d36-5754-a24f-d07ca5f4010f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML03059',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 119311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-30',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.8 Turbo Quadrifoglio Verde',
 'transmission': 'manual',
 'trim': 'Quadrifoglio Verde',
 'year': 2019}
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML03059%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [auto1.it] INFO: Saving data for ML03059: {'auction_closing_time': 1774715540.0, 'created_time': 1773132058.440772, 'last_price_update_time': 1774688453.178934}
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ML03059') HTTP/1.1" 204 0
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_8ba1c8b05aafd1050ac9196a94b76864.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_8ba1c8b05aafd1050ac9196a94b76864.jpg not downloaded yet
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: CX68845
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX68845%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [auto1.it] INFO: Scrape type for CX68845: 0
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: XY56734
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY56734%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [auto1.it] INFO: Scrape type for XY56734: 0
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: RG91775
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG91775%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [auto1.it] INFO: Scrape type for RG91775: 0
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: MV49803
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV49803%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [auto1.it] INFO: Scrape type for MV49803: 0
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: SL86512
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: EE91281
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: DC62247
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: XR42745
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR42745%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [auto1.it] INFO: Scrape type for XR42745: 0
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: MF61265
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: UW72001
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: DS35304
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: VZ70094
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ70094%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [auto1.it] INFO: Scrape type for VZ70094: 0
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: CH35422
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH35422%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [auto1.it] INFO: Scrape type for CH35422: 0
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: PK48399
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: CG66796
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG66796%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [auto1.it] INFO: Scrape type for CG66796: 0
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: SH43932
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH43932%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [auto1.it] INFO: Scrape type for SH43932: 0
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: BG88310
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: GC37992
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: VD70212
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VD70212%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [auto1.it] INFO: Scrape type for VD70212: 0
2026-03-28 09:00:53 [auto1.it] INFO: Found listing with ID: RW64625
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW64625%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [auto1.it] INFO: Scrape type for RW64625: 0
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F1b%252F441be1d9c8e06e9fd59c1c32823a0a23%252Fpa%252FHY41860_8f3218011c609edf0dc0136cfba36004.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_8f3218011c609edf0dc0136cfba36004.jpg not downloaded yet
2026-03-28 09:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_8096d4bee469e42e5f147a19bfc51170.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_bce220cdf8faeeafd22a32bd2d7998f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_7f50b37f7cebc2de32f11dfc2d9a406e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_7f50b37f7cebc2de32f11dfc2d9a406e.jpg not downloaded yet
2026-03-28 09:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MT45417> (referer: https://www.auto1.com/v1/car-details-view/MT45417/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KA05234> (referer: https://www.auto1.com/v1/car-details-view/KA05234/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_309ba8e37ba6cc0a4e8d5b634eead64d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b570d0>
2026-03-28 09:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F17%252F06171d8cb3f743305f07cb856a6eaadb%252Fpa%252FAG82147_648e9fbad74f3bbd28e3029db5b1b486.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_648e9fbad74f3bbd28e3029db5b1b486.jpg saved to cache
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df2e52db-61dc-5a76-9435-08d746d02bef
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_b4902d837ae12ee62e4a363c3bab736c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_b4902d837ae12ee62e4a363c3bab736c.jpg not downloaded yet
2026-03-28 09:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_e3de91e16028db0e8d3c82a2f61bb432.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_288ee1712ff7ff4d48dbb6268c067d6b.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_4452385de47ed2d98479facef337bc1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_4452385de47ed2d98479facef337bc1c.jpg not downloaded yet
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_90e18b3e9a42f75568ba9dcc895698ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_90e18b3e9a42f75568ba9dcc895698ae.jpg not downloaded yet
2026-03-28 09:00:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a67e190>
2026-03-28 09:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_8096d4bee469e42e5f147a19bfc51170.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_8096d4bee469e42e5f147a19bfc51170.jpg saved to cache
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 736efd31-a741-58bc-ba47-075110b051d8
2026-03-28 09:00:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c1a8d0>
2026-03-28 09:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_bce220cdf8faeeafd22a32bd2d7998f0.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_bce220cdf8faeeafd22a32bd2d7998f0.jpg saved to cache
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 736efd31-a741-58bc-ba47-075110b051d8
2026-03-28 09:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_2d350aaeb5cb62e2c221f9be36ec6514.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d10eb72b-e95d-562e-9bb3-9568ada2d821 with identifier: MT45417
2026-03-28 09:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d10eb72b-e95d-562e-9bb3-9568ada2d821 with scrape type 1
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d10eb72b-e95d-562e-9bb3-9568ada2d821
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe3%252F02e3a0cab5251a65506a115b0ec10577%252Fpa%252FMT45417_62040cb44f6fbb166e1a6bf81d99525c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_62040cb44f6fbb166e1a6bf81d99525c.jpg already downloaded
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe3%252F02e3a0cab5251a65506a115b0ec10577%252Fpa%252FMT45417_a51e06dc8d47af1307f7abc3da5efa1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_a51e06dc8d47af1307f7abc3da5efa1c.jpg already downloaded
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe3%252F02e3a0cab5251a65506a115b0ec10577%252Fpa%252FMT45417_3edba138f31d7d4d3bca467647498d97.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_3edba138f31d7d4d3bca467647498d97.jpg already downloaded
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe3%252F02e3a0cab5251a65506a115b0ec10577%252Fpa%252FMT45417_739630477deda3995bc599528d2634de.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_739630477deda3995bc599528d2634de.jpg already downloaded
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe3%252F02e3a0cab5251a65506a115b0ec10577%252Fpa%252FMT45417_837b4e213d6f7886a5621cda6b6fd9f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_837b4e213d6f7886a5621cda6b6fd9f2.jpg already downloaded
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe3%252F02e3a0cab5251a65506a115b0ec10577%252Fpa%252FMT45417_5a6c957a05674649033b640770212f7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_5a6c957a05674649033b640770212f7b.jpg already downloaded
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe3%252F02e3a0cab5251a65506a115b0ec10577%252Fpa%252FMT45417_25dda274da8c555680cc965adbf3ded6.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_25dda274da8c555680cc965adbf3ded6.jpg already downloaded
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe3%252F02e3a0cab5251a65506a115b0ec10577%252Fpa%252FMT45417_1fd9cfe7a18e2fef304779b630bcee9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_1fd9cfe7a18e2fef304779b630bcee9d.jpg already downloaded
2026-03-28 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe3%252F02e3a0cab5251a65506a115b0ec10577%252Fpa%252FMT45417_5feca28c57091799002ae83d71fd35aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_5feca28c57091799002ae83d71fd35aa.jpg already downloaded
2026-03-28 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe3%252F02e3a0cab5251a65506a115b0ec10577%252Fpa%252FMT45417_1e73bc403946542671ef0ec670ac4544.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_1e73bc403946542671ef0ec670ac4544.jpg already downloaded
2026-03-28 09:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d10eb72b-e95d-562e-9bb3-9568ada2d821, identifier: MT45417
2026-03-28 09:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ed38df8-2ef2-584e-bfcc-cb149feefcfc with identifier: KA05234
2026-03-28 09:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ed38df8-2ef2-584e-bfcc-cb149feefcfc with scrape type 1
2026-03-28 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ed38df8-2ef2-584e-bfcc-cb149feefcfc
2026-03-28 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_9d0cf16fbd97e9ce19c4348f5489de7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_9d0cf16fbd97e9ce19c4348f5489de7e.jpg not downloaded yet
2026-03-28 09:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6c9610>
2026-03-28 09:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F17%252F06171d8cb3f743305f07cb856a6eaadb%252Fpa%252FAG82147_309ba8e37ba6cc0a4e8d5b634eead64d.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_309ba8e37ba6cc0a4e8d5b634eead64d.jpg saved to cache
2026-03-28 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df2e52db-61dc-5a76-9435-08d746d02bef
2026-03-28 09:00:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df2e52db-61dc-5a76-9435-08d746d02bef, skipping ID generation
2026-03-28 09:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df2e52db-61dc-5a76-9435-08d746d02bef with scrape type 1
2026-03-28 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df2e52db-61dc-5a76-9435-08d746d02bef sending to next pipeline
2026-03-28 09:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: df2e52db-61dc-5a76-9435-08d746d02bef, identifier: AG82147
2026-03-28 09:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_f9db332936362d856abb83c029eb4310.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_f2f981df5630df591937ed77aee9bf40.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d10eb72b-e95d-562e-9bb3-9568ada2d821 with identifier: MT45417
2026-03-28 09:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d10eb72b-e95d-562e-9bb3-9568ada2d821 with identifier: MT45417
2026-03-28 09:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d10eb72b-e95d-562e-9bb3-9568ada2d821 with identifier: MT45417 to the API
2026-03-28 09:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MT45417>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:01Z',
 'fuel_type': 'diesel',
 'id': 'd10eb72b-e95d-562e-9bb3-9568ada2d821',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT45417',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 147278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_62040cb44f6fbb166e1a6bf81d99525c.jpg',
                'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_a51e06dc8d47af1307f7abc3da5efa1c.jpg',
                'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_3edba138f31d7d4d3bca467647498d97.jpg',
                'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_739630477deda3995bc599528d2634de.jpg',
                'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_837b4e213d6f7886a5621cda6b6fd9f2.jpg',
                'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_5a6c957a05674649033b640770212f7b.jpg',
                'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_25dda274da8c555680cc965adbf3ded6.jpg',
                'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_1fd9cfe7a18e2fef304779b630bcee9d.jpg',
                'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_5feca28c57091799002ae83d71fd35aa.jpg',
                'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_1e73bc403946542671ef0ec670ac4544.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d10eb72b-e95d-562e-9bb3-9568ada2d821/d10eb72b-e95d-562e-9bb3-9568ada2d821_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_62040cb44f6fbb166e1a6bf81d99525c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d10eb72b-e95d-562e-9bb3-9568ada2d821/d10eb72b-e95d-562e-9bb3-9568ada2d821_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3218618,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_a51e06dc8d47af1307f7abc3da5efa1c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d10eb72b-e95d-562e-9bb3-9568ada2d821/d10eb72b-e95d-562e-9bb3-9568ada2d821_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2999032,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_3edba138f31d7d4d3bca467647498d97.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d10eb72b-e95d-562e-9bb3-9568ada2d821/d10eb72b-e95d-562e-9bb3-9568ada2d821_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_739630477deda3995bc599528d2634de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d10eb72b-e95d-562e-9bb3-9568ada2d821/d10eb72b-e95d-562e-9bb3-9568ada2d821_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3040022,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_837b4e213d6f7886a5621cda6b6fd9f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d10eb72b-e95d-562e-9bb3-9568ada2d821/d10eb72b-e95d-562e-9bb3-9568ada2d821_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_5a6c957a05674649033b640770212f7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d10eb72b-e95d-562e-9bb3-9568ada2d821/d10eb72b-e95d-562e-9bb3-9568ada2d821_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2312846,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_25dda274da8c555680cc965adbf3ded6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d10eb72b-e95d-562e-9bb3-9568ada2d821/d10eb72b-e95d-562e-9bb3-9568ada2d821_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_1fd9cfe7a18e2fef304779b630bcee9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d10eb72b-e95d-562e-9bb3-9568ada2d821/d10eb72b-e95d-562e-9bb3-9568ada2d821_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3398303,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_5feca28c57091799002ae83d71fd35aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d10eb72b-e95d-562e-9bb3-9568ada2d821/d10eb72b-e95d-562e-9bb3-9568ada2d821_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3079435,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e3/02e3a0cab5251a65506a115b0ec10577/pa/MT45417_1e73bc403946542671ef0ec670ac4544.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2017}
2026-03-28 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT45417%27 HTTP/1.1" 200 None
2026-03-28 09:00:54 [auto1.it] INFO: Saving data for MT45417: {'created_time': 1774688454.65059, 'last_price_update_time': 1774688454.650601, 'auction_closing_time': 1774884181.0}
2026-03-28 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MT45417') HTTP/1.1" 204 0
2026-03-28 09:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: df2e52db-61dc-5a76-9435-08d746d02bef with identifier: AG82147
2026-03-28 09:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: df2e52db-61dc-5a76-9435-08d746d02bef with identifier: AG82147
2026-03-28 09:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: df2e52db-61dc-5a76-9435-08d746d02bef with identifier: AG82147 to the API
2026-03-28 09:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_309ba8e37ba6cc0a4e8d5b634eead64d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:26:54Z',
 'fuel_type': 'diesel',
 'id': 'df2e52db-61dc-5a76-9435-08d746d02bef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG82147',
 'listing': 'auction',
 'location': 'IT, Valmontone (RM)',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 297907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_c88f308dee5133ea9686efaf1bbb4f2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_309ba8e37ba6cc0a4e8d5b634eead64d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_648e9fbad74f3bbd28e3029db5b1b486.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_baf8727c0d811603040f676fc6f1f096.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_5d83dd28622cf999bed76c69b51dd6f4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500L 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG82147%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Saving data for AG82147: {'created_time': 1774688455.139783, 'last_price_update_time': 1774688455.139794, 'auction_closing_time': 1774884414.0}
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AG82147') HTTP/1.1" 204 0
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_9a1357871cd016e21b6b4ef27fcdc7b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_9a1357871cd016e21b6b4ef27fcdc7b0.jpg not downloaded yet
2026-03-28 09:00:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a67da50>
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_e3de91e16028db0e8d3c82a2f61bb432.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_e3de91e16028db0e8d3c82a2f61bb432.jpg saved to cache
2026-03-28 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 736efd31-a741-58bc-ba47-075110b051d8
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1c599290>
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f2c3dce-5942-5608-8b87-e8147630bbdb/9f2c3dce-5942-5608-8b87-e8147630bbdb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F1b%252F441be1d9c8e06e9fd59c1c32823a0a23%252Fpa%252FHY41860_288ee1712ff7ff4d48dbb6268c067d6b.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_288ee1712ff7ff4d48dbb6268c067d6b.jpg saved to cache
2026-03-28 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f2c3dce-5942-5608-8b87-e8147630bbdb
2026-03-28 09:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_59f60eedf61c9a7ec514c7604ec9f867.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_c931e44c5e7c69ab7512a688cd14e8a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_451ee9c7493215f595b68dbdac0566db.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_451ee9c7493215f595b68dbdac0566db.jpg not downloaded yet
2026-03-28 09:00:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6a33d0>
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_2d350aaeb5cb62e2c221f9be36ec6514.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_2d350aaeb5cb62e2c221f9be36ec6514.jpg saved to cache
2026-03-28 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 736efd31-a741-58bc-ba47-075110b051d8
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c2ffd0>
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f2c3dce-5942-5608-8b87-e8147630bbdb/9f2c3dce-5942-5608-8b87-e8147630bbdb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F1b%252F441be1d9c8e06e9fd59c1c32823a0a23%252Fpa%252FHY41860_f9db332936362d856abb83c029eb4310.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_f9db332936362d856abb83c029eb4310.jpg saved to cache
2026-03-28 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f2c3dce-5942-5608-8b87-e8147630bbdb
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c9f8d0>
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_f2f981df5630df591937ed77aee9bf40.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_f2f981df5630df591937ed77aee9bf40.jpg saved to cache
2026-03-28 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 186bb506-7a70-5713-b211-f145610d42d4
2026-03-28 09:00:55 [auto1.it] INFO: Channel: 24h | Page: 6 | totalHits: 3430 | hits on page: 40
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_82d0ece9b7a2054aa8bb765093a2a95d.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_82d0ece9b7a2054aa8bb765093a2a95d.jpg not downloaded yet
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: JF27717
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF27717%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for JF27717: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: UM17769
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: CK01527
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK01527%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for CK01527: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: BE55711
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE55711%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for BE55711: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: DL42775
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: YG18213
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: KD20323
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: FY53013
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: LR95961
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR95961%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for LR95961: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: XA66823
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XA66823%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for XA66823: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: CA11225
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: VG20766
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG20766%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for VG20766: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: ST39288
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST39288%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for ST39288: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: YF20115
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF20115%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for YF20115: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: LG27793
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: GT16338
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: NT95206
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT95206%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for NT95206: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: YD65292
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD65292%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for YD65292: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: FW75637
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW75637%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for FW75637: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: KR30691
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR30691%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for KR30691: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: YP66201
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP66201%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for YP66201: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: WV42889
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: BD88975
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: XS44510
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: ZA06304
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA06304%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for ZA06304: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: PB14031
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB14031%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for PB14031: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: GK30834
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK30834%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for GK30834: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: DF71809
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF71809%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for DF71809: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: LM41534
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: WV91656
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: ML96661
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML96661%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for ML96661: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: FU47372
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU47372%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for FU47372: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: CS14469
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: PE22085
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE22085%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for PE22085: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: DW89993
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: LE38713
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE38713%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for LE38713: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: VC63991
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC63991%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for VC63991: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: RC58822
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC58822%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for RC58822: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: TV19217
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV19217%27 HTTP/1.1" 200 None
2026-03-28 09:00:55 [auto1.it] INFO: Scrape type for TV19217: 0
2026-03-28 09:00:55 [auto1.it] INFO: Found listing with ID: SE41207
2026-03-28 09:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_0df9ab565899c42233172beaefb97161.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_8f3218011c609edf0dc0136cfba36004.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab2a1e5f10>
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_59f60eedf61c9a7ec514c7604ec9f867.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_59f60eedf61c9a7ec514c7604ec9f867.jpg saved to cache
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 736efd31-a741-58bc-ba47-075110b051d8
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6e1190>
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f2c3dce-5942-5608-8b87-e8147630bbdb/9f2c3dce-5942-5608-8b87-e8147630bbdb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F1b%252F441be1d9c8e06e9fd59c1c32823a0a23%252Fpa%252FHY41860_c931e44c5e7c69ab7512a688cd14e8a0.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_c931e44c5e7c69ab7512a688cd14e8a0.jpg saved to cache
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f2c3dce-5942-5608-8b87-e8147630bbdb
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_de82138163bad1f36e18e38137885e71.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_de82138163bad1f36e18e38137885e71.jpg not downloaded yet
2026-03-28 09:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_90e18b3e9a42f75568ba9dcc895698ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_2ddbe13ffe0b6f638f46c9c874fc6948.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_13843b4a445e6744fa8bf9e61cd9f39d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_7d5ad54d986c9e8c61b8ac7d7bbad16f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_7d5ad54d986c9e8c61b8ac7d7bbad16f.jpg not downloaded yet
2026-03-28 09:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_2fdf2edb228f081f140776c4f8ee2808.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_3fa809fdc37160275b8f8ed204391d6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_3fa809fdc37160275b8f8ed204391d6a.jpg not downloaded yet
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6e1dd0>
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_0df9ab565899c42233172beaefb97161.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_0df9ab565899c42233172beaefb97161.jpg saved to cache
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 186bb506-7a70-5713-b211-f145610d42d4
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b37f50>
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f2c3dce-5942-5608-8b87-e8147630bbdb/9f2c3dce-5942-5608-8b87-e8147630bbdb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F1b%252F441be1d9c8e06e9fd59c1c32823a0a23%252Fpa%252FHY41860_8f3218011c609edf0dc0136cfba36004.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_8f3218011c609edf0dc0136cfba36004.jpg saved to cache
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f2c3dce-5942-5608-8b87-e8147630bbdb
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_b2092ecd3b624d03423e8ff949275098.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_b2092ecd3b624d03423e8ff949275098.jpg not downloaded yet
2026-03-28 09:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_451ee9c7493215f595b68dbdac0566db.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_4452385de47ed2d98479facef337bc1c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_7f50b37f7cebc2de32f11dfc2d9a406e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_3972e44df8a84ea5fd71d6bc8513c07e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_c29660cfa12b9e1a074f6aa2841897b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_c29660cfa12b9e1a074f6aa2841897b6.jpg not downloaded yet
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a7adb10>
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_90e18b3e9a42f75568ba9dcc895698ae.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_90e18b3e9a42f75568ba9dcc895698ae.jpg saved to cache
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 186bb506-7a70-5713-b211-f145610d42d4
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b37110>
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_2ddbe13ffe0b6f638f46c9c874fc6948.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_2ddbe13ffe0b6f638f46c9c874fc6948.jpg saved to cache
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 186bb506-7a70-5713-b211-f145610d42d4
2026-03-28 09:00:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c61c90>
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_13843b4a445e6744fa8bf9e61cd9f39d.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_13843b4a445e6744fa8bf9e61cd9f39d.jpg saved to cache
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 736efd31-a741-58bc-ba47-075110b051d8
2026-03-28 09:00:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a70f850>
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb1%252F57b15e3ab171cad9281550145b65438f%252Fpa%252FVV69855_2fdf2edb228f081f140776c4f8ee2808.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_2fdf2edb228f081f140776c4f8ee2808.jpg saved to cache
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 736efd31-a741-58bc-ba47-075110b051d8
2026-03-28 09:00:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 736efd31-a741-58bc-ba47-075110b051d8, skipping ID generation
2026-03-28 09:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 736efd31-a741-58bc-ba47-075110b051d8 with scrape type 1
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 736efd31-a741-58bc-ba47-075110b051d8 sending to next pipeline
2026-03-28 09:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 736efd31-a741-58bc-ba47-075110b051d8, identifier: VV69855
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_3a22acfe749a329caddb139d520fca46.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_3a22acfe749a329caddb139d520fca46.jpg not downloaded yet
2026-03-28 09:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 736efd31-a741-58bc-ba47-075110b051d8 with identifier: VV69855
2026-03-28 09:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 09:00:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 736efd31-a741-58bc-ba47-075110b051d8 with identifier: VV69855
2026-03-28 09:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 736efd31-a741-58bc-ba47-075110b051d8 with identifier: VV69855 to the API
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_2fdf2edb228f081f140776c4f8ee2808.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:41:56Z',
 'fuel_type': 'petrol',
 'id': '736efd31-a741-58bc-ba47-075110b051d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV69855',
 'listing': 'auction',
 'location': 'IT, Rovato',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 188559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2188182,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_bce220cdf8faeeafd22a32bd2d7998f0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2179449,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_8096d4bee469e42e5f147a19bfc51170.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_7847ed21c1a2c710b3fd85f2e21ffe20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2106953,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_e3de91e16028db0e8d3c82a2f61bb432.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_e9091a446f964009b0c31a18b7200b92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2377112,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_2d350aaeb5cb62e2c221f9be36ec6514.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_3382cbcbc9eb7e0aa1f1ac62b95b35c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2332965,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_2fdf2edb228f081f140776c4f8ee2808.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2280877,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_13843b4a445e6744fa8bf9e61cd9f39d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736efd31-a741-58bc-ba47-075110b051d8/736efd31-a741-58bc-ba47-075110b051d8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2314364,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/b1/57b15e3ab171cad9281550145b65438f/pa/VV69855_59f60eedf61c9a7ec514c7604ec9f867.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 Sport FWD',
 'transmission': 'manual',
 'trim': 'Sport FWD',
 'year': 2016}
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV69855%27 HTTP/1.1" 200 None
2026-03-28 09:00:57 [auto1.it] INFO: Saving data for VV69855: {'created_time': 1774688457.501142, 'last_price_update_time': 1774688457.501153, 'auction_closing_time': 1774885316.0}
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VV69855') HTTP/1.1" 204 0
2026-03-28 09:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_82d0ece9b7a2054aa8bb765093a2a95d.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_9d0cf16fbd97e9ce19c4348f5489de7e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_9a1357871cd016e21b6b4ef27fcdc7b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_a44ed01b8fd950a2efbd4ba8b90da3be.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_de82138163bad1f36e18e38137885e71.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a795910>
2026-03-28 09:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_451ee9c7493215f595b68dbdac0566db.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_451ee9c7493215f595b68dbdac0566db.jpg saved to cache
2026-03-28 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ed38df8-2ef2-584e-bfcc-cb149feefcfc
2026-03-28 09:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1c855b50>
2026-03-28 09:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_4452385de47ed2d98479facef337bc1c.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_4452385de47ed2d98479facef337bc1c.jpg saved to cache
2026-03-28 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 186bb506-7a70-5713-b211-f145610d42d4
2026-03-28 09:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1c854e90>
2026-03-28 09:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_7f50b37f7cebc2de32f11dfc2d9a406e.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_7f50b37f7cebc2de32f11dfc2d9a406e.jpg saved to cache
2026-03-28 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 186bb506-7a70-5713-b211-f145610d42d4
2026-03-28 09:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6de8d0>
2026-03-28 09:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f2c3dce-5942-5608-8b87-e8147630bbdb/9f2c3dce-5942-5608-8b87-e8147630bbdb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F1b%252F441be1d9c8e06e9fd59c1c32823a0a23%252Fpa%252FHY41860_3972e44df8a84ea5fd71d6bc8513c07e.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_3972e44df8a84ea5fd71d6bc8513c07e.jpg saved to cache
2026-03-28 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f2c3dce-5942-5608-8b87-e8147630bbdb
2026-03-28 09:00:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f2c3dce-5942-5608-8b87-e8147630bbdb, skipping ID generation
2026-03-28 09:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f2c3dce-5942-5608-8b87-e8147630bbdb with scrape type 1
2026-03-28 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f2c3dce-5942-5608-8b87-e8147630bbdb sending to next pipeline
2026-03-28 09:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9f2c3dce-5942-5608-8b87-e8147630bbdb, identifier: HY41860
2026-03-28 09:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9f2c3dce-5942-5608-8b87-e8147630bbdb with identifier: HY41860
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 09:00:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9f2c3dce-5942-5608-8b87-e8147630bbdb with identifier: HY41860
2026-03-28 09:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9f2c3dce-5942-5608-8b87-e8147630bbdb with identifier: HY41860 to the API
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_3972e44df8a84ea5fd71d6bc8513c07e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:06:42Z',
 'fuel_type': 'gas',
 'id': '9f2c3dce-5942-5608-8b87-e8147630bbdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY41860',
 'listing': 'auction',
 'location': 'IT, Genova',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 200947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f2c3dce-5942-5608-8b87-e8147630bbdb/9f2c3dce-5942-5608-8b87-e8147630bbdb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_288ee1712ff7ff4d48dbb6268c067d6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f2c3dce-5942-5608-8b87-e8147630bbdb/9f2c3dce-5942-5608-8b87-e8147630bbdb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_3972e44df8a84ea5fd71d6bc8513c07e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f2c3dce-5942-5608-8b87-e8147630bbdb/9f2c3dce-5942-5608-8b87-e8147630bbdb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_f9db332936362d856abb83c029eb4310.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f2c3dce-5942-5608-8b87-e8147630bbdb/9f2c3dce-5942-5608-8b87-e8147630bbdb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23852,
             'Height': 255,
             'OriginUrl': 'https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_c931e44c5e7c69ab7512a688cd14e8a0.jpg',
             'Width': 340},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f2c3dce-5942-5608-8b87-e8147630bbdb/9f2c3dce-5942-5608-8b87-e8147630bbdb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/1b/441be1d9c8e06e9fd59c1c32823a0a23/pa/HY41860_8f3218011c609edf0dc0136cfba36004.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic GPL',
 'transmission': 'manual',
 'trim': 'Dynamic GPL',
 'year': 2009}
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY41860%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Saving data for HY41860: {'created_time': 1774688458.392944, 'last_price_update_time': 1774688458.392955, 'auction_closing_time': 1774883202.0}
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HY41860') HTTP/1.1" 204 0
2026-03-28 09:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_067799b861078ffd940af1a7743f9b2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_3fa809fdc37160275b8f8ed204391d6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_7d5ad54d986c9e8c61b8ac7d7bbad16f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WL53741> (referer: https://www.auto1.com/v1/car-details-view/WL53741/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_c29660cfa12b9e1a074f6aa2841897b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_3a22acfe749a329caddb139d520fca46.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_b2092ecd3b624d03423e8ff949275098.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cff0d0>
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_82d0ece9b7a2054aa8bb765093a2a95d.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_82d0ece9b7a2054aa8bb765093a2a95d.jpg saved to cache
2026-03-28 09:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ed38df8-2ef2-584e-bfcc-cb149feefcfc
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19caa150>
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_9d0cf16fbd97e9ce19c4348f5489de7e.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_9d0cf16fbd97e9ce19c4348f5489de7e.jpg saved to cache
2026-03-28 09:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ed38df8-2ef2-584e-bfcc-cb149feefcfc
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a7c4410>
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_9a1357871cd016e21b6b4ef27fcdc7b0.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_9a1357871cd016e21b6b4ef27fcdc7b0.jpg saved to cache
2026-03-28 09:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ed38df8-2ef2-584e-bfcc-cb149feefcfc
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19e16a90>
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_a44ed01b8fd950a2efbd4ba8b90da3be.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_a44ed01b8fd950a2efbd4ba8b90da3be.jpg saved to cache
2026-03-28 09:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 186bb506-7a70-5713-b211-f145610d42d4
2026-03-28 09:00:58 [auto1.it] INFO: Channel: 24h | Page: 7 | totalHits: 3430 | hits on page: 40
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cd5c10>
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_de82138163bad1f36e18e38137885e71.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_de82138163bad1f36e18e38137885e71.jpg saved to cache
2026-03-28 09:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ed38df8-2ef2-584e-bfcc-cb149feefcfc
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: XJ91749
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: KC88615
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC88615%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for KC88615: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: WH06276
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: MC37024
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC37024%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for MC37024: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: BG56608
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG56608%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for BG56608: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: MK89859
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: HK94664
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK94664%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for HK94664: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: EU22988
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU22988%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for EU22988: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: NC70942
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC70942%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for NC70942: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: EP92787
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP92787%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for EP92787: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: LY59830
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: DC45028
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: EZ48642
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: UZ24263
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ24263%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for UZ24263: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: GX06628
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX06628%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for GX06628: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: VE78842
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: NY14439
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: VS64028
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: VC44140
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: GM86126
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: UZ24825
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: AF82865
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: SP92634
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP92634%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for SP92634: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: TE63682
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE63682%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for TE63682: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: BM81624
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM81624%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for BM81624: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: NH43496
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: EA01754
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: FD12268
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD12268%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for FD12268: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: GA58857
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: XK51996
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK51996%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for XK51996: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: UN52705
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: HG71843
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: CE81369
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: XJ87155
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ87155%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for XJ87155: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: CE17965
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE17965%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for CE17965: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: PJ77887
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PJ77887%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for PJ77887: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: YF31693
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: ZR65304
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: AA46193
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA46193%27 HTTP/1.1" 200 None
2026-03-28 09:00:58 [auto1.it] INFO: Scrape type for AA46193: 0
2026-03-28 09:00:58 [auto1.it] INFO: Found listing with ID: XC79515
2026-03-28 09:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_11d7a6d595b0397b43a77841a97bb74c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:00:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c16c50>
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F75%252Fff751eb15ff507c8ba6747439375c3c3%252Fpa%252FWY26414_067799b861078ffd940af1a7743f9b2b.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_067799b861078ffd940af1a7743f9b2b.jpg saved to cache
2026-03-28 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-03-28 09:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c671b85-f866-5acd-8d39-772f2c4e4d58, skipping ID generation
2026-03-28 09:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c671b85-f866-5acd-8d39-772f2c4e4d58 with scrape type 1
2026-03-28 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c671b85-f866-5acd-8d39-772f2c4e4d58 sending to next pipeline
2026-03-28 09:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c671b85-f866-5acd-8d39-772f2c4e4d58, identifier: WY26414
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1c853d90>
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_3fa809fdc37160275b8f8ed204391d6a.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_3fa809fdc37160275b8f8ed204391d6a.jpg saved to cache
2026-03-28 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ed38df8-2ef2-584e-bfcc-cb149feefcfc
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6cb810>
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_7d5ad54d986c9e8c61b8ac7d7bbad16f.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_7d5ad54d986c9e8c61b8ac7d7bbad16f.jpg saved to cache
2026-03-28 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ed38df8-2ef2-584e-bfcc-cb149feefcfc
2026-03-28 09:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2015853c-9978-555b-9f1e-1d07a5343122 with identifier: WL53741
2026-03-28 09:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2015853c-9978-555b-9f1e-1d07a5343122 with scrape type 1
2026-03-28 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2015853c-9978-555b-9f1e-1d07a5343122
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F97%252F2897de8320addb1ef2e706bb0d696035%252Fpa%252FWL53741_2badc356b0498936ca717a85d95546ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_2badc356b0498936ca717a85d95546ba.jpg not downloaded yet
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6cfa10>
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_c29660cfa12b9e1a074f6aa2841897b6.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_c29660cfa12b9e1a074f6aa2841897b6.jpg saved to cache
2026-03-28 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1ed38df8-2ef2-584e-bfcc-cb149feefcfc
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19dda750>
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_3a22acfe749a329caddb139d520fca46.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_3a22acfe749a329caddb139d520fca46.jpg saved to cache
2026-03-28 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ed38df8-2ef2-584e-bfcc-cb149feefcfc
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c34390>
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd6%252F62d61a33d68188f03b870eca69ad7894%252Fpa%252FKA05234_b2092ecd3b624d03423e8ff949275098.jpg') HTTP/1.1" 204 0
2026-03-28 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_b2092ecd3b624d03423e8ff949275098.jpg saved to cache
2026-03-28 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ed38df8-2ef2-584e-bfcc-cb149feefcfc
2026-03-28 09:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ed38df8-2ef2-584e-bfcc-cb149feefcfc, skipping ID generation
2026-03-28 09:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ed38df8-2ef2-584e-bfcc-cb149feefcfc with scrape type 1
2026-03-28 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ed38df8-2ef2-584e-bfcc-cb149feefcfc sending to next pipeline
2026-03-28 09:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1ed38df8-2ef2-584e-bfcc-cb149feefcfc, identifier: KA05234
2026-03-28 09:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_dc59c3886c151d54de40a5e325c17cdc.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_b51c0e2860881b47fa756377c8b8e248.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_72cbc59b709c1f6980e89a4bdca31296.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c671b85-f866-5acd-8d39-772f2c4e4d58 with identifier: WY26414
2026-03-28 09:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c671b85-f866-5acd-8d39-772f2c4e4d58 with identifier: WY26414
2026-03-28 09:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4c671b85-f866-5acd-8d39-772f2c4e4d58 with identifier: WY26414 to the API
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_067799b861078ffd940af1a7743f9b2b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:47Z',
 'fuel_type': 'petrol',
 'id': '4c671b85-f866-5acd-8d39-772f2c4e4d58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY26414',
 'listing': 'auction',
 'location': 'IT, Legnano',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 20350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2201306,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_434785d63e95b6abcca047e84b7a1972.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1972204,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_74675b61766b7963603e48846c55349e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2004433,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_ddec2bacb879432ba7427bc6934e763f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1747891,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_067799b861078ffd940af1a7743f9b2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1992611,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_e5d7256f3814c56e551512236205f30c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2067848,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_c8a1917cc0bdc82378f6d7420e4a6e7a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1807468,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_12e0ea780bdb80bb12f76fe3b0ece8a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2112801,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_1fa8bb3fedd56fe4fab1962b33dcc680.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_c9d7aac908d7711e5a9b130540c5cdf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2030794,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_7e021cab6c2ac7635ed477b3e7e638a2.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid XLine 2WD',
 'transmission': 'automatic',
 'trim': 'XLine 2WD',
 'year': 2023}
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY26414%27 HTTP/1.1" 200 None
2026-03-28 09:00:59 [auto1.it] INFO: Saving data for WY26414: {'created_time': 1774688459.852184, 'last_price_update_time': 1774688459.852196, 'auction_closing_time': 1774883147.0}
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WY26414') HTTP/1.1" 204 0
2026-03-28 09:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1ed38df8-2ef2-584e-bfcc-cb149feefcfc with identifier: KA05234
2026-03-28 09:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1ed38df8-2ef2-584e-bfcc-cb149feefcfc with identifier: KA05234
2026-03-28 09:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1ed38df8-2ef2-584e-bfcc-cb149feefcfc with identifier: KA05234 to the API
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_b2092ecd3b624d03423e8ff949275098.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.2L',
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:30:23Z',
 'fuel_type': 'diesel',
 'id': '1ed38df8-2ef2-584e-bfcc-cb149feefcfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA05234',
 'listing': 'auction',
 'location': 'IT, Beinasco',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 89289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_9d0cf16fbd97e9ce19c4348f5489de7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_9a1357871cd016e21b6b4ef27fcdc7b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_451ee9c7493215f595b68dbdac0566db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_82d0ece9b7a2054aa8bb765093a2a95d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_de82138163bad1f36e18e38137885e71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_7d5ad54d986c9e8c61b8ac7d7bbad16f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_3fa809fdc37160275b8f8ed204391d6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_b2092ecd3b624d03423e8ff949275098.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_c29660cfa12b9e1a074f6aa2841897b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed38df8-2ef2-584e-bfcc-cb149feefcfc/1ed38df8-2ef2-584e-bfcc-cb149feefcfc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d6/62d61a33d68188f03b870eca69ad7894/pa/KA05234_3a22acfe749a329caddb139d520fca46.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Cherokee 2.2 M-Jet Limited 4x4',
 'transmission': 'automatic',
 'trim': 'Limited 4x4',
 'year': 2019}
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA05234%27 HTTP/1.1" 200 None
2026-03-28 09:01:00 [auto1.it] INFO: Saving data for KA05234: {'created_time': 1774688460.319661, 'last_price_update_time': 1774688460.319672, 'auction_closing_time': 1774884623.0}
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KA05234') HTTP/1.1" 204 0
2026-03-28 09:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_f4665a75955a80322ff3887891e6f93e.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_9435cb2f27f8a2f234a223578db648ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F97%252F2897de8320addb1ef2e706bb0d696035%252Fpa%252FWL53741_a0d8cd38aa2a575b919b24a9ea0ffb40.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_a0d8cd38aa2a575b919b24a9ea0ffb40.jpg not downloaded yet
2026-03-28 09:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_09f122d7b78b758f670d8664a71cc588.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FV07755> (referer: https://www.auto1.com/v1/car-details-view/FV07755/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6c8f90>
2026-03-28 09:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_11d7a6d595b0397b43a77841a97bb74c.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_11d7a6d595b0397b43a77841a97bb74c.jpg saved to cache
2026-03-28 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 186bb506-7a70-5713-b211-f145610d42d4
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F97%252F2897de8320addb1ef2e706bb0d696035%252Fpa%252FWL53741_afc949c1f2d63faa4da72b4d01784963.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_afc949c1f2d63faa4da72b4d01784963.jpg not downloaded yet
2026-03-28 09:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b3c6d0>
2026-03-28 09:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_dc59c3886c151d54de40a5e325c17cdc.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_dc59c3886c151d54de40a5e325c17cdc.jpg saved to cache
2026-03-28 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 272a2abb-ea00-5227-86d6-27f128f3fc71
2026-03-28 09:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b6b1d0>
2026-03-28 09:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1828b9e-02e9-519e-b209-ff64bf547566/a1828b9e-02e9-519e-b209-ff64bf547566_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F7b%252F817b2d3f725286cfe5c1d0b8777b2bb0%252Fpa%252FZU87038_b51c0e2860881b47fa756377c8b8e248.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_b51c0e2860881b47fa756377c8b8e248.jpg saved to cache
2026-03-28 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1828b9e-02e9-519e-b209-ff64bf547566
2026-03-28 09:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1c7e9cd0>
2026-03-28 09:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F60%252F2b60c28ff727cb495bf853fa3a014720%252Fpa%252FFD69176_72cbc59b709c1f6980e89a4bdca31296.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_72cbc59b709c1f6980e89a4bdca31296.jpg saved to cache
2026-03-28 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 272a2abb-ea00-5227-86d6-27f128f3fc71
2026-03-28 09:01:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 272a2abb-ea00-5227-86d6-27f128f3fc71, skipping ID generation
2026-03-28 09:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 272a2abb-ea00-5227-86d6-27f128f3fc71 with scrape type 1
2026-03-28 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 272a2abb-ea00-5227-86d6-27f128f3fc71 sending to next pipeline
2026-03-28 09:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 272a2abb-ea00-5227-86d6-27f128f3fc71, identifier: FD69176
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F97%252F2897de8320addb1ef2e706bb0d696035%252Fpa%252FWL53741_827561e5cfb410691af3a34d7ca89582.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_827561e5cfb410691af3a34d7ca89582.jpg not downloaded yet
2026-03-28 09:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 272a2abb-ea00-5227-86d6-27f128f3fc71 with identifier: FD69176
2026-03-28 09:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 272a2abb-ea00-5227-86d6-27f128f3fc71 with identifier: FD69176
2026-03-28 09:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 272a2abb-ea00-5227-86d6-27f128f3fc71 with identifier: FD69176 to the API
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_72cbc59b709c1f6980e89a4bdca31296.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:09Z',
 'fuel_type': 'diesel',
 'id': '272a2abb-ea00-5227-86d6-27f128f3fc71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD69176',
 'listing': 'auction',
 'location': 'IT, Pavia',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 37673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_dc59c3886c151d54de40a5e325c17cdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_72cbc59b709c1f6980e89a4bdca31296.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_5e5feffbacae790f025705a63bb9c6bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_3ee46cecd1d0d29af1db23df24f95b9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_08c49b390c972e648a9b0bf1ada35642.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_e850e1c8bd8a36a602c142442f0cf471.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_cf9b2088ed14dc010d264446b2c2321f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_ab2521d99b9a1451668644b14cd31d94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_8529ba88f5d1e213c7b553b877b006f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_272a2abb-ea00-5227-86d6-27f128f3fc71/272a2abb-ea00-5227-86d6-27f128f3fc71_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/60/2b60c28ff727cb495bf853fa3a014720/pa/FD69176_aef8c987645b2006b0dcd05eef97d988.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD69176%27 HTTP/1.1" 200 None
2026-03-28 09:01:01 [auto1.it] INFO: Saving data for FD69176: {'created_time': 1774688461.034196, 'last_price_update_time': 1774688461.034209, 'auction_closing_time': 1774884009.0}
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FD69176') HTTP/1.1" 204 0
2026-03-28 09:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_8e5353670ebf594eb3acbfd1a1872114.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_2badc356b0498936ca717a85d95546ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F97%252F2897de8320addb1ef2e706bb0d696035%252Fpa%252FWL53741_f5ce784fc8b477f4e4f43461f4cb703b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_f5ce784fc8b477f4e4f43461f4cb703b.jpg not downloaded yet
2026-03-28 09:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT33269/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SK62476/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c82e90>
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1828b9e-02e9-519e-b209-ff64bf547566/a1828b9e-02e9-519e-b209-ff64bf547566_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F7b%252F817b2d3f725286cfe5c1d0b8777b2bb0%252Fpa%252FZU87038_f4665a75955a80322ff3887891e6f93e.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_f4665a75955a80322ff3887891e6f93e.jpg saved to cache
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1828b9e-02e9-519e-b209-ff64bf547566
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6e3010>
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1828b9e-02e9-519e-b209-ff64bf547566/a1828b9e-02e9-519e-b209-ff64bf547566_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F7b%252F817b2d3f725286cfe5c1d0b8777b2bb0%252Fpa%252FZU87038_9435cb2f27f8a2f234a223578db648ae.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_9435cb2f27f8a2f234a223578db648ae.jpg saved to cache
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1828b9e-02e9-519e-b209-ff64bf547566
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a68b710>
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1828b9e-02e9-519e-b209-ff64bf547566/a1828b9e-02e9-519e-b209-ff64bf547566_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F7b%252F817b2d3f725286cfe5c1d0b8777b2bb0%252Fpa%252FZU87038_09f122d7b78b758f670d8664a71cc588.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_09f122d7b78b758f670d8664a71cc588.jpg saved to cache
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1828b9e-02e9-519e-b209-ff64bf547566
2026-03-28 09:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55e5496d-79bd-5b57-a590-4dd9104d03de with identifier: FV07755
2026-03-28 09:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e5496d-79bd-5b57-a590-4dd9104d03de with scrape type 1
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 55e5496d-79bd-5b57-a590-4dd9104d03de
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Fc8%252Fc9c8cdc8d0c9f0f5fdd13931b43f13ae%252Fpa%252FFV07755_44af236f88a8263d52ee2364ada04b6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_44af236f88a8263d52ee2364ada04b6e.jpg already downloaded
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Fc8%252Fc9c8cdc8d0c9f0f5fdd13931b43f13ae%252Fpa%252FFV07755_78b2e5f0073ba9c3993cf1ec5c7a126a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_78b2e5f0073ba9c3993cf1ec5c7a126a.jpg already downloaded
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Fc8%252Fc9c8cdc8d0c9f0f5fdd13931b43f13ae%252Fpa%252FFV07755_e24343d7f44b481316f1fdbc541ee0bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_e24343d7f44b481316f1fdbc541ee0bf.jpg already downloaded
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Fc8%252Fc9c8cdc8d0c9f0f5fdd13931b43f13ae%252Fpa%252FFV07755_bbb72ddd41afb77841502d9d689f3a22.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_bbb72ddd41afb77841502d9d689f3a22.jpg already downloaded
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Fc8%252Fc9c8cdc8d0c9f0f5fdd13931b43f13ae%252Fpa%252FFV07755_bf2c510573cc2ef571680d2dffbb4985.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_bf2c510573cc2ef571680d2dffbb4985.jpg already downloaded
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Fc8%252Fc9c8cdc8d0c9f0f5fdd13931b43f13ae%252Fpa%252FFV07755_3d43088721163b0f4e9ad13070c79ccd.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_3d43088721163b0f4e9ad13070c79ccd.jpg already downloaded
2026-03-28 09:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 55e5496d-79bd-5b57-a590-4dd9104d03de, identifier: FV07755
2026-03-28 09:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 55e5496d-79bd-5b57-a590-4dd9104d03de with identifier: FV07755
2026-03-28 09:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 55e5496d-79bd-5b57-a590-4dd9104d03de with identifier: FV07755
2026-03-28 09:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 55e5496d-79bd-5b57-a590-4dd9104d03de with identifier: FV07755 to the API
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FV07755>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:58:16Z',
 'fuel_type': 'petrol',
 'id': '55e5496d-79bd-5b57-a590-4dd9104d03de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV07755',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 74903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_44af236f88a8263d52ee2364ada04b6e.jpg',
                'https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_78b2e5f0073ba9c3993cf1ec5c7a126a.jpg',
                'https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_e24343d7f44b481316f1fdbc541ee0bf.jpg',
                'https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_bbb72ddd41afb77841502d9d689f3a22.jpg',
                'https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_bf2c510573cc2ef571680d2dffbb4985.jpg',
                'https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_3d43088721163b0f4e9ad13070c79ccd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e5496d-79bd-5b57-a590-4dd9104d03de/55e5496d-79bd-5b57-a590-4dd9104d03de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_44af236f88a8263d52ee2364ada04b6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e5496d-79bd-5b57-a590-4dd9104d03de/55e5496d-79bd-5b57-a590-4dd9104d03de_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_78b2e5f0073ba9c3993cf1ec5c7a126a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e5496d-79bd-5b57-a590-4dd9104d03de/55e5496d-79bd-5b57-a590-4dd9104d03de_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_e24343d7f44b481316f1fdbc541ee0bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e5496d-79bd-5b57-a590-4dd9104d03de/55e5496d-79bd-5b57-a590-4dd9104d03de_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_bbb72ddd41afb77841502d9d689f3a22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e5496d-79bd-5b57-a590-4dd9104d03de/55e5496d-79bd-5b57-a590-4dd9104d03de_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_bf2c510573cc2ef571680d2dffbb4985.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e5496d-79bd-5b57-a590-4dd9104d03de/55e5496d-79bd-5b57-a590-4dd9104d03de_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/c8/c9c8cdc8d0c9f0f5fdd13931b43f13ae/pa/FV07755_3d43088721163b0f4e9ad13070c79ccd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Now',
 'transmission': 'manual',
 'trim': 'Now',
 'year': 2010}
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV07755%27 HTTP/1.1" 200 None
2026-03-28 09:01:01 [auto1.it] INFO: Saving data for FV07755: {'created_time': 1774688461.736279, 'last_price_update_time': 1774688461.736289, 'auction_closing_time': 1774886296.0}
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FV07755') HTTP/1.1" 204 0
2026-03-28 09:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_a0d8cd38aa2a575b919b24a9ea0ffb40.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU50392> (referer: https://www.auto1.com/v1/car-details-view/AU50392/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS31843> (referer: https://www.auto1.com/v1/car-details-view/XS31843/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RB57838> (referer: https://www.auto1.com/v1/car-details-view/RB57838/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19a27990>
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1828b9e-02e9-519e-b209-ff64bf547566/a1828b9e-02e9-519e-b209-ff64bf547566_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F7b%252F817b2d3f725286cfe5c1d0b8777b2bb0%252Fpa%252FZU87038_8e5353670ebf594eb3acbfd1a1872114.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_8e5353670ebf594eb3acbfd1a1872114.jpg saved to cache
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1828b9e-02e9-519e-b209-ff64bf547566
2026-03-28 09:01:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1828b9e-02e9-519e-b209-ff64bf547566, skipping ID generation
2026-03-28 09:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1828b9e-02e9-519e-b209-ff64bf547566 with scrape type 1
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1828b9e-02e9-519e-b209-ff64bf547566 sending to next pipeline
2026-03-28 09:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a1828b9e-02e9-519e-b209-ff64bf547566, identifier: ZU87038
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a78cd50>
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2015853c-9978-555b-9f1e-1d07a5343122/2015853c-9978-555b-9f1e-1d07a5343122_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F97%252F2897de8320addb1ef2e706bb0d696035%252Fpa%252FWL53741_2badc356b0498936ca717a85d95546ba.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_2badc356b0498936ca717a85d95546ba.jpg saved to cache
2026-03-28 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2015853c-9978-555b-9f1e-1d07a5343122
2026-03-28 09:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_afc949c1f2d63faa4da72b4d01784963.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a1828b9e-02e9-519e-b209-ff64bf547566 with identifier: ZU87038
2026-03-28 09:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a1828b9e-02e9-519e-b209-ff64bf547566 with identifier: ZU87038
2026-03-28 09:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a1828b9e-02e9-519e-b209-ff64bf547566 with identifier: ZU87038 to the API
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_8e5353670ebf594eb3acbfd1a1872114.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:24:56Z',
 'fuel_type': 'petrol',
 'id': 'a1828b9e-02e9-519e-b209-ff64bf547566',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU87038',
 'listing': 'auction',
 'location': 'IT, Desenzano del Garda',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 127648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1828b9e-02e9-519e-b209-ff64bf547566/a1828b9e-02e9-519e-b209-ff64bf547566_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_8e5353670ebf594eb3acbfd1a1872114.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1828b9e-02e9-519e-b209-ff64bf547566/a1828b9e-02e9-519e-b209-ff64bf547566_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_09f122d7b78b758f670d8664a71cc588.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1828b9e-02e9-519e-b209-ff64bf547566/a1828b9e-02e9-519e-b209-ff64bf547566_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_9435cb2f27f8a2f234a223578db648ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1828b9e-02e9-519e-b209-ff64bf547566/a1828b9e-02e9-519e-b209-ff64bf547566_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_f4665a75955a80322ff3887891e6f93e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1828b9e-02e9-519e-b209-ff64bf547566/a1828b9e-02e9-519e-b209-ff64bf547566_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/7b/817b2d3f725286cfe5c1d0b8777b2bb0/pa/ZU87038_b51c0e2860881b47fa756377c8b8e248.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2009}
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU87038%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [auto1.it] INFO: Saving data for ZU87038: {'created_time': 1774688462.339503, 'last_price_update_time': 1774688462.339513, 'auction_closing_time': 1774884296.0}
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZU87038') HTTP/1.1" 204 0
2026-03-28 09:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_827561e5cfb410691af3a34d7ca89582.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19a1c490>
2026-03-28 09:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2015853c-9978-555b-9f1e-1d07a5343122/2015853c-9978-555b-9f1e-1d07a5343122_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F97%252F2897de8320addb1ef2e706bb0d696035%252Fpa%252FWL53741_a0d8cd38aa2a575b919b24a9ea0ffb40.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_a0d8cd38aa2a575b919b24a9ea0ffb40.jpg saved to cache
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2015853c-9978-555b-9f1e-1d07a5343122
2026-03-28 09:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf6de24c-2fce-5019-a0eb-41c0cf48ef9e with identifier: AU50392
2026-03-28 09:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf6de24c-2fce-5019-a0eb-41c0cf48ef9e with scrape type 1
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf6de24c-2fce-5019-a0eb-41c0cf48ef9e
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_b507e91bfe1d1bd1412b9459671d09e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_b507e91bfe1d1bd1412b9459671d09e2.jpg not downloaded yet
2026-03-28 09:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cdad10a-9437-57dc-86ac-53301d8e35e8 with identifier: XS31843
2026-03-28 09:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cdad10a-9437-57dc-86ac-53301d8e35e8 with scrape type 1
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6cdad10a-9437-57dc-86ac-53301d8e35e8
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb9%252Fd5b9fee49398ddb2e2be6fcf70c18f4d%252Fpa%252FXS31843_9fa8cc7b99d56a2255a43ed42bfe7386.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_9fa8cc7b99d56a2255a43ed42bfe7386.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb9%252Fd5b9fee49398ddb2e2be6fcf70c18f4d%252Fpa%252FXS31843_75ab0eb71a789189fcf0e2b942b4279f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_75ab0eb71a789189fcf0e2b942b4279f.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb9%252Fd5b9fee49398ddb2e2be6fcf70c18f4d%252Fpa%252FXS31843_30f928a58d4acbe1cd7a235a036981c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_30f928a58d4acbe1cd7a235a036981c5.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb9%252Fd5b9fee49398ddb2e2be6fcf70c18f4d%252Fpa%252FXS31843_cc672cec036fe63d0789325a50eb68e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_cc672cec036fe63d0789325a50eb68e6.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb9%252Fd5b9fee49398ddb2e2be6fcf70c18f4d%252Fpa%252FXS31843_43c0408c870f28bdccc49ba09c735a6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_43c0408c870f28bdccc49ba09c735a6b.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb9%252Fd5b9fee49398ddb2e2be6fcf70c18f4d%252Fpa%252FXS31843_a420491c15f5cfcb00f09a7d9ffc4398.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_a420491c15f5cfcb00f09a7d9ffc4398.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb9%252Fd5b9fee49398ddb2e2be6fcf70c18f4d%252Fpa%252FXS31843_917d7ec080c6a615e30b45d05539350b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_917d7ec080c6a615e30b45d05539350b.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb9%252Fd5b9fee49398ddb2e2be6fcf70c18f4d%252Fpa%252FXS31843_dbfa97aba7429124dd9fd5b5fa53b486.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_dbfa97aba7429124dd9fd5b5fa53b486.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb9%252Fd5b9fee49398ddb2e2be6fcf70c18f4d%252Fpa%252FXS31843_e325ea1c7ab0c48aff2a395bc8724d13.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_e325ea1c7ab0c48aff2a395bc8724d13.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb9%252Fd5b9fee49398ddb2e2be6fcf70c18f4d%252Fpa%252FXS31843_8d15711ffe975a4398db31fed46b17e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_8d15711ffe975a4398db31fed46b17e3.jpg already downloaded
2026-03-28 09:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6cdad10a-9437-57dc-86ac-53301d8e35e8, identifier: XS31843
2026-03-28 09:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc8b1de5-1d46-54ca-9908-fc5b5d698057 with identifier: RB57838
2026-03-28 09:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc8b1de5-1d46-54ca-9908-fc5b5d698057 with scrape type 1
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc8b1de5-1d46-54ca-9908-fc5b5d698057
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F46%252F04465c18fbce91de87bd4e535fe04bff%252Fpa%252FRB57838_34ab062b3ac2ad96f6dfe7f9a1cabf07.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_34ab062b3ac2ad96f6dfe7f9a1cabf07.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F46%252F04465c18fbce91de87bd4e535fe04bff%252Fpa%252FRB57838_a4a6e60ec0af1947cc11dc2d556c1e7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_a4a6e60ec0af1947cc11dc2d556c1e7e.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F46%252F04465c18fbce91de87bd4e535fe04bff%252Fpa%252FRB57838_572ad077edebaf18cd0f718c18214cf1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_572ad077edebaf18cd0f718c18214cf1.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F46%252F04465c18fbce91de87bd4e535fe04bff%252Fpa%252FRB57838_51a4677b8477d9b1738c8ac59156619f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_51a4677b8477d9b1738c8ac59156619f.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F46%252F04465c18fbce91de87bd4e535fe04bff%252Fpa%252FRB57838_ad70277a43e6a3eb33c05bf7ccc7e1e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_ad70277a43e6a3eb33c05bf7ccc7e1e6.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F46%252F04465c18fbce91de87bd4e535fe04bff%252Fpa%252FRB57838_cb0c1e46171674151ffcdd077808aa7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_cb0c1e46171674151ffcdd077808aa7b.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F46%252F04465c18fbce91de87bd4e535fe04bff%252Fpa%252FRB57838_8c3d1a652f6922289fceb133da312449.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_8c3d1a652f6922289fceb133da312449.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F46%252F04465c18fbce91de87bd4e535fe04bff%252Fpa%252FRB57838_f935c2160cbdada2bb2bcc8b8c5d901f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_f935c2160cbdada2bb2bcc8b8c5d901f.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F46%252F04465c18fbce91de87bd4e535fe04bff%252Fpa%252FRB57838_98e6a78aacfc9e790f81d5b54a0991d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_98e6a78aacfc9e790f81d5b54a0991d3.jpg already downloaded
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F46%252F04465c18fbce91de87bd4e535fe04bff%252Fpa%252FRB57838_9419781923e8a3ccd2b9d170d0375ece.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_9419781923e8a3ccd2b9d170d0375ece.jpg already downloaded
2026-03-28 09:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fc8b1de5-1d46-54ca-9908-fc5b5d698057, identifier: RB57838
2026-03-28 09:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6cdad10a-9437-57dc-86ac-53301d8e35e8 with identifier: XS31843
2026-03-28 09:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6cdad10a-9437-57dc-86ac-53301d8e35e8 with identifier: XS31843
2026-03-28 09:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6cdad10a-9437-57dc-86ac-53301d8e35e8 with identifier: XS31843 to the API
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XS31843>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:06:10Z',
 'fuel_type': 'diesel',
 'id': '6cdad10a-9437-57dc-86ac-53301d8e35e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS31843',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 155438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_9fa8cc7b99d56a2255a43ed42bfe7386.jpg',
                'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_75ab0eb71a789189fcf0e2b942b4279f.jpg',
                'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_30f928a58d4acbe1cd7a235a036981c5.jpg',
                'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_cc672cec036fe63d0789325a50eb68e6.jpg',
                'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_43c0408c870f28bdccc49ba09c735a6b.jpg',
                'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_a420491c15f5cfcb00f09a7d9ffc4398.jpg',
                'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_917d7ec080c6a615e30b45d05539350b.jpg',
                'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_dbfa97aba7429124dd9fd5b5fa53b486.jpg',
                'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_e325ea1c7ab0c48aff2a395bc8724d13.jpg',
                'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_8d15711ffe975a4398db31fed46b17e3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cdad10a-9437-57dc-86ac-53301d8e35e8/6cdad10a-9437-57dc-86ac-53301d8e35e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_9fa8cc7b99d56a2255a43ed42bfe7386.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cdad10a-9437-57dc-86ac-53301d8e35e8/6cdad10a-9437-57dc-86ac-53301d8e35e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_75ab0eb71a789189fcf0e2b942b4279f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cdad10a-9437-57dc-86ac-53301d8e35e8/6cdad10a-9437-57dc-86ac-53301d8e35e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_30f928a58d4acbe1cd7a235a036981c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cdad10a-9437-57dc-86ac-53301d8e35e8/6cdad10a-9437-57dc-86ac-53301d8e35e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_cc672cec036fe63d0789325a50eb68e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cdad10a-9437-57dc-86ac-53301d8e35e8/6cdad10a-9437-57dc-86ac-53301d8e35e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_43c0408c870f28bdccc49ba09c735a6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cdad10a-9437-57dc-86ac-53301d8e35e8/6cdad10a-9437-57dc-86ac-53301d8e35e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_a420491c15f5cfcb00f09a7d9ffc4398.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cdad10a-9437-57dc-86ac-53301d8e35e8/6cdad10a-9437-57dc-86ac-53301d8e35e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_917d7ec080c6a615e30b45d05539350b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cdad10a-9437-57dc-86ac-53301d8e35e8/6cdad10a-9437-57dc-86ac-53301d8e35e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_dbfa97aba7429124dd9fd5b5fa53b486.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cdad10a-9437-57dc-86ac-53301d8e35e8/6cdad10a-9437-57dc-86ac-53301d8e35e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_e325ea1c7ab0c48aff2a395bc8724d13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cdad10a-9437-57dc-86ac-53301d8e35e8/6cdad10a-9437-57dc-86ac-53301d8e35e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/b9/d5b9fee49398ddb2e2be6fcf70c18f4d/pa/XS31843_8d15711ffe975a4398db31fed46b17e3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS31843%27 HTTP/1.1" 200 None
2026-03-28 09:01:03 [auto1.it] INFO: Saving data for XS31843: {'created_time': 1774688463.342992, 'last_price_update_time': 1774688463.343002, 'auction_closing_time': 1774883170.0}
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XS31843') HTTP/1.1" 204 0
2026-03-28 09:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fc8b1de5-1d46-54ca-9908-fc5b5d698057 with identifier: RB57838
2026-03-28 09:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fc8b1de5-1d46-54ca-9908-fc5b5d698057 with identifier: RB57838
2026-03-28 09:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fc8b1de5-1d46-54ca-9908-fc5b5d698057 with identifier: RB57838 to the API
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RB57838>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:46:17Z',
 'fuel_type': 'petrol',
 'id': 'fc8b1de5-1d46-54ca-9908-fc5b5d698057',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB57838',
 'listing': 'auction',
 'location': 'IT, Pradamano (UD)',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 170486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_34ab062b3ac2ad96f6dfe7f9a1cabf07.jpg',
                'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_a4a6e60ec0af1947cc11dc2d556c1e7e.jpg',
                'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_572ad077edebaf18cd0f718c18214cf1.jpg',
                'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_51a4677b8477d9b1738c8ac59156619f.jpg',
                'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_ad70277a43e6a3eb33c05bf7ccc7e1e6.jpg',
                'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_cb0c1e46171674151ffcdd077808aa7b.jpg',
                'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_8c3d1a652f6922289fceb133da312449.jpg',
                'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_f935c2160cbdada2bb2bcc8b8c5d901f.jpg',
                'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_98e6a78aacfc9e790f81d5b54a0991d3.jpg',
                'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_9419781923e8a3ccd2b9d170d0375ece.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8b1de5-1d46-54ca-9908-fc5b5d698057/fc8b1de5-1d46-54ca-9908-fc5b5d698057_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_34ab062b3ac2ad96f6dfe7f9a1cabf07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8b1de5-1d46-54ca-9908-fc5b5d698057/fc8b1de5-1d46-54ca-9908-fc5b5d698057_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_a4a6e60ec0af1947cc11dc2d556c1e7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8b1de5-1d46-54ca-9908-fc5b5d698057/fc8b1de5-1d46-54ca-9908-fc5b5d698057_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_572ad077edebaf18cd0f718c18214cf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8b1de5-1d46-54ca-9908-fc5b5d698057/fc8b1de5-1d46-54ca-9908-fc5b5d698057_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2877320,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_51a4677b8477d9b1738c8ac59156619f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8b1de5-1d46-54ca-9908-fc5b5d698057/fc8b1de5-1d46-54ca-9908-fc5b5d698057_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3139282,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_ad70277a43e6a3eb33c05bf7ccc7e1e6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8b1de5-1d46-54ca-9908-fc5b5d698057/fc8b1de5-1d46-54ca-9908-fc5b5d698057_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_cb0c1e46171674151ffcdd077808aa7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8b1de5-1d46-54ca-9908-fc5b5d698057/fc8b1de5-1d46-54ca-9908-fc5b5d698057_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3048441,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_8c3d1a652f6922289fceb133da312449.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8b1de5-1d46-54ca-9908-fc5b5d698057/fc8b1de5-1d46-54ca-9908-fc5b5d698057_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_f935c2160cbdada2bb2bcc8b8c5d901f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8b1de5-1d46-54ca-9908-fc5b5d698057/fc8b1de5-1d46-54ca-9908-fc5b5d698057_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_98e6a78aacfc9e790f81d5b54a0991d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8b1de5-1d46-54ca-9908-fc5b5d698057/fc8b1de5-1d46-54ca-9908-fc5b5d698057_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/46/04465c18fbce91de87bd4e535fe04bff/pa/RB57838_9419781923e8a3ccd2b9d170d0375ece.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2017}
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB57838%27 HTTP/1.1" 200 None
2026-03-28 09:01:03 [auto1.it] INFO: Saving data for RB57838: {'created_time': 1774688463.686792, 'last_price_update_time': 1774688463.686803, 'auction_closing_time': 1774885577.0}
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RB57838') HTTP/1.1" 204 0
2026-03-28 09:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_f5ce784fc8b477f4e4f43461f4cb703b.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_c182c8d486adb9f1f5eaf0790f850a9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_c182c8d486adb9f1f5eaf0790f850a9a.jpg not downloaded yet
2026-03-28 09:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TL02972/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1c95ca90>
2026-03-28 09:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2015853c-9978-555b-9f1e-1d07a5343122/2015853c-9978-555b-9f1e-1d07a5343122_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F97%252F2897de8320addb1ef2e706bb0d696035%252Fpa%252FWL53741_afc949c1f2d63faa4da72b4d01784963.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_afc949c1f2d63faa4da72b4d01784963.jpg saved to cache
2026-03-28 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2015853c-9978-555b-9f1e-1d07a5343122
2026-03-28 09:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW21371/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ93918/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_8fb1d6d5cc5eabf327a2c809ea359421.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_8fb1d6d5cc5eabf327a2c809ea359421.jpg not downloaded yet
2026-03-28 09:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b82990>
2026-03-28 09:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2015853c-9978-555b-9f1e-1d07a5343122/2015853c-9978-555b-9f1e-1d07a5343122_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F97%252F2897de8320addb1ef2e706bb0d696035%252Fpa%252FWL53741_827561e5cfb410691af3a34d7ca89582.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_827561e5cfb410691af3a34d7ca89582.jpg saved to cache
2026-03-28 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2015853c-9978-555b-9f1e-1d07a5343122
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_60fa2aba6f0cd8b1bb80b517d65d8dd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_60fa2aba6f0cd8b1bb80b517d65d8dd6.jpg not downloaded yet
2026-03-28 09:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_b507e91bfe1d1bd1412b9459671d09e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_ed286e29bcf9afa7c9d7fc99c468a75a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_ed286e29bcf9afa7c9d7fc99c468a75a.jpg not downloaded yet
2026-03-28 09:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19dd1810>
2026-03-28 09:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2015853c-9978-555b-9f1e-1d07a5343122/2015853c-9978-555b-9f1e-1d07a5343122_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F97%252F2897de8320addb1ef2e706bb0d696035%252Fpa%252FWL53741_f5ce784fc8b477f4e4f43461f4cb703b.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_f5ce784fc8b477f4e4f43461f4cb703b.jpg saved to cache
2026-03-28 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2015853c-9978-555b-9f1e-1d07a5343122
2026-03-28 09:01:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2015853c-9978-555b-9f1e-1d07a5343122, skipping ID generation
2026-03-28 09:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2015853c-9978-555b-9f1e-1d07a5343122 with scrape type 1
2026-03-28 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2015853c-9978-555b-9f1e-1d07a5343122 sending to next pipeline
2026-03-28 09:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2015853c-9978-555b-9f1e-1d07a5343122, identifier: WL53741
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_a00ff6a633e02f9e02e1f474380821d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_a00ff6a633e02f9e02e1f474380821d9.jpg not downloaded yet
2026-03-28 09:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2015853c-9978-555b-9f1e-1d07a5343122 with identifier: WL53741
2026-03-28 09:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2015853c-9978-555b-9f1e-1d07a5343122 with identifier: WL53741
2026-03-28 09:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2015853c-9978-555b-9f1e-1d07a5343122 with identifier: WL53741 to the API
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_f5ce784fc8b477f4e4f43461f4cb703b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:35Z',
 'fuel_type': 'diesel',
 'id': '2015853c-9978-555b-9f1e-1d07a5343122',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL53741',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 201246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2015853c-9978-555b-9f1e-1d07a5343122/2015853c-9978-555b-9f1e-1d07a5343122_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_2badc356b0498936ca717a85d95546ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2015853c-9978-555b-9f1e-1d07a5343122/2015853c-9978-555b-9f1e-1d07a5343122_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_a0d8cd38aa2a575b919b24a9ea0ffb40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2015853c-9978-555b-9f1e-1d07a5343122/2015853c-9978-555b-9f1e-1d07a5343122_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_afc949c1f2d63faa4da72b4d01784963.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2015853c-9978-555b-9f1e-1d07a5343122/2015853c-9978-555b-9f1e-1d07a5343122_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_827561e5cfb410691af3a34d7ca89582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2015853c-9978-555b-9f1e-1d07a5343122/2015853c-9978-555b-9f1e-1d07a5343122_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/97/2897de8320addb1ef2e706bb0d696035/pa/WL53741_f5ce784fc8b477f4e4f43461f4cb703b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 2.0 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2015}
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL53741%27 HTTP/1.1" 200 None
2026-03-28 09:01:04 [auto1.it] INFO: Saving data for WL53741: {'created_time': 1774688464.337166, 'last_price_update_time': 1774688464.337177, 'auction_closing_time': 1774883195.0}
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WL53741') HTTP/1.1" 204 0
2026-03-28 09:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_8ba1c8b05aafd1050ac9196a94b76864.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:04 [auto1.it] INFO: Channel: 24h | Page: 8 | totalHits: 3430 | hits on page: 40
2026-03-28 09:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_c182c8d486adb9f1f5eaf0790f850a9a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_8fb1d6d5cc5eabf327a2c809ea359421.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_4b347ade0a9a74085a753afc1ff00d47.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_4b347ade0a9a74085a753afc1ff00d47.jpg not downloaded yet
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: XC79515
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: SH22107
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: WD83298
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD83298%27 HTTP/1.1" 200 None
2026-03-28 09:01:04 [auto1.it] INFO: Scrape type for WD83298: 0
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: XH35372
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: GK72900
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: YT99583
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: DP98700
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP98700%27 HTTP/1.1" 200 None
2026-03-28 09:01:04 [auto1.it] INFO: Scrape type for DP98700: 0
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: LZ50355
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ50355%27 HTTP/1.1" 200 None
2026-03-28 09:01:04 [auto1.it] INFO: Scrape type for LZ50355: 0
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: JP72281
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: AS43039
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS43039%27 HTTP/1.1" 200 None
2026-03-28 09:01:04 [auto1.it] INFO: Scrape type for AS43039: 0
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: MH72386
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: KX04923
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX04923%27 HTTP/1.1" 200 None
2026-03-28 09:01:04 [auto1.it] INFO: Scrape type for KX04923: 0
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: XW72958
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: WL97433
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL97433%27 HTTP/1.1" 200 None
2026-03-28 09:01:04 [auto1.it] INFO: Scrape type for WL97433: 0
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: HH27298
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: JP60910
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP60910%27 HTTP/1.1" 200 None
2026-03-28 09:01:04 [auto1.it] INFO: Scrape type for JP60910: 0
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: MS15959
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS15959%27 HTTP/1.1" 200 None
2026-03-28 09:01:04 [auto1.it] INFO: Scrape type for MS15959: 0
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: UB22158
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB22158%27 HTTP/1.1" 200 None
2026-03-28 09:01:04 [auto1.it] INFO: Scrape type for UB22158: 0
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: VT21354
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT21354%27 HTTP/1.1" 200 None
2026-03-28 09:01:04 [auto1.it] INFO: Scrape type for VT21354: 0
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: JZ95441
2026-03-28 09:01:04 [auto1.it] INFO: Found listing with ID: HV53293
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV53293%27 HTTP/1.1" 200 None
2026-03-28 09:01:04 [auto1.it] INFO: Scrape type for HV53293: 2
2026-03-28 09:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3ceecf0-a539-5dd0-89ad-854198a7c815 with identifier: HV53293
2026-03-28 09:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3ceecf0-a539-5dd0-89ad-854198a7c815 with scrape type 2
2026-03-28 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3ceecf0-a539-5dd0-89ad-854198a7c815 with scrape type 2
2026-03-28 09:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c3ceecf0-a539-5dd0-89ad-854198a7c815, identifier: HV53293
2026-03-28 09:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19d1c690>
2026-03-28 09:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_b507e91bfe1d1bd1412b9459671d09e2.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_b507e91bfe1d1bd1412b9459671d09e2.jpg saved to cache
2026-03-28 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf6de24c-2fce-5019-a0eb-41c0cf48ef9e
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_37c4d478efe6ffabb4a0a147f3e15210.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_37c4d478efe6ffabb4a0a147f3e15210.jpg not downloaded yet
2026-03-28 09:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c3ceecf0-a539-5dd0-89ad-854198a7c815 with identifier: HV53293
2026-03-28 09:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c3ceecf0-a539-5dd0-89ad-854198a7c815 with identifier: HV53293
2026-03-28 09:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c3ceecf0-a539-5dd0-89ad-854198a7c815 with identifier: HV53293 to the API
2026-03-28 09:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:28:34Z',
 'fuel_type': 'petrol',
 'id': 'c3ceecf0-a539-5dd0-89ad-854198a7c815',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV53293',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 47690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-17',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2012}
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV53293%27 HTTP/1.1" 200 None
2026-03-28 09:01:05 [auto1.it] INFO: Saving data for HV53293: {'auction_closing_time': 1774715314.0, 'created_time': 1774472711.632419, 'last_price_update_time': 1774688465.175289}
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HV53293') HTTP/1.1" 204 0
2026-03-28 09:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_ed286e29bcf9afa7c9d7fc99c468a75a.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_60fa2aba6f0cd8b1bb80b517d65d8dd6.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:05 [auto1.it] INFO: Found listing with ID: WZ40427
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ40427%27 HTTP/1.1" 200 None
2026-03-28 09:01:05 [auto1.it] INFO: Scrape type for WZ40427: 0
2026-03-28 09:01:05 [auto1.it] INFO: Found listing with ID: DR60838
2026-03-28 09:01:05 [auto1.it] INFO: Found listing with ID: BF36974
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF36974%27 HTTP/1.1" 200 None
2026-03-28 09:01:05 [auto1.it] INFO: Scrape type for BF36974: 0
2026-03-28 09:01:05 [auto1.it] INFO: Found listing with ID: JP22966
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP22966%27 HTTP/1.1" 200 None
2026-03-28 09:01:05 [auto1.it] INFO: Scrape type for JP22966: 0
2026-03-28 09:01:05 [auto1.it] INFO: Found listing with ID: LG94393
2026-03-28 09:01:05 [auto1.it] INFO: Found listing with ID: HP74394
2026-03-28 09:01:05 [auto1.it] INFO: Found listing with ID: ME64112
2026-03-28 09:01:05 [auto1.it] INFO: Found listing with ID: TP47880
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP47880%27 HTTP/1.1" 200 None
2026-03-28 09:01:05 [auto1.it] INFO: Scrape type for TP47880: 0
2026-03-28 09:01:05 [auto1.it] INFO: Found listing with ID: YJ46375
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ46375%27 HTTP/1.1" 200 None
2026-03-28 09:01:05 [auto1.it] INFO: Scrape type for YJ46375: 0
2026-03-28 09:01:05 [auto1.it] INFO: Found listing with ID: PF40120
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF40120%27 HTTP/1.1" 200 None
2026-03-28 09:01:05 [auto1.it] INFO: Scrape type for PF40120: 0
2026-03-28 09:01:05 [auto1.it] INFO: Found listing with ID: HX55945
2026-03-28 09:01:05 [auto1.it] INFO: Found listing with ID: HT98795
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT98795%27 HTTP/1.1" 200 None
2026-03-28 09:01:05 [auto1.it] INFO: Scrape type for HT98795: 2
2026-03-28 09:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b17a8f5b-2940-5eaf-9fa0-9f87ac72f842 with identifier: HT98795
2026-03-28 09:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b17a8f5b-2940-5eaf-9fa0-9f87ac72f842 with scrape type 2
2026-03-28 09:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b17a8f5b-2940-5eaf-9fa0-9f87ac72f842 with scrape type 2
2026-03-28 09:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b17a8f5b-2940-5eaf-9fa0-9f87ac72f842, identifier: HT98795
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_97b861a5735eedf23105b73c3bf6efd0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_97b861a5735eedf23105b73c3bf6efd0.jpg not downloaded yet
2026-03-28 09:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b17a8f5b-2940-5eaf-9fa0-9f87ac72f842 with identifier: HT98795
2026-03-28 09:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b17a8f5b-2940-5eaf-9fa0-9f87ac72f842 with identifier: HT98795
2026-03-28 09:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b17a8f5b-2940-5eaf-9fa0-9f87ac72f842 with identifier: HT98795 to the API
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:29:51Z',
 'fuel_type': 'diesel',
 'id': 'b17a8f5b-2940-5eaf-9fa0-9f87ac72f842',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT98795',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 359732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT98795%27 HTTP/1.1" 200 None
2026-03-28 09:01:05 [auto1.it] INFO: Saving data for HT98795: {'auction_closing_time': 1774715391.0, 'created_time': 1773236206.26992, 'last_price_update_time': 1774688465.838528}
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HT98795') HTTP/1.1" 204 0
2026-03-28 09:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SK62476> (referer: https://www.auto1.com/v1/car-details-view/SK62476/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL36522/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG79014> (referer: https://www.auto1.com/v1/car-details-view/RG79014/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_a00ff6a633e02f9e02e1f474380821d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:05 [scrapy.extensions.logstats] INFO: Crawled 94 pages (at 94 pages/min), scraped 48 items (at 48 items/min)
2026-03-28 09:01:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 190MiB
2026-03-28 09:01:05 [auto1.it] INFO: Found listing with ID: PH46734
2026-03-28 09:01:05 [auto1.it] INFO: Found listing with ID: EE49908
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE49908%27 HTTP/1.1" 200 None
2026-03-28 09:01:05 [auto1.it] INFO: Scrape type for EE49908: 0
2026-03-28 09:01:05 [auto1.it] INFO: Found listing with ID: VC73391
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC73391%27 HTTP/1.1" 200 None
2026-03-28 09:01:05 [auto1.it] INFO: Scrape type for VC73391: 0
2026-03-28 09:01:05 [auto1.it] INFO: Found listing with ID: SP57651
2026-03-28 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP57651%27 HTTP/1.1" 200 None
2026-03-28 09:01:06 [auto1.it] INFO: Scrape type for SP57651: 0
2026-03-28 09:01:06 [auto1.it] INFO: Found listing with ID: TP78592
2026-03-28 09:01:06 [auto1.it] INFO: Found listing with ID: AJ45475
2026-03-28 09:01:06 [auto1.it] INFO: Found listing with ID: EN15125
2026-03-28 09:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a664510>
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_8ba1c8b05aafd1050ac9196a94b76864.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_8ba1c8b05aafd1050ac9196a94b76864.jpg saved to cache
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 186bb506-7a70-5713-b211-f145610d42d4
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19d1fe50>
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_c182c8d486adb9f1f5eaf0790f850a9a.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_c182c8d486adb9f1f5eaf0790f850a9a.jpg saved to cache
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf6de24c-2fce-5019-a0eb-41c0cf48ef9e
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c61d10>
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_8fb1d6d5cc5eabf327a2c809ea359421.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_8fb1d6d5cc5eabf327a2c809ea359421.jpg saved to cache
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf6de24c-2fce-5019-a0eb-41c0cf48ef9e
2026-03-28 09:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_4b347ade0a9a74085a753afc1ff00d47.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_b3f9df10da9af47cac8fc3d4a25c28e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_b3f9df10da9af47cac8fc3d4a25c28e8.jpg not downloaded yet
2026-03-28 09:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT57270> (referer: https://www.auto1.com/v1/car-details-view/RT57270/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c97050>
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_ed286e29bcf9afa7c9d7fc99c468a75a.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_ed286e29bcf9afa7c9d7fc99c468a75a.jpg saved to cache
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf6de24c-2fce-5019-a0eb-41c0cf48ef9e
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a68fc90>
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_60fa2aba6f0cd8b1bb80b517d65d8dd6.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_60fa2aba6f0cd8b1bb80b517d65d8dd6.jpg saved to cache
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf6de24c-2fce-5019-a0eb-41c0cf48ef9e
2026-03-28 09:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 891143cb-01ba-58ee-8700-07bc95cbce58 with identifier: SK62476
2026-03-28 09:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 891143cb-01ba-58ee-8700-07bc95cbce58 with scrape type 1
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 891143cb-01ba-58ee-8700-07bc95cbce58
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fab%252Fa6aba33d37f2e21ff356c85851ed3ce4%252Fpa%252FSK62476_6518bae7de2488d329b945fccde5a4cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_6518bae7de2488d329b945fccde5a4cd.jpg already downloaded
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fab%252Fa6aba33d37f2e21ff356c85851ed3ce4%252Fpa%252FSK62476_4c02f7dfb07073e5612f6511e2fb06b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_4c02f7dfb07073e5612f6511e2fb06b1.jpg already downloaded
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fab%252Fa6aba33d37f2e21ff356c85851ed3ce4%252Fpa%252FSK62476_1e86f43022119e3168a21c898bd4db22.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_1e86f43022119e3168a21c898bd4db22.jpg already downloaded
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fab%252Fa6aba33d37f2e21ff356c85851ed3ce4%252Fpa%252FSK62476_1b7288f6af44c2d68ac72ca7a9cc7ef8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_1b7288f6af44c2d68ac72ca7a9cc7ef8.jpg already downloaded
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fab%252Fa6aba33d37f2e21ff356c85851ed3ce4%252Fpa%252FSK62476_ad66b7d398675d99f248c9b215698341.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_ad66b7d398675d99f248c9b215698341.jpg already downloaded
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fab%252Fa6aba33d37f2e21ff356c85851ed3ce4%252Fpa%252FSK62476_7c95e38afc7d042de9102f73eaa51b96.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_7c95e38afc7d042de9102f73eaa51b96.jpg already downloaded
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fab%252Fa6aba33d37f2e21ff356c85851ed3ce4%252Fpa%252FSK62476_e5cbf47de0a361e38ed248203334df49.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_e5cbf47de0a361e38ed248203334df49.jpg already downloaded
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fab%252Fa6aba33d37f2e21ff356c85851ed3ce4%252Fpa%252FSK62476_2d2b975e8001eff843b30c44112b450f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_2d2b975e8001eff843b30c44112b450f.jpg already downloaded
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fab%252Fa6aba33d37f2e21ff356c85851ed3ce4%252Fpa%252FSK62476_fab0224384b2a953460d96a50f3ddc7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_fab0224384b2a953460d96a50f3ddc7b.jpg already downloaded
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fab%252Fa6aba33d37f2e21ff356c85851ed3ce4%252Fpa%252FSK62476_3402ef540000f5a43a7d6a061de746ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_3402ef540000f5a43a7d6a061de746ec.jpg already downloaded
2026-03-28 09:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 891143cb-01ba-58ee-8700-07bc95cbce58, identifier: SK62476
2026-03-28 09:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bdd4a83-a025-5966-8982-3aa39ebc9962 with identifier: RG79014
2026-03-28 09:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bdd4a83-a025-5966-8982-3aa39ebc9962 with scrape type 1
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4bdd4a83-a025-5966-8982-3aa39ebc9962
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_2b95e9b08cd0d909103292a05c04e702.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_2b95e9b08cd0d909103292a05c04e702.jpg not downloaded yet
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a7e0310>
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_a00ff6a633e02f9e02e1f474380821d9.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_a00ff6a633e02f9e02e1f474380821d9.jpg saved to cache
2026-03-28 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf6de24c-2fce-5019-a0eb-41c0cf48ef9e
2026-03-28 09:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_b4902d837ae12ee62e4a363c3bab736c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 891143cb-01ba-58ee-8700-07bc95cbce58 with identifier: SK62476
2026-03-28 09:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 891143cb-01ba-58ee-8700-07bc95cbce58 with identifier: SK62476
2026-03-28 09:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 891143cb-01ba-58ee-8700-07bc95cbce58 with identifier: SK62476 to the API
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SK62476>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 179,
 'expiration_date': '2026-03-30T15:21:30Z',
 'fuel_type': 'diesel',
 'id': '891143cb-01ba-58ee-8700-07bc95cbce58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK62476',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 69359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_6518bae7de2488d329b945fccde5a4cd.jpg',
                'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_4c02f7dfb07073e5612f6511e2fb06b1.jpg',
                'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_1e86f43022119e3168a21c898bd4db22.jpg',
                'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_1b7288f6af44c2d68ac72ca7a9cc7ef8.jpg',
                'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_ad66b7d398675d99f248c9b215698341.jpg',
                'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_7c95e38afc7d042de9102f73eaa51b96.jpg',
                'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_e5cbf47de0a361e38ed248203334df49.jpg',
                'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_2d2b975e8001eff843b30c44112b450f.jpg',
                'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_fab0224384b2a953460d96a50f3ddc7b.jpg',
                'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_3402ef540000f5a43a7d6a061de746ec.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_891143cb-01ba-58ee-8700-07bc95cbce58/891143cb-01ba-58ee-8700-07bc95cbce58_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_6518bae7de2488d329b945fccde5a4cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_891143cb-01ba-58ee-8700-07bc95cbce58/891143cb-01ba-58ee-8700-07bc95cbce58_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_4c02f7dfb07073e5612f6511e2fb06b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_891143cb-01ba-58ee-8700-07bc95cbce58/891143cb-01ba-58ee-8700-07bc95cbce58_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_1e86f43022119e3168a21c898bd4db22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_891143cb-01ba-58ee-8700-07bc95cbce58/891143cb-01ba-58ee-8700-07bc95cbce58_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_1b7288f6af44c2d68ac72ca7a9cc7ef8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_891143cb-01ba-58ee-8700-07bc95cbce58/891143cb-01ba-58ee-8700-07bc95cbce58_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_ad66b7d398675d99f248c9b215698341.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_891143cb-01ba-58ee-8700-07bc95cbce58/891143cb-01ba-58ee-8700-07bc95cbce58_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_7c95e38afc7d042de9102f73eaa51b96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_891143cb-01ba-58ee-8700-07bc95cbce58/891143cb-01ba-58ee-8700-07bc95cbce58_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_e5cbf47de0a361e38ed248203334df49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_891143cb-01ba-58ee-8700-07bc95cbce58/891143cb-01ba-58ee-8700-07bc95cbce58_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_2d2b975e8001eff843b30c44112b450f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_891143cb-01ba-58ee-8700-07bc95cbce58/891143cb-01ba-58ee-8700-07bc95cbce58_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_fab0224384b2a953460d96a50f3ddc7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_891143cb-01ba-58ee-8700-07bc95cbce58/891143cb-01ba-58ee-8700-07bc95cbce58_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/ab/a6aba33d37f2e21ff356c85851ed3ce4/pa/SK62476_3402ef540000f5a43a7d6a061de746ec.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D180 Mild-Hybrid R-dynamic SE',
 'transmission': 'automatic',
 'trim': 'R-dynamic SE',
 'year': 2020}
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK62476%27 HTTP/1.1" 200 None
2026-03-28 09:01:07 [auto1.it] INFO: Saving data for SK62476: {'created_time': 1774688467.081957, 'last_price_update_time': 1774688467.081971, 'auction_closing_time': 1774884090.0}
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SK62476') HTTP/1.1" 204 0
2026-03-28 09:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_37c4d478efe6ffabb4a0a147f3e15210.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_97b861a5735eedf23105b73c3bf6efd0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_6cc2ddf0281e22a2084c2240340bb593.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_6cc2ddf0281e22a2084c2240340bb593.jpg not downloaded yet
2026-03-28 09:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6fea90>
2026-03-28 09:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_4b347ade0a9a74085a753afc1ff00d47.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_4b347ade0a9a74085a753afc1ff00d47.jpg saved to cache
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf6de24c-2fce-5019-a0eb-41c0cf48ef9e
2026-03-28 09:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff6890d4-a840-546e-a6b8-95d4b516185a with identifier: RT57270
2026-03-28 09:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff6890d4-a840-546e-a6b8-95d4b516185a with scrape type 1
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff6890d4-a840-546e-a6b8-95d4b516185a
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_87e89287ef6055512dfee66504a0f4af.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_87e89287ef6055512dfee66504a0f4af.jpg not downloaded yet
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_68f24a331f4647d946ffb6f23fc017be.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_68f24a331f4647d946ffb6f23fc017be.jpg not downloaded yet
2026-03-28 09:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT33269> (referer: https://www.auto1.com/v1/car-details-view/UT33269/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_ad48c98304542c5adb8a1f524b6404ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_ad48c98304542c5adb8a1f524b6404ac.jpg not downloaded yet
2026-03-28 09:01:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19a1ca10>
2026-03-28 09:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fb0%252F79b04fe52a5e01828b71cc9c18d0ece1%252Fpa%252FWH30921_b4902d837ae12ee62e4a363c3bab736c.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_b4902d837ae12ee62e4a363c3bab736c.jpg saved to cache
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 186bb506-7a70-5713-b211-f145610d42d4
2026-03-28 09:01:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 186bb506-7a70-5713-b211-f145610d42d4, skipping ID generation
2026-03-28 09:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 186bb506-7a70-5713-b211-f145610d42d4 with scrape type 1
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 186bb506-7a70-5713-b211-f145610d42d4 sending to next pipeline
2026-03-28 09:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 186bb506-7a70-5713-b211-f145610d42d4, identifier: WH30921
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_a88318a9a6aa4614fa8738dbe9ce56a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_a88318a9a6aa4614fa8738dbe9ce56a1.jpg not downloaded yet
2026-03-28 09:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ93918> (referer: https://www.auto1.com/v1/car-details-view/WJ93918/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 186bb506-7a70-5713-b211-f145610d42d4 with identifier: WH30921
2026-03-28 09:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 186bb506-7a70-5713-b211-f145610d42d4 with identifier: WH30921
2026-03-28 09:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 186bb506-7a70-5713-b211-f145610d42d4 with identifier: WH30921 to the API
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_b4902d837ae12ee62e4a363c3bab736c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:40:45Z',
 'fuel_type': 'gas',
 'id': '186bb506-7a70-5713-b211-f145610d42d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH30921',
 'listing': 'auction',
 'location': 'IT, Desio (MB)',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 108337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_11d7a6d595b0397b43a77841a97bb74c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_f2f981df5630df591937ed77aee9bf40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_a44ed01b8fd950a2efbd4ba8b90da3be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_2ddbe13ffe0b6f638f46c9c874fc6948.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_0df9ab565899c42233172beaefb97161.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3491541,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_8ba1c8b05aafd1050ac9196a94b76864.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_7f50b37f7cebc2de32f11dfc2d9a406e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3253286,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_b4902d837ae12ee62e4a363c3bab736c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_4452385de47ed2d98479facef337bc1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_186bb506-7a70-5713-b211-f145610d42d4/186bb506-7a70-5713-b211-f145610d42d4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/b0/79b04fe52a5e01828b71cc9c18d0ece1/pa/WH30921_90e18b3e9a42f75568ba9dcc895698ae.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 LPG 120 Jahre',
 'transmission': 'manual',
 'trim': '120 Jahre',
 'year': 2019}
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH30921%27 HTTP/1.1" 200 None
2026-03-28 09:01:07 [auto1.it] INFO: Saving data for WH30921: {'created_time': 1774688467.836223, 'last_price_update_time': 1774688467.836233, 'auction_closing_time': 1774885245.0}
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WH30921') HTTP/1.1" 204 0
2026-03-28 09:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_b3f9df10da9af47cac8fc3d4a25c28e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_0025f5927308c1949dcadc62b3016856.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_0025f5927308c1949dcadc62b3016856.jpg not downloaded yet
2026-03-28 09:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_2b95e9b08cd0d909103292a05c04e702.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_53c65208e83316f2627575d09aa4a15b.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_53c65208e83316f2627575d09aa4a15b.jpg not downloaded yet
2026-03-28 09:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c9e050>
2026-03-28 09:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_37c4d478efe6ffabb4a0a147f3e15210.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_37c4d478efe6ffabb4a0a147f3e15210.jpg saved to cache
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bf6de24c-2fce-5019-a0eb-41c0cf48ef9e
2026-03-28 09:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19bf6e50>
2026-03-28 09:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_97b861a5735eedf23105b73c3bf6efd0.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_97b861a5735eedf23105b73c3bf6efd0.jpg saved to cache
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bf6de24c-2fce-5019-a0eb-41c0cf48ef9e
2026-03-28 09:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dfa03af-68b3-5623-8343-d92ed9de464f with identifier: UT33269
2026-03-28 09:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dfa03af-68b3-5623-8343-d92ed9de464f with scrape type 1
2026-03-28 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3dfa03af-68b3-5623-8343-d92ed9de464f
2026-03-28 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fe1%252Fefe1b31be62366ea6e5532f823c5d9a9%252Fpa%252FUT33269_d89a7f28c63006eec859df5d126d5e74.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_d89a7f28c63006eec859df5d126d5e74.jpg already downloaded
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fe1%252Fefe1b31be62366ea6e5532f823c5d9a9%252Fpa%252FUT33269_47766af91efafb0bfba57776329f88fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_47766af91efafb0bfba57776329f88fd.jpg already downloaded
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fe1%252Fefe1b31be62366ea6e5532f823c5d9a9%252Fpa%252FUT33269_d2d1067105942b795a580e00cdb6b864.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_d2d1067105942b795a580e00cdb6b864.jpg already downloaded
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fe1%252Fefe1b31be62366ea6e5532f823c5d9a9%252Fpa%252FUT33269_14cf97e696d2c757f7f60f4e5e036c91.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_14cf97e696d2c757f7f60f4e5e036c91.jpg already downloaded
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fe1%252Fefe1b31be62366ea6e5532f823c5d9a9%252Fpa%252FUT33269_b16f419fa7973da901c9a1b820f331d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_b16f419fa7973da901c9a1b820f331d4.jpg already downloaded
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fe1%252Fefe1b31be62366ea6e5532f823c5d9a9%252Fpa%252FUT33269_ffc5d300368bc250822880a216e4fbc2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_ffc5d300368bc250822880a216e4fbc2.jpg already downloaded
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fe1%252Fefe1b31be62366ea6e5532f823c5d9a9%252Fpa%252FUT33269_6aa4194bae9129c6fd3186c0be4b78d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_6aa4194bae9129c6fd3186c0be4b78d8.jpg already downloaded
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fe1%252Fefe1b31be62366ea6e5532f823c5d9a9%252Fpa%252FUT33269_5cb38fb3e7ca17c8e7eb6e8d8435fe13.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_5cb38fb3e7ca17c8e7eb6e8d8435fe13.jpg already downloaded
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fe1%252Fefe1b31be62366ea6e5532f823c5d9a9%252Fpa%252FUT33269_e3384fc37c740f97e01ef3d52498cd68.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_e3384fc37c740f97e01ef3d52498cd68.jpg already downloaded
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fe1%252Fefe1b31be62366ea6e5532f823c5d9a9%252Fpa%252FUT33269_8f4d932ed13b452a40a00ed77110d000.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_8f4d932ed13b452a40a00ed77110d000.jpg already downloaded
2026-03-28 09:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3dfa03af-68b3-5623-8343-d92ed9de464f, identifier: UT33269
2026-03-28 09:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_6cc2ddf0281e22a2084c2240340bb593.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_4ac7a1f4bdb3506caa608e42114c75fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_4ac7a1f4bdb3506caa608e42114c75fe.jpg not downloaded yet
2026-03-28 09:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TL02972> (referer: https://www.auto1.com/v1/car-details-view/TL02972/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW21371> (referer: https://www.auto1.com/v1/car-details-view/PW21371/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3dfa03af-68b3-5623-8343-d92ed9de464f with identifier: UT33269
2026-03-28 09:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3dfa03af-68b3-5623-8343-d92ed9de464f with identifier: UT33269
2026-03-28 09:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3dfa03af-68b3-5623-8343-d92ed9de464f with identifier: UT33269 to the API
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UT33269>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:37:12Z',
 'fuel_type': 'diesel',
 'id': '3dfa03af-68b3-5623-8343-d92ed9de464f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT33269',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 122669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_d89a7f28c63006eec859df5d126d5e74.jpg',
                'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_47766af91efafb0bfba57776329f88fd.jpg',
                'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_d2d1067105942b795a580e00cdb6b864.jpg',
                'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_14cf97e696d2c757f7f60f4e5e036c91.jpg',
                'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_b16f419fa7973da901c9a1b820f331d4.jpg',
                'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_ffc5d300368bc250822880a216e4fbc2.jpg',
                'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_6aa4194bae9129c6fd3186c0be4b78d8.jpg',
                'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_5cb38fb3e7ca17c8e7eb6e8d8435fe13.jpg',
                'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_e3384fc37c740f97e01ef3d52498cd68.jpg',
                'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_8f4d932ed13b452a40a00ed77110d000.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dfa03af-68b3-5623-8343-d92ed9de464f/3dfa03af-68b3-5623-8343-d92ed9de464f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_d89a7f28c63006eec859df5d126d5e74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dfa03af-68b3-5623-8343-d92ed9de464f/3dfa03af-68b3-5623-8343-d92ed9de464f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_47766af91efafb0bfba57776329f88fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dfa03af-68b3-5623-8343-d92ed9de464f/3dfa03af-68b3-5623-8343-d92ed9de464f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2733189,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_d2d1067105942b795a580e00cdb6b864.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dfa03af-68b3-5623-8343-d92ed9de464f/3dfa03af-68b3-5623-8343-d92ed9de464f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2521525,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_14cf97e696d2c757f7f60f4e5e036c91.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dfa03af-68b3-5623-8343-d92ed9de464f/3dfa03af-68b3-5623-8343-d92ed9de464f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2582287,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_b16f419fa7973da901c9a1b820f331d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dfa03af-68b3-5623-8343-d92ed9de464f/3dfa03af-68b3-5623-8343-d92ed9de464f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2632654,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_ffc5d300368bc250822880a216e4fbc2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dfa03af-68b3-5623-8343-d92ed9de464f/3dfa03af-68b3-5623-8343-d92ed9de464f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2641889,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_6aa4194bae9129c6fd3186c0be4b78d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dfa03af-68b3-5623-8343-d92ed9de464f/3dfa03af-68b3-5623-8343-d92ed9de464f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2800250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_5cb38fb3e7ca17c8e7eb6e8d8435fe13.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dfa03af-68b3-5623-8343-d92ed9de464f/3dfa03af-68b3-5623-8343-d92ed9de464f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2682639,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_e3384fc37c740f97e01ef3d52498cd68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dfa03af-68b3-5623-8343-d92ed9de464f/3dfa03af-68b3-5623-8343-d92ed9de464f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2629782,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/e1/efe1b31be62366ea6e5532f823c5d9a9/pa/UT33269_8f4d932ed13b452a40a00ed77110d000.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT33269%27 HTTP/1.1" 200 None
2026-03-28 09:01:08 [auto1.it] INFO: Saving data for UT33269: {'created_time': 1774688468.633041, 'last_price_update_time': 1774688468.633056, 'auction_closing_time': 1774885032.0}
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UT33269') HTTP/1.1" 204 0
2026-03-28 09:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d with identifier: WJ93918
2026-03-28 09:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d with scrape type 1
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_cf19710658a2cb0e539773c094b276e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_cf19710658a2cb0e539773c094b276e5.jpg not downloaded yet
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_575f8e4c18fe75e93c8d0c264694f019.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_575f8e4c18fe75e93c8d0c264694f019.jpg not downloaded yet
2026-03-28 09:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_87e89287ef6055512dfee66504a0f4af.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_68f24a331f4647d946ffb6f23fc017be.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_d402c3ec8f293871420b1656aa503ed0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_d402c3ec8f293871420b1656aa503ed0.jpg not downloaded yet
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_7bbfbe277e45ac76c369f3c36a2afbbb.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_7bbfbe277e45ac76c369f3c36a2afbbb.jpg not downloaded yet
2026-03-28 09:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a70aed0>
2026-03-28 09:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7f%252Fb57f67ed447112fa71dd4609b1f48b34%252Fpa%252FAU50392_b3f9df10da9af47cac8fc3d4a25c28e8.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_b3f9df10da9af47cac8fc3d4a25c28e8.jpg saved to cache
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bf6de24c-2fce-5019-a0eb-41c0cf48ef9e
2026-03-28 09:01:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf6de24c-2fce-5019-a0eb-41c0cf48ef9e, skipping ID generation
2026-03-28 09:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf6de24c-2fce-5019-a0eb-41c0cf48ef9e with scrape type 1
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf6de24c-2fce-5019-a0eb-41c0cf48ef9e sending to next pipeline
2026-03-28 09:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf6de24c-2fce-5019-a0eb-41c0cf48ef9e, identifier: AU50392
2026-03-28 09:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b23310>
2026-03-28 09:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_2b95e9b08cd0d909103292a05c04e702.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_2b95e9b08cd0d909103292a05c04e702.jpg saved to cache
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4bdd4a83-a025-5966-8982-3aa39ebc9962
2026-03-28 09:01:08 [auto1.it] INFO: Channel: 24h | Page: 9 | totalHits: 3430 | hits on page: 40
2026-03-28 09:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_ad48c98304542c5adb8a1f524b6404ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_4c3663595eeeb7ec7ed7148bf89c6037.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_4c3663595eeeb7ec7ed7148bf89c6037.jpg not downloaded yet
2026-03-28 09:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf6de24c-2fce-5019-a0eb-41c0cf48ef9e with identifier: AU50392
2026-03-28 09:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf6de24c-2fce-5019-a0eb-41c0cf48ef9e with identifier: AU50392
2026-03-28 09:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bf6de24c-2fce-5019-a0eb-41c0cf48ef9e with identifier: AU50392 to the API
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_b3f9df10da9af47cac8fc3d4a25c28e8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Rental',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:32:48Z',
 'fuel_type': 'petrol',
 'id': 'bf6de24c-2fce-5019-a0eb-41c0cf48ef9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU50392',
 'listing': 'auction',
 'location': 'IT, Verona',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 104403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_b507e91bfe1d1bd1412b9459671d09e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_c182c8d486adb9f1f5eaf0790f850a9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_8fb1d6d5cc5eabf327a2c809ea359421.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_60fa2aba6f0cd8b1bb80b517d65d8dd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_ed286e29bcf9afa7c9d7fc99c468a75a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_a00ff6a633e02f9e02e1f474380821d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_4b347ade0a9a74085a753afc1ff00d47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_37c4d478efe6ffabb4a0a147f3e15210.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_97b861a5735eedf23105b73c3bf6efd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6de24c-2fce-5019-a0eb-41c0cf48ef9e/bf6de24c-2fce-5019-a0eb-41c0cf48ef9e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7f/b57f67ed447112fa71dd4609b1f48b34/pa/AU50392_b3f9df10da9af47cac8fc3d4a25c28e8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 GL Style',
 'transmission': 'manual',
 'trim': 'GL Style',
 'year': 2013}
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU50392%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [auto1.it] INFO: Saving data for AU50392: {'created_time': 1774688469.324207, 'last_price_update_time': 1774688469.324226, 'auction_closing_time': 1774884768.0}
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AU50392') HTTP/1.1" 204 0
2026-03-28 09:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6f7650>
2026-03-28 09:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_6cc2ddf0281e22a2084c2240340bb593.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_6cc2ddf0281e22a2084c2240340bb593.jpg saved to cache
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4bdd4a83-a025-5966-8982-3aa39ebc9962
2026-03-28 09:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0c048e4-6380-5703-af26-42214e4f4c77 with identifier: TL02972
2026-03-28 09:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0c048e4-6380-5703-af26-42214e4f4c77 with scrape type 1
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f0c048e4-6380-5703-af26-42214e4f4c77
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F88%252F5088d48bbc518f3a2eeb9e51fbef45f2%252Fpa%252FTL02972_6ae67592ffc370aceef87c22e9e17a61.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_6ae67592ffc370aceef87c22e9e17a61.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F88%252F5088d48bbc518f3a2eeb9e51fbef45f2%252Fpa%252FTL02972_c7fb62a1c9bd28f2dc134b5431fb97d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_c7fb62a1c9bd28f2dc134b5431fb97d7.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F88%252F5088d48bbc518f3a2eeb9e51fbef45f2%252Fpa%252FTL02972_67de16e7539463205e55c04e2fc24c0f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_67de16e7539463205e55c04e2fc24c0f.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F88%252F5088d48bbc518f3a2eeb9e51fbef45f2%252Fpa%252FTL02972_5dedc13f07cba1f58e4c3aceb54939bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_5dedc13f07cba1f58e4c3aceb54939bc.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F88%252F5088d48bbc518f3a2eeb9e51fbef45f2%252Fpa%252FTL02972_011871df4c79ea9db1d096ef831ed1ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_011871df4c79ea9db1d096ef831ed1ed.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F88%252F5088d48bbc518f3a2eeb9e51fbef45f2%252Fpa%252FTL02972_5a2eed346e0747924df4b684a1042a01.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_5a2eed346e0747924df4b684a1042a01.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F88%252F5088d48bbc518f3a2eeb9e51fbef45f2%252Fpa%252FTL02972_4acf90f76acc069e373af61e02954dc6.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_4acf90f76acc069e373af61e02954dc6.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F88%252F5088d48bbc518f3a2eeb9e51fbef45f2%252Fpa%252FTL02972_31660669fdbc46498b1ef6eb8691a7d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_31660669fdbc46498b1ef6eb8691a7d7.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F88%252F5088d48bbc518f3a2eeb9e51fbef45f2%252Fpa%252FTL02972_181e40cfe306c07e9742388ea33897f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_181e40cfe306c07e9742388ea33897f9.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F88%252F5088d48bbc518f3a2eeb9e51fbef45f2%252Fpa%252FTL02972_38149f9f4f575b26664ab37ea3b0b514.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_38149f9f4f575b26664ab37ea3b0b514.jpg already downloaded
2026-03-28 09:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f0c048e4-6380-5703-af26-42214e4f4c77, identifier: TL02972
2026-03-28 09:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5f1250b-caa5-5943-96fb-2c6468c38ac1 with identifier: PW21371
2026-03-28 09:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5f1250b-caa5-5943-96fb-2c6468c38ac1 with scrape type 1
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5f1250b-caa5-5943-96fb-2c6468c38ac1
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F1f%252Fa71ff5f0bf891cd6216f7faa8ae0f40c%252Fpa%252FPW21371_04dd7630b56ed9328c050d29e1c35a97.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_04dd7630b56ed9328c050d29e1c35a97.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F1f%252Fa71ff5f0bf891cd6216f7faa8ae0f40c%252Fpa%252FPW21371_c6d89a1215a2714644b0ed7762c629b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_c6d89a1215a2714644b0ed7762c629b5.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F1f%252Fa71ff5f0bf891cd6216f7faa8ae0f40c%252Fpa%252FPW21371_551f186c5722a3a9268831f626eff4c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_551f186c5722a3a9268831f626eff4c2.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F1f%252Fa71ff5f0bf891cd6216f7faa8ae0f40c%252Fpa%252FPW21371_f672a88ec21cafaae66f825b33b7dd4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_f672a88ec21cafaae66f825b33b7dd4e.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F1f%252Fa71ff5f0bf891cd6216f7faa8ae0f40c%252Fpa%252FPW21371_131a10278afc0d8b12879ff6e2092c73.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_131a10278afc0d8b12879ff6e2092c73.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F1f%252Fa71ff5f0bf891cd6216f7faa8ae0f40c%252Fpa%252FPW21371_5ddcdac781760ca3b6b710491271e06a.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_5ddcdac781760ca3b6b710491271e06a.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F1f%252Fa71ff5f0bf891cd6216f7faa8ae0f40c%252Fpa%252FPW21371_4fb1d8cc939ae7de780ea26728d5c8d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_4fb1d8cc939ae7de780ea26728d5c8d3.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F1f%252Fa71ff5f0bf891cd6216f7faa8ae0f40c%252Fpa%252FPW21371_09966f04c813ff9d52f95a528c23627f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_09966f04c813ff9d52f95a528c23627f.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F1f%252Fa71ff5f0bf891cd6216f7faa8ae0f40c%252Fpa%252FPW21371_ad3f32606c2ddc09735edef926e7709f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_ad3f32606c2ddc09735edef926e7709f.jpg already downloaded
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F1f%252Fa71ff5f0bf891cd6216f7faa8ae0f40c%252Fpa%252FPW21371_bbf3a6832ba6d1cc0349119d1637d7b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_bbf3a6832ba6d1cc0349119d1637d7b3.jpg already downloaded
2026-03-28 09:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b5f1250b-caa5-5943-96fb-2c6468c38ac1, identifier: PW21371
2026-03-28 09:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_a88318a9a6aa4614fa8738dbe9ce56a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_215f511553fc7e48f101528baa7390f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_215f511553fc7e48f101528baa7390f1.jpg not downloaded yet
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_1fd5a092134a7967aa9fd06e7aeba9a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_1fd5a092134a7967aa9fd06e7aeba9a0.jpg not downloaded yet
2026-03-28 09:01:09 [auto1.it] INFO: Found listing with ID: GU66352
2026-03-28 09:01:09 [auto1.it] INFO: Found listing with ID: KN87461
2026-03-28 09:01:09 [auto1.it] INFO: Found listing with ID: DY04825
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY04825%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [auto1.it] INFO: Scrape type for DY04825: 0
2026-03-28 09:01:09 [auto1.it] INFO: Found listing with ID: NE32372
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE32372%27 HTTP/1.1" 200 None
2026-03-28 09:01:09 [auto1.it] INFO: Scrape type for NE32372: 0
2026-03-28 09:01:09 [auto1.it] INFO: Found listing with ID: XR49803
2026-03-28 09:01:09 [auto1.it] INFO: Found listing with ID: WM63577
2026-03-28 09:01:09 [auto1.it] INFO: Found listing with ID: GV52121
2026-03-28 09:01:10 [auto1.it] INFO: Found listing with ID: JP45376
2026-03-28 09:01:10 [auto1.it] INFO: Found listing with ID: US40525
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US40525%27 HTTP/1.1" 200 None
2026-03-28 09:01:10 [auto1.it] INFO: Scrape type for US40525: 0
2026-03-28 09:01:10 [auto1.it] INFO: Found listing with ID: MJ86480
2026-03-28 09:01:10 [auto1.it] INFO: Found listing with ID: ZJ84308
2026-03-28 09:01:10 [auto1.it] INFO: Found listing with ID: FE03475
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE03475%27 HTTP/1.1" 200 None
2026-03-28 09:01:10 [auto1.it] INFO: Scrape type for FE03475: 0
2026-03-28 09:01:10 [auto1.it] INFO: Found listing with ID: MW97099
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW97099%27 HTTP/1.1" 200 None
2026-03-28 09:01:10 [auto1.it] INFO: Scrape type for MW97099: 0
2026-03-28 09:01:10 [auto1.it] INFO: Found listing with ID: EU82988
2026-03-28 09:01:10 [auto1.it] INFO: Found listing with ID: BE00286
2026-03-28 09:01:10 [auto1.it] INFO: Found listing with ID: MC12015
2026-03-28 09:01:10 [auto1.it] INFO: Found listing with ID: AW62695
2026-03-28 09:01:10 [auto1.it] INFO: Found listing with ID: SK48941
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK48941%27 HTTP/1.1" 200 None
2026-03-28 09:01:10 [auto1.it] INFO: Scrape type for SK48941: 2
2026-03-28 09:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5082f1d-f4d7-59a1-abf4-d225b478e2ed with identifier: SK48941
2026-03-28 09:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5082f1d-f4d7-59a1-abf4-d225b478e2ed with scrape type 2
2026-03-28 09:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5082f1d-f4d7-59a1-abf4-d225b478e2ed with scrape type 2
2026-03-28 09:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a5082f1d-f4d7-59a1-abf4-d225b478e2ed, identifier: SK48941
2026-03-28 09:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f0c048e4-6380-5703-af26-42214e4f4c77 with identifier: TL02972
2026-03-28 09:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f0c048e4-6380-5703-af26-42214e4f4c77 with identifier: TL02972
2026-03-28 09:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f0c048e4-6380-5703-af26-42214e4f4c77 with identifier: TL02972 to the API
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TL02972>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:39:56Z',
 'fuel_type': 'diesel',
 'id': 'f0c048e4-6380-5703-af26-42214e4f4c77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL02972',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 204129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_6ae67592ffc370aceef87c22e9e17a61.jpg',
                'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_c7fb62a1c9bd28f2dc134b5431fb97d7.jpg',
                'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_67de16e7539463205e55c04e2fc24c0f.jpg',
                'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_5dedc13f07cba1f58e4c3aceb54939bc.jpg',
                'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_011871df4c79ea9db1d096ef831ed1ed.jpg',
                'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_5a2eed346e0747924df4b684a1042a01.jpg',
                'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_4acf90f76acc069e373af61e02954dc6.jpg',
                'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_31660669fdbc46498b1ef6eb8691a7d7.jpg',
                'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_181e40cfe306c07e9742388ea33897f9.jpg',
                'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_38149f9f4f575b26664ab37ea3b0b514.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0c048e4-6380-5703-af26-42214e4f4c77/f0c048e4-6380-5703-af26-42214e4f4c77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2767941,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_6ae67592ffc370aceef87c22e9e17a61.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0c048e4-6380-5703-af26-42214e4f4c77/f0c048e4-6380-5703-af26-42214e4f4c77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2837359,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_c7fb62a1c9bd28f2dc134b5431fb97d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0c048e4-6380-5703-af26-42214e4f4c77/f0c048e4-6380-5703-af26-42214e4f4c77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2636413,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_67de16e7539463205e55c04e2fc24c0f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0c048e4-6380-5703-af26-42214e4f4c77/f0c048e4-6380-5703-af26-42214e4f4c77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_5dedc13f07cba1f58e4c3aceb54939bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0c048e4-6380-5703-af26-42214e4f4c77/f0c048e4-6380-5703-af26-42214e4f4c77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_011871df4c79ea9db1d096ef831ed1ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0c048e4-6380-5703-af26-42214e4f4c77/f0c048e4-6380-5703-af26-42214e4f4c77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_5a2eed346e0747924df4b684a1042a01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0c048e4-6380-5703-af26-42214e4f4c77/f0c048e4-6380-5703-af26-42214e4f4c77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2361523,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_4acf90f76acc069e373af61e02954dc6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0c048e4-6380-5703-af26-42214e4f4c77/f0c048e4-6380-5703-af26-42214e4f4c77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2531831,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_31660669fdbc46498b1ef6eb8691a7d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0c048e4-6380-5703-af26-42214e4f4c77/f0c048e4-6380-5703-af26-42214e4f4c77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2650871,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_181e40cfe306c07e9742388ea33897f9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0c048e4-6380-5703-af26-42214e4f4c77/f0c048e4-6380-5703-af26-42214e4f4c77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2539980,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/88/5088d48bbc518f3a2eeb9e51fbef45f2/pa/TL02972_38149f9f4f575b26664ab37ea3b0b514.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2017}
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL02972%27 HTTP/1.1" 200 None
2026-03-28 09:01:10 [auto1.it] INFO: Saving data for TL02972: {'created_time': 1774688470.530275, 'last_price_update_time': 1774688470.530288, 'auction_closing_time': 1774885196.0}
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TL02972') HTTP/1.1" 204 0
2026-03-28 09:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b5f1250b-caa5-5943-96fb-2c6468c38ac1 with identifier: PW21371
2026-03-28 09:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b5f1250b-caa5-5943-96fb-2c6468c38ac1 with identifier: PW21371
2026-03-28 09:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b5f1250b-caa5-5943-96fb-2c6468c38ac1 with identifier: PW21371 to the API
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PW21371>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:09:08Z',
 'fuel_type': 'diesel',
 'id': 'b5f1250b-caa5-5943-96fb-2c6468c38ac1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW21371',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 208990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_04dd7630b56ed9328c050d29e1c35a97.jpg',
                'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_c6d89a1215a2714644b0ed7762c629b5.jpg',
                'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_551f186c5722a3a9268831f626eff4c2.jpg',
                'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_f672a88ec21cafaae66f825b33b7dd4e.jpg',
                'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_131a10278afc0d8b12879ff6e2092c73.jpg',
                'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_5ddcdac781760ca3b6b710491271e06a.jpg',
                'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_4fb1d8cc939ae7de780ea26728d5c8d3.jpg',
                'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_09966f04c813ff9d52f95a528c23627f.jpg',
                'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_ad3f32606c2ddc09735edef926e7709f.jpg',
                'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_bbf3a6832ba6d1cc0349119d1637d7b3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1250b-caa5-5943-96fb-2c6468c38ac1/b5f1250b-caa5-5943-96fb-2c6468c38ac1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_04dd7630b56ed9328c050d29e1c35a97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1250b-caa5-5943-96fb-2c6468c38ac1/b5f1250b-caa5-5943-96fb-2c6468c38ac1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_c6d89a1215a2714644b0ed7762c629b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1250b-caa5-5943-96fb-2c6468c38ac1/b5f1250b-caa5-5943-96fb-2c6468c38ac1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_551f186c5722a3a9268831f626eff4c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1250b-caa5-5943-96fb-2c6468c38ac1/b5f1250b-caa5-5943-96fb-2c6468c38ac1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_f672a88ec21cafaae66f825b33b7dd4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1250b-caa5-5943-96fb-2c6468c38ac1/b5f1250b-caa5-5943-96fb-2c6468c38ac1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_131a10278afc0d8b12879ff6e2092c73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1250b-caa5-5943-96fb-2c6468c38ac1/b5f1250b-caa5-5943-96fb-2c6468c38ac1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_5ddcdac781760ca3b6b710491271e06a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1250b-caa5-5943-96fb-2c6468c38ac1/b5f1250b-caa5-5943-96fb-2c6468c38ac1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_4fb1d8cc939ae7de780ea26728d5c8d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1250b-caa5-5943-96fb-2c6468c38ac1/b5f1250b-caa5-5943-96fb-2c6468c38ac1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_09966f04c813ff9d52f95a528c23627f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1250b-caa5-5943-96fb-2c6468c38ac1/b5f1250b-caa5-5943-96fb-2c6468c38ac1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_ad3f32606c2ddc09735edef926e7709f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1250b-caa5-5943-96fb-2c6468c38ac1/b5f1250b-caa5-5943-96fb-2c6468c38ac1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/1f/a71ff5f0bf891cd6216f7faa8ae0f40c/pa/PW21371_bbf3a6832ba6d1cc0349119d1637d7b3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW21371%27 HTTP/1.1" 200 None
2026-03-28 09:01:10 [auto1.it] INFO: Saving data for PW21371: {'created_time': 1774688470.999209, 'last_price_update_time': 1774688470.999221, 'auction_closing_time': 1774883348.0}
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PW21371') HTTP/1.1" 204 0
2026-03-28 09:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_0025f5927308c1949dcadc62b3016856.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_991faf579e5db1344d6e7ff68af4c406.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_991faf579e5db1344d6e7ff68af4c406.jpg not downloaded yet
2026-03-28 09:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a5082f1d-f4d7-59a1-abf4-d225b478e2ed with identifier: SK48941
2026-03-28 09:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a5082f1d-f4d7-59a1-abf4-d225b478e2ed with identifier: SK48941
2026-03-28 09:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a5082f1d-f4d7-59a1-abf4-d225b478e2ed with identifier: SK48941 to the API
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:09:43Z',
 'fuel_type': 'diesel',
 'id': 'a5082f1d-f4d7-59a1-abf4-d225b478e2ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK48941',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 306286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-07',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Sd4 Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2012}
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK48941%27 HTTP/1.1" 200 None
2026-03-28 09:01:11 [auto1.it] INFO: Saving data for SK48941: {'auction_closing_time': 1774714183.0, 'created_time': 1772784357.0611129, 'last_price_update_time': 1774688471.371445}
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SK48941') HTTP/1.1" 204 0
2026-03-28 09:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL36522> (referer: https://www.auto1.com/v1/car-details-view/XL36522/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19a3eb90>
2026-03-28 09:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_87e89287ef6055512dfee66504a0f4af.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_87e89287ef6055512dfee66504a0f4af.jpg saved to cache
2026-03-28 09:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff6890d4-a840-546e-a6b8-95d4b516185a
2026-03-28 09:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19a33cd0>
2026-03-28 09:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_68f24a331f4647d946ffb6f23fc017be.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_68f24a331f4647d946ffb6f23fc017be.jpg saved to cache
2026-03-28 09:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4bdd4a83-a025-5966-8982-3aa39ebc9962
2026-03-28 09:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_cf19710658a2cb0e539773c094b276e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_53c65208e83316f2627575d09aa4a15b.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_77fea6cb68e8c0d0075cec80a9b14dd4.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_77fea6cb68e8c0d0075cec80a9b14dd4.jpg not downloaded yet
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_769f1c16768442893910d4363a7d07e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_769f1c16768442893910d4363a7d07e5.jpg not downloaded yet
2026-03-28 09:01:11 [auto1.it] INFO: Found listing with ID: CM36340
2026-03-28 09:01:11 [auto1.it] INFO: Found listing with ID: CZ82762
2026-03-28 09:01:11 [auto1.it] INFO: Found listing with ID: SB02789
2026-03-28 09:01:11 [auto1.it] INFO: Found listing with ID: NA90799
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA90799%27 HTTP/1.1" 200 None
2026-03-28 09:01:11 [auto1.it] INFO: Scrape type for NA90799: 0
2026-03-28 09:01:11 [auto1.it] INFO: Found listing with ID: YN65512
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN65512%27 HTTP/1.1" 200 None
2026-03-28 09:01:11 [auto1.it] INFO: Scrape type for YN65512: 0
2026-03-28 09:01:11 [auto1.it] INFO: Found listing with ID: GG10303
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG10303%27 HTTP/1.1" 200 None
2026-03-28 09:01:11 [auto1.it] INFO: Scrape type for GG10303: 0
2026-03-28 09:01:11 [auto1.it] INFO: Found listing with ID: WR41361
2026-03-28 09:01:11 [auto1.it] INFO: Found listing with ID: SE28120
2026-03-28 09:01:11 [auto1.it] INFO: Found listing with ID: MG07654
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG07654%27 HTTP/1.1" 200 None
2026-03-28 09:01:11 [auto1.it] INFO: Scrape type for MG07654: 0
2026-03-28 09:01:11 [auto1.it] INFO: Found listing with ID: TP85930
2026-03-28 09:01:11 [auto1.it] INFO: Found listing with ID: MM75159
2026-03-28 09:01:11 [auto1.it] INFO: Found listing with ID: NK94790
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK94790%27 HTTP/1.1" 200 None
2026-03-28 09:01:11 [auto1.it] INFO: Scrape type for NK94790: 0
2026-03-28 09:01:11 [auto1.it] INFO: Found listing with ID: TG60202
2026-03-28 09:01:11 [auto1.it] INFO: Found listing with ID: MF09411
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MF09411%27 HTTP/1.1" 200 None
2026-03-28 09:01:11 [auto1.it] INFO: Scrape type for MF09411: 0
2026-03-28 09:01:11 [auto1.it] INFO: Found listing with ID: ZR48768
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR48768%27 HTTP/1.1" 200 None
2026-03-28 09:01:11 [auto1.it] INFO: Scrape type for ZR48768: 0
2026-03-28 09:01:11 [auto1.it] INFO: Found listing with ID: VA22015
2026-03-28 09:01:11 [auto1.it] INFO: Found listing with ID: RJ99533
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ99533%27 HTTP/1.1" 200 None
2026-03-28 09:01:11 [auto1.it] INFO: Scrape type for RJ99533: 2
2026-03-28 09:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdf3be22-d96f-530b-ae8b-c66212b6be60 with identifier: RJ99533
2026-03-28 09:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdf3be22-d96f-530b-ae8b-c66212b6be60 with scrape type 2
2026-03-28 09:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdf3be22-d96f-530b-ae8b-c66212b6be60 with scrape type 2
2026-03-28 09:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cdf3be22-d96f-530b-ae8b-c66212b6be60, identifier: RJ99533
2026-03-28 09:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19a5f0d0>
2026-03-28 09:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_ad48c98304542c5adb8a1f524b6404ac.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_ad48c98304542c5adb8a1f524b6404ac.jpg saved to cache
2026-03-28 09:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff6890d4-a840-546e-a6b8-95d4b516185a
2026-03-28 09:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_4ac7a1f4bdb3506caa608e42114c75fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_775e65c5eeb691a4523dacf21013d73f.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_775e65c5eeb691a4523dacf21013d73f.jpg not downloaded yet
2026-03-28 09:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cdf3be22-d96f-530b-ae8b-c66212b6be60 with identifier: RJ99533
2026-03-28 09:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cdf3be22-d96f-530b-ae8b-c66212b6be60 with identifier: RJ99533
2026-03-28 09:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cdf3be22-d96f-530b-ae8b-c66212b6be60 with identifier: RJ99533 to the API
2026-03-28 09:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:16:17Z',
 'fuel_type': 'diesel',
 'id': 'cdf3be22-d96f-530b-ae8b-c66212b6be60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ99533',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 157965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-20',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 TDCi Business Nav',
 'transmission': 'automatic',
 'trim': 'Business Nav',
 'year': 2019}
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ99533%27 HTTP/1.1" 200 None
2026-03-28 09:01:12 [auto1.it] INFO: Saving data for RJ99533: {'auction_closing_time': 1774714577.0, 'created_time': 1772784647.847542, 'last_price_update_time': 1774688472.185387}
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RJ99533') HTTP/1.1" 204 0
2026-03-28 09:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a684a10>
2026-03-28 09:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_a88318a9a6aa4614fa8738dbe9ce56a1.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_a88318a9a6aa4614fa8738dbe9ce56a1.jpg saved to cache
2026-03-28 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4bdd4a83-a025-5966-8982-3aa39ebc9962
2026-03-28 09:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_7bbfbe277e45ac76c369f3c36a2afbbb.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_575f8e4c18fe75e93c8d0c264694f019.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_5476cf1c1cd84373f0894e2583cdeb28.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_5476cf1c1cd84373f0894e2583cdeb28.jpg not downloaded yet
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_e65ff2c89a8dbc79a2feefab773d1403.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_e65ff2c89a8dbc79a2feefab773d1403.jpg not downloaded yet
2026-03-28 09:01:12 [auto1.it] INFO: Found listing with ID: MW88015
2026-03-28 09:01:12 [auto1.it] INFO: Found listing with ID: BZ76072
2026-03-28 09:01:12 [auto1.it] INFO: Found listing with ID: MY09959
2026-03-28 09:01:12 [auto1.it] INFO: Found listing with ID: YD29186
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD29186%27 HTTP/1.1" 200 None
2026-03-28 09:01:12 [auto1.it] INFO: Scrape type for YD29186: 2
2026-03-28 09:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 127b3eaa-53a6-5cca-b09a-b336031a081e with identifier: YD29186
2026-03-28 09:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 127b3eaa-53a6-5cca-b09a-b336031a081e with scrape type 2
2026-03-28 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 127b3eaa-53a6-5cca-b09a-b336031a081e with scrape type 2
2026-03-28 09:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 127b3eaa-53a6-5cca-b09a-b336031a081e, identifier: YD29186
2026-03-28 09:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19bce490>
2026-03-28 09:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_0025f5927308c1949dcadc62b3016856.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_0025f5927308c1949dcadc62b3016856.jpg saved to cache
2026-03-28 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff6890d4-a840-546e-a6b8-95d4b516185a
2026-03-28 09:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_4c3663595eeeb7ec7ed7148bf89c6037.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_d402c3ec8f293871420b1656aa503ed0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_8c8d233fd8f889ef148bd8c56c36e69c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_8c8d233fd8f889ef148bd8c56c36e69c.jpg not downloaded yet
2026-03-28 09:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 127b3eaa-53a6-5cca-b09a-b336031a081e with identifier: YD29186
2026-03-28 09:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 127b3eaa-53a6-5cca-b09a-b336031a081e with identifier: YD29186
2026-03-28 09:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 127b3eaa-53a6-5cca-b09a-b336031a081e with identifier: YD29186 to the API
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:04:32Z',
 'fuel_type': 'petrol',
 'id': '127b3eaa-53a6-5cca-b09a-b336031a081e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD29186',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 164927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-31',
 'seller_name': None,
 'title': 'Fiat 500L 1.4 Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2016}
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD29186%27 HTTP/1.1" 200 None
2026-03-28 09:01:12 [auto1.it] INFO: Saving data for YD29186: {'auction_closing_time': 1774713872.0, 'created_time': 1773269706.503204, 'last_price_update_time': 1774688472.872131}
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YD29186') HTTP/1.1" 204 0
2026-03-28 09:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58e2a63a-002e-5c18-9686-90d7731f8a23 with identifier: XL36522
2026-03-28 09:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58e2a63a-002e-5c18-9686-90d7731f8a23 with scrape type 1
2026-03-28 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58e2a63a-002e-5c18-9686-90d7731f8a23
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_dda98c7e9f1da1d88cbe2d3b8a7a4523.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_dda98c7e9f1da1d88cbe2d3b8a7a4523.jpg not downloaded yet
2026-03-28 09:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cb8910>
2026-03-28 09:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_cf19710658a2cb0e539773c094b276e5.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_cf19710658a2cb0e539773c094b276e5.jpg saved to cache
2026-03-28 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d
2026-03-28 09:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19e15350>
2026-03-28 09:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_53c65208e83316f2627575d09aa4a15b.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_53c65208e83316f2627575d09aa4a15b.jpg saved to cache
2026-03-28 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4bdd4a83-a025-5966-8982-3aa39ebc9962
2026-03-28 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_f19fad2ae034e69a1fa3d79356264082.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_f19fad2ae034e69a1fa3d79356264082.jpg not downloaded yet
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_f84af7942d4564872d51e1df552b3929.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_f84af7942d4564872d51e1df552b3929.jpg not downloaded yet
2026-03-28 09:01:13 [auto1.it] INFO: Found listing with ID: TJ75665
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ75665%27 HTTP/1.1" 200 None
2026-03-28 09:01:13 [auto1.it] INFO: Scrape type for TJ75665: 0
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c070d0>
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_4ac7a1f4bdb3506caa608e42114c75fe.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_4ac7a1f4bdb3506caa608e42114c75fe.jpg saved to cache
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff6890d4-a840-546e-a6b8-95d4b516185a
2026-03-28 09:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_215f511553fc7e48f101528baa7390f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_1fd5a092134a7967aa9fd06e7aeba9a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_54625f5d9b6af878bcc8322c8764e4e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_54625f5d9b6af878bcc8322c8764e4e3.jpg not downloaded yet
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19e0dd10>
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_7bbfbe277e45ac76c369f3c36a2afbbb.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_7bbfbe277e45ac76c369f3c36a2afbbb.jpg saved to cache
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19df6bd0>
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_575f8e4c18fe75e93c8d0c264694f019.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_575f8e4c18fe75e93c8d0c264694f019.jpg saved to cache
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4bdd4a83-a025-5966-8982-3aa39ebc9962
2026-03-28 09:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_769f1c16768442893910d4363a7d07e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_991faf579e5db1344d6e7ff68af4c406.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_9dfbe843b289c9248b17a9a6b16f9bcf.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_9dfbe843b289c9248b17a9a6b16f9bcf.jpg not downloaded yet
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_365afbafc9251f1ebfb7cb188d058483.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_365afbafc9251f1ebfb7cb188d058483.jpg not downloaded yet
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c9e010>
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_4c3663595eeeb7ec7ed7148bf89c6037.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_4c3663595eeeb7ec7ed7148bf89c6037.jpg saved to cache
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4bdd4a83-a025-5966-8982-3aa39ebc9962
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19b61c50>
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_d402c3ec8f293871420b1656aa503ed0.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_d402c3ec8f293871420b1656aa503ed0.jpg saved to cache
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff6890d4-a840-546e-a6b8-95d4b516185a
2026-03-28 09:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_77fea6cb68e8c0d0075cec80a9b14dd4.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_dfd60fcee0261c0dac7356462ab73a99.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_dfd60fcee0261c0dac7356462ab73a99.jpg not downloaded yet
2026-03-28 09:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_e65ff2c89a8dbc79a2feefab773d1403.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_775e65c5eeb691a4523dacf21013d73f.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_8e5df6309a76b3b89f1ca8dbf2635277.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_8e5df6309a76b3b89f1ca8dbf2635277.jpg not downloaded yet
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_bf22a00877a26f1ca1fe1c47853483f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_bf22a00877a26f1ca1fe1c47853483f6.jpg not downloaded yet
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6f6890>
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_215f511553fc7e48f101528baa7390f1.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_215f511553fc7e48f101528baa7390f1.jpg saved to cache
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff6890d4-a840-546e-a6b8-95d4b516185a
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1c564a10>
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_1fd5a092134a7967aa9fd06e7aeba9a0.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_1fd5a092134a7967aa9fd06e7aeba9a0.jpg saved to cache
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19d281d0>
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_769f1c16768442893910d4363a7d07e5.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_769f1c16768442893910d4363a7d07e5.jpg saved to cache
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a623910>
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_991faf579e5db1344d6e7ff68af4c406.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_991faf579e5db1344d6e7ff68af4c406.jpg saved to cache
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4bdd4a83-a025-5966-8982-3aa39ebc9962
2026-03-28 09:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_8c8d233fd8f889ef148bd8c56c36e69c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_2961234e9e438f18928e786519d8a680.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_2961234e9e438f18928e786519d8a680.jpg not downloaded yet
2026-03-28 09:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_f84af7942d4564872d51e1df552b3929.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_dda98c7e9f1da1d88cbe2d3b8a7a4523.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_67035e5fd1718682b2a15a62cdd12e28.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_67035e5fd1718682b2a15a62cdd12e28.jpg not downloaded yet
2026-03-28 09:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_f19fad2ae034e69a1fa3d79356264082.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_54625f5d9b6af878bcc8322c8764e4e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_8e508dbeb34a6b6cc786bba63701c93c.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_8e508dbeb34a6b6cc786bba63701c93c.jpg not downloaded yet
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_0862d79c0f7824af5ce41ddba3bd0696.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_0862d79c0f7824af5ce41ddba3bd0696.jpg not downloaded yet
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cfd5d0>
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_77fea6cb68e8c0d0075cec80a9b14dd4.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_77fea6cb68e8c0d0075cec80a9b14dd4.jpg saved to cache
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff6890d4-a840-546e-a6b8-95d4b516185a
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19dc2590>
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_e65ff2c89a8dbc79a2feefab773d1403.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_e65ff2c89a8dbc79a2feefab773d1403.jpg saved to cache
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c54710>
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_775e65c5eeb691a4523dacf21013d73f.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_775e65c5eeb691a4523dacf21013d73f.jpg saved to cache
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4bdd4a83-a025-5966-8982-3aa39ebc9962
2026-03-28 09:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_365afbafc9251f1ebfb7cb188d058483.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_9dfbe843b289c9248b17a9a6b16f9bcf.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_14e45ea59f09ae6ee61e7e86a66409d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_14e45ea59f09ae6ee61e7e86a66409d4.jpg not downloaded yet
2026-03-28 09:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_dfd60fcee0261c0dac7356462ab73a99.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_bf22a00877a26f1ca1fe1c47853483f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a637890>
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F1f%252Ff21f3b95937bf9a4abfd63bfe7d75ab3%252Fpa%252FRG79014_8c8d233fd8f889ef148bd8c56c36e69c.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_8c8d233fd8f889ef148bd8c56c36e69c.jpg saved to cache
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4bdd4a83-a025-5966-8982-3aa39ebc9962
2026-03-28 09:01:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4bdd4a83-a025-5966-8982-3aa39ebc9962, skipping ID generation
2026-03-28 09:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bdd4a83-a025-5966-8982-3aa39ebc9962 with scrape type 1
2026-03-28 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4bdd4a83-a025-5966-8982-3aa39ebc9962 sending to next pipeline
2026-03-28 09:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4bdd4a83-a025-5966-8982-3aa39ebc9962, identifier: RG79014
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cc1a50>
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_f84af7942d4564872d51e1df552b3929.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_f84af7942d4564872d51e1df552b3929.jpg saved to cache
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1c922990>
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_0.jpg HTTP/1.1" 201 0
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_dda98c7e9f1da1d88cbe2d3b8a7a4523.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_dda98c7e9f1da1d88cbe2d3b8a7a4523.jpg saved to cache
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58e2a63a-002e-5c18-9686-90d7731f8a23
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6d1290>
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_f19fad2ae034e69a1fa3d79356264082.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_f19fad2ae034e69a1fa3d79356264082.jpg saved to cache
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff6890d4-a840-546e-a6b8-95d4b516185a
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19a363d0>
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_1.jpg HTTP/1.1" 201 0
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_54625f5d9b6af878bcc8322c8764e4e3.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_54625f5d9b6af878bcc8322c8764e4e3.jpg saved to cache
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58e2a63a-002e-5c18-9686-90d7731f8a23
2026-03-28 09:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_2961234e9e438f18928e786519d8a680.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_8e5df6309a76b3b89f1ca8dbf2635277.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_8ce76c7bd1308be2645b2daa3283e1b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_8ce76c7bd1308be2645b2daa3283e1b7.jpg not downloaded yet
2026-03-28 09:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4bdd4a83-a025-5966-8982-3aa39ebc9962 with identifier: RG79014
2026-03-28 09:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4bdd4a83-a025-5966-8982-3aa39ebc9962 with identifier: RG79014
2026-03-28 09:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4bdd4a83-a025-5966-8982-3aa39ebc9962 with identifier: RG79014 to the API
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_8c8d233fd8f889ef148bd8c56c36e69c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 249,
 'expiration_date': '2026-03-30T15:33:07Z',
 'fuel_type': 'diesel',
 'id': '4bdd4a83-a025-5966-8982-3aa39ebc9962',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG79014',
 'listing': 'auction',
 'location': 'IT, Creazzo VI',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 149001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_2b95e9b08cd0d909103292a05c04e702.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_6cc2ddf0281e22a2084c2240340bb593.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_68f24a331f4647d946ffb6f23fc017be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_a88318a9a6aa4614fa8738dbe9ce56a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_53c65208e83316f2627575d09aa4a15b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_575f8e4c18fe75e93c8d0c264694f019.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_4c3663595eeeb7ec7ed7148bf89c6037.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_991faf579e5db1344d6e7ff68af4c406.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_775e65c5eeb691a4523dacf21013d73f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdd4a83-a025-5966-8982-3aa39ebc9962/4bdd4a83-a025-5966-8982-3aa39ebc9962_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/1f/f21f3b95937bf9a4abfd63bfe7d75ab3/pa/RG79014_8c8d233fd8f889ef148bd8c56c36e69c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-05',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2022}
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG79014%27 HTTP/1.1" 200 None
2026-03-28 09:01:14 [auto1.it] INFO: Saving data for RG79014: {'created_time': 1774688474.594693, 'last_price_update_time': 1774688474.594703, 'auction_closing_time': 1774884787.0}
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RG79014') HTTP/1.1" 204 0
2026-03-28 09:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_67035e5fd1718682b2a15a62cdd12e28.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_986bf998429e1cc54723515e43053630.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_986bf998429e1cc54723515e43053630.jpg not downloaded yet
2026-03-28 09:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_8e508dbeb34a6b6cc786bba63701c93c.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a781250>
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_365afbafc9251f1ebfb7cb188d058483.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_365afbafc9251f1ebfb7cb188d058483.jpg saved to cache
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cb7190>
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_9dfbe843b289c9248b17a9a6b16f9bcf.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_9dfbe843b289c9248b17a9a6b16f9bcf.jpg saved to cache
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff6890d4-a840-546e-a6b8-95d4b516185a
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19dc1910>
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_2.jpg HTTP/1.1" 201 0
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_dfd60fcee0261c0dac7356462ab73a99.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_dfd60fcee0261c0dac7356462ab73a99.jpg saved to cache
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58e2a63a-002e-5c18-9686-90d7731f8a23
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a6dc350>
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_3.jpg HTTP/1.1" 201 0
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_bf22a00877a26f1ca1fe1c47853483f6.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_bf22a00877a26f1ca1fe1c47853483f6.jpg saved to cache
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58e2a63a-002e-5c18-9686-90d7731f8a23
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a68f690>
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_2961234e9e438f18928e786519d8a680.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_2961234e9e438f18928e786519d8a680.jpg saved to cache
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c15350>
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_8e5df6309a76b3b89f1ca8dbf2635277.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_8e5df6309a76b3b89f1ca8dbf2635277.jpg saved to cache
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_23f949629e9ae9c052d0c0e8538f1013.jpg%27 HTTP/1.1" 200 None
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_23f949629e9ae9c052d0c0e8538f1013.jpg not downloaded yet
2026-03-28 09:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_14e45ea59f09ae6ee61e7e86a66409d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_0862d79c0f7824af5ce41ddba3bd0696.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19c06810>
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_4.jpg HTTP/1.1" 201 0
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_67035e5fd1718682b2a15a62cdd12e28.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_67035e5fd1718682b2a15a62cdd12e28.jpg saved to cache
2026-03-28 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58e2a63a-002e-5c18-9686-90d7731f8a23
2026-03-28 09:01:14 [auto1.it] INFO: Channel: 24h | Page: 10 | totalHits: 3430 | hits on page: 40
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a708c50>
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79ed14ed0b10f16e05aa98e100d4f583%252Fpa%252FWJ93918_8e508dbeb34a6b6cc786bba63701c93c.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_8e508dbeb34a6b6cc786bba63701c93c.jpg saved to cache
2026-03-28 09:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d
2026-03-28 09:01:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d, skipping ID generation
2026-03-28 09:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d with scrape type 1
2026-03-28 09:01:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d sending to next pipeline
2026-03-28 09:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d, identifier: WJ93918
2026-03-28 09:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d with identifier: WJ93918
2026-03-28 09:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d with identifier: WJ93918
2026-03-28 09:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d with identifier: WJ93918 to the API
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_8e508dbeb34a6b6cc786bba63701c93c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:34:42Z',
 'fuel_type': 'petrol',
 'id': '3adcadb9-bc54-53b7-8c2d-ef2a711bb45d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ93918',
 'listing': 'auction',
 'location': 'IT, Camerano (AN)',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 150720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_cf19710658a2cb0e539773c094b276e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_7bbfbe277e45ac76c369f3c36a2afbbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_1fd5a092134a7967aa9fd06e7aeba9a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_769f1c16768442893910d4363a7d07e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_e65ff2c89a8dbc79a2feefab773d1403.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_f84af7942d4564872d51e1df552b3929.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_365afbafc9251f1ebfb7cb188d058483.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_8e5df6309a76b3b89f1ca8dbf2635277.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_2961234e9e438f18928e786519d8a680.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3adcadb9-bc54-53b7-8c2d-ef2a711bb45d/3adcadb9-bc54-53b7-8c2d-ef2a711bb45d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed14ed0b10f16e05aa98e100d4f583/pa/WJ93918_8e508dbeb34a6b6cc786bba63701c93c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2016}
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ93918%27 HTTP/1.1" 200 None
2026-03-28 09:01:15 [auto1.it] INFO: Saving data for WJ93918: {'created_time': 1774688475.528678, 'last_price_update_time': 1774688475.528688, 'auction_closing_time': 1774884882.0}
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WJ93918') HTTP/1.1" 204 0
2026-03-28 09:01:15 [auto1.it] INFO: Found listing with ID: MC88266
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC88266%27 HTTP/1.1" 200 None
2026-03-28 09:01:15 [auto1.it] INFO: Scrape type for MC88266: 0
2026-03-28 09:01:15 [auto1.it] INFO: Found listing with ID: NY04443
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY04443%27 HTTP/1.1" 200 None
2026-03-28 09:01:15 [auto1.it] INFO: Scrape type for NY04443: 2
2026-03-28 09:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6c8ac5c-dc35-54e8-bbd7-75493044dbe6 with identifier: NY04443
2026-03-28 09:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6c8ac5c-dc35-54e8-bbd7-75493044dbe6 with scrape type 2
2026-03-28 09:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6c8ac5c-dc35-54e8-bbd7-75493044dbe6 with scrape type 2
2026-03-28 09:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e6c8ac5c-dc35-54e8-bbd7-75493044dbe6, identifier: NY04443
2026-03-28 09:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_8ce76c7bd1308be2645b2daa3283e1b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_986bf998429e1cc54723515e43053630.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e6c8ac5c-dc35-54e8-bbd7-75493044dbe6 with identifier: NY04443
2026-03-28 09:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e6c8ac5c-dc35-54e8-bbd7-75493044dbe6 with identifier: NY04443
2026-03-28 09:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e6c8ac5c-dc35-54e8-bbd7-75493044dbe6 with identifier: NY04443 to the API
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-28T16:53:27Z',
 'fuel_type': 'diesel',
 'id': 'e6c8ac5c-dc35-54e8-bbd7-75493044dbe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY04443',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 64947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-29',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 B5 Mild-Hybrid Plus Bright AWD',
 'transmission': 'automatic',
 'trim': 'Plus Bright AWD',
 'year': 2022}
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY04443%27 HTTP/1.1" 200 None
2026-03-28 09:01:15 [auto1.it] INFO: Saving data for NY04443: {'auction_closing_time': 1774716807.0, 'created_time': 1773137920.271193, 'last_price_update_time': 1774688475.986259}
2026-03-28 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NY04443') HTTP/1.1" 204 0
2026-03-28 09:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab19cf7f90>
2026-03-28 09:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_6.jpg HTTP/1.1" 201 0
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_14e45ea59f09ae6ee61e7e86a66409d4.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_14e45ea59f09ae6ee61e7e86a66409d4.jpg saved to cache
2026-03-28 09:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58e2a63a-002e-5c18-9686-90d7731f8a23
2026-03-28 09:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a70cf50>
2026-03-28 09:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_5.jpg HTTP/1.1" 201 0
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_0862d79c0f7824af5ce41ddba3bd0696.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_0862d79c0f7824af5ce41ddba3bd0696.jpg saved to cache
2026-03-28 09:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58e2a63a-002e-5c18-9686-90d7731f8a23
2026-03-28 09:01:16 [auto1.it] INFO: Found listing with ID: AR32020
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR32020%27 HTTP/1.1" 200 None
2026-03-28 09:01:16 [auto1.it] INFO: Scrape type for AR32020: 2
2026-03-28 09:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ceacd756-af46-5ea7-8388-ed877c0696f8 with identifier: AR32020
2026-03-28 09:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceacd756-af46-5ea7-8388-ed877c0696f8 with scrape type 2
2026-03-28 09:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ceacd756-af46-5ea7-8388-ed877c0696f8 with scrape type 2
2026-03-28 09:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ceacd756-af46-5ea7-8388-ed877c0696f8, identifier: AR32020
2026-03-28 09:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_23f949629e9ae9c052d0c0e8538f1013.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ceacd756-af46-5ea7-8388-ed877c0696f8 with identifier: AR32020
2026-03-28 09:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ceacd756-af46-5ea7-8388-ed877c0696f8 with identifier: AR32020
2026-03-28 09:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ceacd756-af46-5ea7-8388-ed877c0696f8 with identifier: AR32020 to the API
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:31:13Z',
 'fuel_type': 'diesel',
 'id': 'ceacd756-af46-5ea7-8388-ed877c0696f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR32020',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 107715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-27',
 'seller_name': None,
 'title': 'BMW X2 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR32020%27 HTTP/1.1" 200 None
2026-03-28 09:01:16 [auto1.it] INFO: Saving data for AR32020: {'auction_closing_time': 1774715473.0, 'created_time': 1773268142.151662, 'last_price_update_time': 1774688476.518004}
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AR32020') HTTP/1.1" 204 0
2026-03-28 09:01:16 [auto1.it] INFO: Found listing with ID: XU30878
2026-03-28 09:01:16 [auto1.it] INFO: Found listing with ID: AZ02575
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ02575%27 HTTP/1.1" 200 None
2026-03-28 09:01:16 [auto1.it] INFO: Scrape type for AZ02575: 0
2026-03-28 09:01:16 [auto1.it] INFO: Found listing with ID: WB02861
2026-03-28 09:01:16 [auto1.it] INFO: Found listing with ID: XT03089
2026-03-28 09:01:16 [auto1.it] INFO: Found listing with ID: XT75480
2026-03-28 09:01:16 [auto1.it] INFO: Found listing with ID: TL73413
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL73413%27 HTTP/1.1" 200 None
2026-03-28 09:01:16 [auto1.it] INFO: Scrape type for TL73413: 0
2026-03-28 09:01:16 [auto1.it] INFO: Found listing with ID: BZ22923
2026-03-28 09:01:16 [auto1.it] INFO: Found listing with ID: MA55202
2026-03-28 09:01:16 [auto1.it] INFO: Found listing with ID: EA99389
2026-03-28 09:01:16 [auto1.it] INFO: Found listing with ID: AB06670
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB06670%27 HTTP/1.1" 200 None
2026-03-28 09:01:16 [auto1.it] INFO: Scrape type for AB06670: 0
2026-03-28 09:01:16 [auto1.it] INFO: Found listing with ID: HD69020
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD69020%27 HTTP/1.1" 200 None
2026-03-28 09:01:16 [auto1.it] INFO: Scrape type for HD69020: 0
2026-03-28 09:01:16 [auto1.it] INFO: Found listing with ID: DD62614
2026-03-28 09:01:16 [auto1.it] INFO: Found listing with ID: YR53882
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR53882%27 HTTP/1.1" 200 None
2026-03-28 09:01:16 [auto1.it] INFO: Scrape type for YR53882: 0
2026-03-28 09:01:16 [auto1.it] INFO: Found listing with ID: ML25161
2026-03-28 09:01:16 [auto1.it] INFO: Found listing with ID: BY85548
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY85548%27 HTTP/1.1" 200 None
2026-03-28 09:01:16 [auto1.it] INFO: Scrape type for BY85548: 2
2026-03-28 09:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26357116-9d9b-597b-8e28-bfb9f75e9208 with identifier: BY85548
2026-03-28 09:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26357116-9d9b-597b-8e28-bfb9f75e9208 with scrape type 2
2026-03-28 09:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26357116-9d9b-597b-8e28-bfb9f75e9208 with scrape type 2
2026-03-28 09:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 26357116-9d9b-597b-8e28-bfb9f75e9208, identifier: BY85548
2026-03-28 09:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 26357116-9d9b-597b-8e28-bfb9f75e9208 with identifier: BY85548
2026-03-28 09:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 26357116-9d9b-597b-8e28-bfb9f75e9208 with identifier: BY85548
2026-03-28 09:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 26357116-9d9b-597b-8e28-bfb9f75e9208 with identifier: BY85548 to the API
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:32:01Z',
 'fuel_type': 'petrol',
 'id': '26357116-9d9b-597b-8e28-bfb9f75e9208',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY85548',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 151260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-31',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2009}
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY85548%27 HTTP/1.1" 200 None
2026-03-28 09:01:17 [auto1.it] INFO: Saving data for BY85548: {'auction_closing_time': 1774715521.0, 'created_time': 1773233548.517839, 'last_price_update_time': 1774688477.076964}
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BY85548') HTTP/1.1" 204 0
2026-03-28 09:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a9bf850>
2026-03-28 09:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_8ce76c7bd1308be2645b2daa3283e1b7.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_8ce76c7bd1308be2645b2daa3283e1b7.jpg saved to cache
2026-03-28 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58e2a63a-002e-5c18-9686-90d7731f8a23
2026-03-28 09:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a797350>
2026-03-28 09:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_8.jpg HTTP/1.1" 201 0
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_986bf998429e1cc54723515e43053630.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_986bf998429e1cc54723515e43053630.jpg saved to cache
2026-03-28 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58e2a63a-002e-5c18-9686-90d7731f8a23
2026-03-28 09:01:17 [auto1.it] INFO: Found listing with ID: AH40154
2026-03-28 09:01:17 [auto1.it] INFO: Found listing with ID: TZ90103
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ90103%27 HTTP/1.1" 200 None
2026-03-28 09:01:17 [auto1.it] INFO: Scrape type for TZ90103: 0
2026-03-28 09:01:17 [auto1.it] INFO: Found listing with ID: KL07491
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL07491%27 HTTP/1.1" 200 None
2026-03-28 09:01:17 [auto1.it] INFO: Scrape type for KL07491: 0
2026-03-28 09:01:17 [auto1.it] INFO: Found listing with ID: HH04548
2026-03-28 09:01:17 [auto1.it] INFO: Found listing with ID: VY96828
2026-03-28 09:01:17 [auto1.it] INFO: Found listing with ID: GS67606
2026-03-28 09:01:17 [auto1.it] INFO: Found listing with ID: PV06948
2026-03-28 09:01:17 [auto1.it] INFO: Found listing with ID: ZY29551
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY29551%27 HTTP/1.1" 200 None
2026-03-28 09:01:17 [auto1.it] INFO: Scrape type for ZY29551: 0
2026-03-28 09:01:17 [auto1.it] INFO: Found listing with ID: RU45122
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU45122%27 HTTP/1.1" 200 None
2026-03-28 09:01:17 [auto1.it] INFO: Scrape type for RU45122: 0
2026-03-28 09:01:17 [auto1.it] INFO: Found listing with ID: SD07666
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD07666%27 HTTP/1.1" 200 None
2026-03-28 09:01:17 [auto1.it] INFO: Scrape type for SD07666: 0
2026-03-28 09:01:17 [auto1.it] INFO: Found listing with ID: CM02924
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM02924%27 HTTP/1.1" 200 None
2026-03-28 09:01:17 [auto1.it] INFO: Scrape type for CM02924: 0
2026-03-28 09:01:17 [auto1.it] INFO: Found listing with ID: DA61571
2026-03-28 09:01:17 [auto1.it] INFO: Found listing with ID: HY12574
2026-03-28 09:01:17 [auto1.it] INFO: Found listing with ID: AR31382
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR31382%27 HTTP/1.1" 200 None
2026-03-28 09:01:17 [auto1.it] INFO: Scrape type for AR31382: 0
2026-03-28 09:01:17 [auto1.it] INFO: Found listing with ID: BT73754
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT73754%27 HTTP/1.1" 200 None
2026-03-28 09:01:17 [auto1.it] INFO: Scrape type for BT73754: 0
2026-03-28 09:01:17 [auto1.it] INFO: Found listing with ID: GY59997
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY59997%27 HTTP/1.1" 200 None
2026-03-28 09:01:17 [auto1.it] INFO: Scrape type for GY59997: 2
2026-03-28 09:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8baffde-df6b-5bd7-a1aa-66a4e954209a with identifier: GY59997
2026-03-28 09:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8baffde-df6b-5bd7-a1aa-66a4e954209a with scrape type 2
2026-03-28 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8baffde-df6b-5bd7-a1aa-66a4e954209a with scrape type 2
2026-03-28 09:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d8baffde-df6b-5bd7-a1aa-66a4e954209a, identifier: GY59997
2026-03-28 09:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d8baffde-df6b-5bd7-a1aa-66a4e954209a with identifier: GY59997
2026-03-28 09:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d8baffde-df6b-5bd7-a1aa-66a4e954209a with identifier: GY59997
2026-03-28 09:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d8baffde-df6b-5bd7-a1aa-66a4e954209a with identifier: GY59997 to the API
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:47:38Z',
 'fuel_type': 'diesel',
 'id': 'd8baffde-df6b-5bd7-a1aa-66a4e954209a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY59997',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Freemont',
 'odometer': 227245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-21',
 'seller_name': None,
 'title': 'Fiat Freemont 2.0 Multijet Lounge 4WD',
 'transmission': 'automatic',
 'trim': 'Lounge 4WD',
 'year': 2014}
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY59997%27 HTTP/1.1" 200 None
2026-03-28 09:01:17 [auto1.it] INFO: Saving data for GY59997: {'auction_closing_time': 1774716458.0, 'created_time': 1774472816.210473, 'last_price_update_time': 1774688477.815648}
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GY59997') HTTP/1.1" 204 0
2026-03-28 09:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1a68a950>
2026-03-28 09:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_9.jpg HTTP/1.1" 201 0
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F81%252F1c81ff92f2fdb76927d6cf54522cd0d1%252Fpa%252FXL36522_23f949629e9ae9c052d0c0e8538f1013.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_23f949629e9ae9c052d0c0e8538f1013.jpg saved to cache
2026-03-28 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 58e2a63a-002e-5c18-9686-90d7731f8a23
2026-03-28 09:01:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58e2a63a-002e-5c18-9686-90d7731f8a23, skipping ID generation
2026-03-28 09:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58e2a63a-002e-5c18-9686-90d7731f8a23 with scrape type 1
2026-03-28 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58e2a63a-002e-5c18-9686-90d7731f8a23 sending to next pipeline
2026-03-28 09:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 58e2a63a-002e-5c18-9686-90d7731f8a23, identifier: XL36522
2026-03-28 09:01:18 [auto1.it] INFO: Found listing with ID: BR84654
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR84654%27 HTTP/1.1" 200 None
2026-03-28 09:01:18 [auto1.it] INFO: Scrape type for BR84654: 0
2026-03-28 09:01:18 [auto1.it] INFO: Found listing with ID: JG32335
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG32335%27 HTTP/1.1" 200 None
2026-03-28 09:01:18 [auto1.it] INFO: Scrape type for JG32335: 0
2026-03-28 09:01:18 [auto1.it] INFO: Found listing with ID: HA49893
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA49893%27 HTTP/1.1" 200 None
2026-03-28 09:01:18 [auto1.it] INFO: Scrape type for HA49893: 0
2026-03-28 09:01:18 [auto1.it] INFO: Found listing with ID: UE49682
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE49682%27 HTTP/1.1" 200 None
2026-03-28 09:01:18 [auto1.it] INFO: Scrape type for UE49682: 0
2026-03-28 09:01:18 [auto1.it] INFO: Found listing with ID: HZ21842
2026-03-28 09:01:18 [auto1.it] INFO: Found listing with ID: VF12324
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF12324%27 HTTP/1.1" 200 None
2026-03-28 09:01:18 [auto1.it] INFO: Scrape type for VF12324: 0
2026-03-28 09:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 58e2a63a-002e-5c18-9686-90d7731f8a23 with identifier: XL36522
2026-03-28 09:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 58e2a63a-002e-5c18-9686-90d7731f8a23 with identifier: XL36522
2026-03-28 09:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 58e2a63a-002e-5c18-9686-90d7731f8a23 with identifier: XL36522 to the API
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_23f949629e9ae9c052d0c0e8538f1013.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 128,
 'expiration_date': '2026-03-30T15:20:59Z',
 'fuel_type': 'diesel',
 'id': '58e2a63a-002e-5c18-9686-90d7731f8a23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL36522',
 'listing': 'auction',
 'location': 'IT, Abbiategrasso',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 192092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_dda98c7e9f1da1d88cbe2d3b8a7a4523.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_54625f5d9b6af878bcc8322c8764e4e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_dfd60fcee0261c0dac7356462ab73a99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_bf22a00877a26f1ca1fe1c47853483f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_67035e5fd1718682b2a15a62cdd12e28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_0862d79c0f7824af5ce41ddba3bd0696.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_14e45ea59f09ae6ee61e7e86a66409d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_8ce76c7bd1308be2645b2daa3283e1b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_986bf998429e1cc54723515e43053630.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e2a63a-002e-5c18-9686-90d7731f8a23/58e2a63a-002e-5c18-9686-90d7731f8a23_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/81/1c81ff92f2fdb76927d6cf54522cd0d1/pa/XL36522_23f949629e9ae9c052d0c0e8538f1013.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi SW Cool",
 'transmission': 'automatic',
 'trim': 'SW Cool',
 'year': 2013}
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL36522%27 HTTP/1.1" 200 None
2026-03-28 09:01:18 [auto1.it] INFO: Saving data for XL36522: {'created_time': 1774688478.521589, 'last_price_update_time': 1774688478.521599, 'auction_closing_time': 1774884059.0}
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XL36522') HTTP/1.1" 204 0
2026-03-28 09:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_5476cf1c1cd84373f0894e2583cdeb28.jpg> (referer: https://www.auto1.com/)
2026-03-28 09:01:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 09:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 09:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fab1c856d10>
2026-03-28 09:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 09:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F1d%252Fe81d6c7783c3e8bcfb74d1168062c34b%252Fpa%252FRT57270_5476cf1c1cd84373f0894e2583cdeb28.jpg') HTTP/1.1" 204 0
2026-03-28 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_5476cf1c1cd84373f0894e2583cdeb28.jpg saved to cache
2026-03-28 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff6890d4-a840-546e-a6b8-95d4b516185a
2026-03-28 09:01:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff6890d4-a840-546e-a6b8-95d4b516185a, skipping ID generation
2026-03-28 09:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff6890d4-a840-546e-a6b8-95d4b516185a with scrape type 1
2026-03-28 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff6890d4-a840-546e-a6b8-95d4b516185a sending to next pipeline
2026-03-28 09:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ff6890d4-a840-546e-a6b8-95d4b516185a, identifier: RT57270
2026-03-28 09:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ff6890d4-a840-546e-a6b8-95d4b516185a with identifier: RT57270
2026-03-28 09:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ff6890d4-a840-546e-a6b8-95d4b516185a with identifier: RT57270
2026-03-28 09:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ff6890d4-a840-546e-a6b8-95d4b516185a with identifier: RT57270 to the API
2026-03-28 09:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_5476cf1c1cd84373f0894e2583cdeb28.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:16:23Z',
 'fuel_type': 'diesel',
 'id': 'ff6890d4-a840-546e-a6b8-95d4b516185a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT57270',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 174503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_87e89287ef6055512dfee66504a0f4af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_ad48c98304542c5adb8a1f524b6404ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_0025f5927308c1949dcadc62b3016856.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_4ac7a1f4bdb3506caa608e42114c75fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_d402c3ec8f293871420b1656aa503ed0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_215f511553fc7e48f101528baa7390f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_77fea6cb68e8c0d0075cec80a9b14dd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3157383,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_5476cf1c1cd84373f0894e2583cdeb28.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_f19fad2ae034e69a1fa3d79356264082.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff6890d4-a840-546e-a6b8-95d4b516185a/ff6890d4-a840-546e-a6b8-95d4b516185a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/1d/e81d6c7783c3e8bcfb74d1168062c34b/pa/RT57270_9dfbe843b289c9248b17a9a6b16f9bcf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTDM Distinctive',
 'transmission': 'manual',
 'trim': 'Distinctive',
 'year': 2015}
2026-03-28 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT57270%27 HTTP/1.1" 200 None
2026-03-28 09:01:19 [auto1.it] INFO: Saving data for RT57270: {'created_time': 1774688479.230442, 'last_price_update_time': 1774688479.230457, 'auction_closing_time': 1774883783.0}
2026-03-28 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT57270') HTTP/1.1" 204 0
2026-03-28 09:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:19 [auto1.it] INFO: Channel: 24h | Page: 11 | totalHits: 3430 | hits on page: 40
2026-03-28 09:01:19 [auto1.it] INFO: Found listing with ID: RF17009
2026-03-28 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF17009%27 HTTP/1.1" 200 None
2026-03-28 09:01:19 [auto1.it] INFO: Scrape type for RF17009: 0
2026-03-28 09:01:19 [auto1.it] INFO: Found listing with ID: GR59213
2026-03-28 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR59213%27 HTTP/1.1" 200 None
2026-03-28 09:01:19 [auto1.it] INFO: Scrape type for GR59213: 0
2026-03-28 09:01:19 [auto1.it] INFO: Found listing with ID: SF89201
2026-03-28 09:01:19 [auto1.it] INFO: Found listing with ID: PG27955
2026-03-28 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG27955%27 HTTP/1.1" 200 None
2026-03-28 09:01:19 [auto1.it] INFO: Scrape type for PG27955: 0
2026-03-28 09:01:19 [auto1.it] INFO: Found listing with ID: KD33461
2026-03-28 09:01:19 [auto1.it] INFO: Found listing with ID: XY30462
2026-03-28 09:01:19 [auto1.it] INFO: Found listing with ID: RF52556
2026-03-28 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF52556%27 HTTP/1.1" 200 None
2026-03-28 09:01:19 [auto1.it] INFO: Scrape type for RF52556: 0
2026-03-28 09:01:19 [auto1.it] INFO: Found listing with ID: UV07226
2026-03-28 09:01:19 [auto1.it] INFO: Found listing with ID: WC70760
2026-03-28 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC70760%27 HTTP/1.1" 200 None
2026-03-28 09:01:19 [auto1.it] INFO: Scrape type for WC70760: 2
2026-03-28 09:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57c8c374-224e-5ae6-975e-7d257401cfa2 with identifier: WC70760
2026-03-28 09:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57c8c374-224e-5ae6-975e-7d257401cfa2 with scrape type 2
2026-03-28 09:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57c8c374-224e-5ae6-975e-7d257401cfa2 with scrape type 2
2026-03-28 09:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 57c8c374-224e-5ae6-975e-7d257401cfa2, identifier: WC70760
2026-03-28 09:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 57c8c374-224e-5ae6-975e-7d257401cfa2 with identifier: WC70760
2026-03-28 09:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 57c8c374-224e-5ae6-975e-7d257401cfa2 with identifier: WC70760
2026-03-28 09:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 57c8c374-224e-5ae6-975e-7d257401cfa2 with identifier: WC70760 to the API
2026-03-28 09:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:16:18Z',
 'fuel_type': 'petrol',
 'id': '57c8c374-224e-5ae6-975e-7d257401cfa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC70760',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 96629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-28',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.0 Turbo Super Q4',
 'transmission': 'automatic',
 'trim': 'Super Q4',
 'year': 2018}
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC70760%27 HTTP/1.1" 200 None
2026-03-28 09:01:20 [auto1.it] INFO: Saving data for WC70760: {'auction_closing_time': 1774714578.0, 'created_time': 1774472759.896819, 'last_price_update_time': 1774688480.011885}
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WC70760') HTTP/1.1" 204 0
2026-03-28 09:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:20 [auto1.it] INFO: Found listing with ID: ZH02661
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH02661%27 HTTP/1.1" 200 None
2026-03-28 09:01:20 [auto1.it] INFO: Scrape type for ZH02661: 0
2026-03-28 09:01:20 [auto1.it] INFO: Found listing with ID: MP98273
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP98273%27 HTTP/1.1" 200 None
2026-03-28 09:01:20 [auto1.it] INFO: Scrape type for MP98273: 0
2026-03-28 09:01:20 [auto1.it] INFO: Found listing with ID: HK97988
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK97988%27 HTTP/1.1" 200 None
2026-03-28 09:01:20 [auto1.it] INFO: Scrape type for HK97988: 0
2026-03-28 09:01:20 [auto1.it] INFO: Found listing with ID: SJ75121
2026-03-28 09:01:20 [auto1.it] INFO: Found listing with ID: UU73428
2026-03-28 09:01:20 [auto1.it] INFO: Found listing with ID: MM82110
2026-03-28 09:01:20 [auto1.it] INFO: Found listing with ID: JA21524
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA21524%27 HTTP/1.1" 200 None
2026-03-28 09:01:20 [auto1.it] INFO: Scrape type for JA21524: 0
2026-03-28 09:01:20 [auto1.it] INFO: Found listing with ID: KE50843
2026-03-28 09:01:20 [auto1.it] INFO: Found listing with ID: MN43509
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN43509%27 HTTP/1.1" 200 None
2026-03-28 09:01:20 [auto1.it] INFO: Scrape type for MN43509: 0
2026-03-28 09:01:20 [auto1.it] INFO: Found listing with ID: WU65183
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU65183%27 HTTP/1.1" 200 None
2026-03-28 09:01:20 [auto1.it] INFO: Scrape type for WU65183: 0
2026-03-28 09:01:20 [auto1.it] INFO: Found listing with ID: FV31205
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV31205%27 HTTP/1.1" 200 None
2026-03-28 09:01:20 [auto1.it] INFO: Scrape type for FV31205: 2
2026-03-28 09:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f66b1df4-d6dd-5beb-84a0-54996a398566 with identifier: FV31205
2026-03-28 09:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f66b1df4-d6dd-5beb-84a0-54996a398566 with scrape type 2
2026-03-28 09:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f66b1df4-d6dd-5beb-84a0-54996a398566 with scrape type 2
2026-03-28 09:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f66b1df4-d6dd-5beb-84a0-54996a398566, identifier: FV31205
2026-03-28 09:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f66b1df4-d6dd-5beb-84a0-54996a398566 with identifier: FV31205
2026-03-28 09:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f66b1df4-d6dd-5beb-84a0-54996a398566 with identifier: FV31205
2026-03-28 09:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f66b1df4-d6dd-5beb-84a0-54996a398566 with identifier: FV31205 to the API
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:07:56Z',
 'fuel_type': 'diesel',
 'id': 'f66b1df4-d6dd-5beb-84a0-54996a398566',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV31205',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 281793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-29',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 R-Design',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2011}
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV31205%27 HTTP/1.1" 200 None
2026-03-28 09:01:20 [auto1.it] INFO: Saving data for FV31205: {'auction_closing_time': 1774714076.0, 'created_time': 1774472584.661018, 'last_price_update_time': 1774688480.644162}
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FV31205') HTTP/1.1" 204 0
2026-03-28 09:01:20 [auto1.it] INFO: Found listing with ID: LY31332
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY31332%27 HTTP/1.1" 200 None
2026-03-28 09:01:20 [auto1.it] INFO: Scrape type for LY31332: 0
2026-03-28 09:01:20 [auto1.it] INFO: Found listing with ID: ZS50484
2026-03-28 09:01:20 [auto1.it] INFO: Found listing with ID: JM76846
2026-03-28 09:01:20 [auto1.it] INFO: Found listing with ID: CV87912
2026-03-28 09:01:20 [auto1.it] INFO: Found listing with ID: XG74352
2026-03-28 09:01:20 [auto1.it] INFO: Found listing with ID: RH02265
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH02265%27 HTTP/1.1" 200 None
2026-03-28 09:01:20 [auto1.it] INFO: Scrape type for RH02265: 2
2026-03-28 09:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdf7c174-5c03-59ea-8c04-5b9de8de8f7e with identifier: RH02265
2026-03-28 09:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdf7c174-5c03-59ea-8c04-5b9de8de8f7e with scrape type 2
2026-03-28 09:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdf7c174-5c03-59ea-8c04-5b9de8de8f7e with scrape type 2
2026-03-28 09:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cdf7c174-5c03-59ea-8c04-5b9de8de8f7e, identifier: RH02265
2026-03-28 09:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cdf7c174-5c03-59ea-8c04-5b9de8de8f7e with identifier: RH02265
2026-03-28 09:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cdf7c174-5c03-59ea-8c04-5b9de8de8f7e with identifier: RH02265
2026-03-28 09:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cdf7c174-5c03-59ea-8c04-5b9de8de8f7e with identifier: RH02265 to the API
2026-03-28 09:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:18:53Z',
 'fuel_type': 'hybrid',
 'id': 'cdf7c174-5c03-59ea-8c04-5b9de8de8f7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH02265',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 28208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-28',
 'seller_name': None,
 'title': 'Renault Captur 1.6 Hybrid E-Tech Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2024}
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH02265%27 HTTP/1.1" 200 None
2026-03-28 09:01:21 [auto1.it] INFO: Saving data for RH02265: {'auction_closing_time': 1774714733.0, 'created_time': 1773139591.519901, 'last_price_update_time': 1774688481.280707}
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RH02265') HTTP/1.1" 204 0
2026-03-28 09:01:21 [auto1.it] INFO: Found listing with ID: PF24041
2026-03-28 09:01:21 [auto1.it] INFO: Found listing with ID: AT64434
2026-03-28 09:01:21 [auto1.it] INFO: Found listing with ID: PC87796
2026-03-28 09:01:21 [auto1.it] INFO: Found listing with ID: YS50306
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS50306%27 HTTP/1.1" 200 None
2026-03-28 09:01:21 [auto1.it] INFO: Scrape type for YS50306: 0
2026-03-28 09:01:21 [auto1.it] INFO: Found listing with ID: UF44040
2026-03-28 09:01:21 [auto1.it] INFO: Found listing with ID: JD40027
2026-03-28 09:01:21 [auto1.it] INFO: Found listing with ID: ZS91054
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS91054%27 HTTP/1.1" 200 None
2026-03-28 09:01:21 [auto1.it] INFO: Scrape type for ZS91054: 0
2026-03-28 09:01:21 [auto1.it] INFO: Found listing with ID: TK51874
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK51874%27 HTTP/1.1" 200 None
2026-03-28 09:01:21 [auto1.it] INFO: Scrape type for TK51874: 0
2026-03-28 09:01:21 [auto1.it] INFO: Found listing with ID: LZ51776
2026-03-28 09:01:21 [auto1.it] INFO: Found listing with ID: CK12538
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK12538%27 HTTP/1.1" 200 None
2026-03-28 09:01:21 [auto1.it] INFO: Scrape type for CK12538: 0
2026-03-28 09:01:21 [auto1.it] INFO: Found listing with ID: GM25035
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM25035%27 HTTP/1.1" 200 None
2026-03-28 09:01:21 [auto1.it] INFO: Scrape type for GM25035: 2
2026-03-28 09:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b347439-72e0-55d3-aa59-f69d38779552 with identifier: GM25035
2026-03-28 09:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b347439-72e0-55d3-aa59-f69d38779552 with scrape type 2
2026-03-28 09:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b347439-72e0-55d3-aa59-f69d38779552 with scrape type 2
2026-03-28 09:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1b347439-72e0-55d3-aa59-f69d38779552, identifier: GM25035
2026-03-28 09:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1b347439-72e0-55d3-aa59-f69d38779552 with identifier: GM25035
2026-03-28 09:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1b347439-72e0-55d3-aa59-f69d38779552 with identifier: GM25035
2026-03-28 09:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1b347439-72e0-55d3-aa59-f69d38779552 with identifier: GM25035 to the API
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:04:17Z',
 'fuel_type': 'diesel',
 'id': '1b347439-72e0-55d3-aa59-f69d38779552',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM25035',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 102025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-23',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2018}
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM25035%27 HTTP/1.1" 200 None
2026-03-28 09:01:21 [auto1.it] INFO: Saving data for GM25035: {'auction_closing_time': 1774713857.0, 'created_time': 1773132407.010376, 'last_price_update_time': 1774688481.792662}
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GM25035') HTTP/1.1" 204 0
2026-03-28 09:01:21 [auto1.it] INFO: Found listing with ID: DA21297
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA21297%27 HTTP/1.1" 200 None
2026-03-28 09:01:21 [auto1.it] INFO: Scrape type for DA21297: 0
2026-03-28 09:01:21 [auto1.it] INFO: Found listing with ID: XH90607
2026-03-28 09:01:21 [auto1.it] INFO: Found listing with ID: RZ71540
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ71540%27 HTTP/1.1" 200 None
2026-03-28 09:01:21 [auto1.it] INFO: Scrape type for RZ71540: 0
2026-03-28 09:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:24 [auto1.it] INFO: Channel: 24h | Page: 12 | totalHits: 3430 | hits on page: 40
2026-03-28 09:01:24 [auto1.it] INFO: Found listing with ID: AE71384
2026-03-28 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE71384%27 HTTP/1.1" 200 None
2026-03-28 09:01:24 [auto1.it] INFO: Scrape type for AE71384: 0
2026-03-28 09:01:24 [auto1.it] INFO: Found listing with ID: GV81081
2026-03-28 09:01:24 [auto1.it] INFO: Found listing with ID: RL11893
2026-03-28 09:01:24 [auto1.it] INFO: Found listing with ID: TT68141
2026-03-28 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT68141%27 HTTP/1.1" 200 None
2026-03-28 09:01:24 [auto1.it] INFO: Scrape type for TT68141: 0
2026-03-28 09:01:24 [auto1.it] INFO: Found listing with ID: WW70884
2026-03-28 09:01:24 [auto1.it] INFO: Found listing with ID: KT78402
2026-03-28 09:01:24 [auto1.it] INFO: Found listing with ID: HE90318
2026-03-28 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE90318%27 HTTP/1.1" 200 None
2026-03-28 09:01:24 [auto1.it] INFO: Scrape type for HE90318: 0
2026-03-28 09:01:24 [auto1.it] INFO: Found listing with ID: KY18822
2026-03-28 09:01:24 [auto1.it] INFO: Found listing with ID: LR80545
2026-03-28 09:01:24 [auto1.it] INFO: Found listing with ID: VK83291
2026-03-28 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK83291%27 HTTP/1.1" 200 None
2026-03-28 09:01:24 [auto1.it] INFO: Scrape type for VK83291: 0
2026-03-28 09:01:24 [auto1.it] INFO: Found listing with ID: KC76044
2026-03-28 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC76044%27 HTTP/1.1" 200 None
2026-03-28 09:01:24 [auto1.it] INFO: Scrape type for KC76044: 2
2026-03-28 09:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 259602b7-5562-5bf4-bbfb-a49d33ccf206 with identifier: KC76044
2026-03-28 09:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 259602b7-5562-5bf4-bbfb-a49d33ccf206 with scrape type 2
2026-03-28 09:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 259602b7-5562-5bf4-bbfb-a49d33ccf206 with scrape type 2
2026-03-28 09:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 259602b7-5562-5bf4-bbfb-a49d33ccf206, identifier: KC76044
2026-03-28 09:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 259602b7-5562-5bf4-bbfb-a49d33ccf206 with identifier: KC76044
2026-03-28 09:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 259602b7-5562-5bf4-bbfb-a49d33ccf206 with identifier: KC76044
2026-03-28 09:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 259602b7-5562-5bf4-bbfb-a49d33ccf206 with identifier: KC76044 to the API
2026-03-28 09:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:19:41Z',
 'fuel_type': 'petrol',
 'id': '259602b7-5562-5bf4-bbfb-a49d33ccf206',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC76044',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 65680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-06',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2014}
2026-03-28 09:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC76044%27 HTTP/1.1" 200 None
2026-03-28 09:01:25 [auto1.it] INFO: Saving data for KC76044: {'auction_closing_time': 1774714781.0, 'created_time': 1772750317.90863, 'last_price_update_time': 1774688485.589621}
2026-03-28 09:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KC76044') HTTP/1.1" 204 0
2026-03-28 09:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:25 [auto1.it] INFO: Found listing with ID: EJ70164
2026-03-28 09:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ70164%27 HTTP/1.1" 200 None
2026-03-28 09:01:25 [auto1.it] INFO: Scrape type for EJ70164: 0
2026-03-28 09:01:25 [auto1.it] INFO: Found listing with ID: FB75949
2026-03-28 09:01:25 [auto1.it] INFO: Found listing with ID: JZ08604
2026-03-28 09:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ08604%27 HTTP/1.1" 200 None
2026-03-28 09:01:25 [auto1.it] INFO: Scrape type for JZ08604: 2
2026-03-28 09:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb3f3d8f-d26d-515a-87a9-f163a24f1a70 with identifier: JZ08604
2026-03-28 09:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb3f3d8f-d26d-515a-87a9-f163a24f1a70 with scrape type 2
2026-03-28 09:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb3f3d8f-d26d-515a-87a9-f163a24f1a70 with scrape type 2
2026-03-28 09:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fb3f3d8f-d26d-515a-87a9-f163a24f1a70, identifier: JZ08604
2026-03-28 09:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fb3f3d8f-d26d-515a-87a9-f163a24f1a70 with identifier: JZ08604
2026-03-28 09:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fb3f3d8f-d26d-515a-87a9-f163a24f1a70 with identifier: JZ08604
2026-03-28 09:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fb3f3d8f-d26d-515a-87a9-f163a24f1a70 with identifier: JZ08604 to the API
2026-03-28 09:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:43:47Z',
 'fuel_type': 'petrol',
 'id': 'fb3f3d8f-d26d-515a-87a9-f163a24f1a70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ08604',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 240140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-05-20',
 'seller_name': None,
 'title': 'Toyota Yaris 1.3 VVT-i Linea Luna',
 'transmission': 'manual',
 'trim': 'Linea Luna',
 'year': 2002}
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ08604%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Saving data for JZ08604: {'auction_closing_time': 1774716227.0, 'created_time': 1774472779.083331, 'last_price_update_time': 1774688486.138381}
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JZ08604') HTTP/1.1" 204 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: CX77034
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: AL33371
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL33371%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for AL33371: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: SG14661
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG14661%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for SG14661: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: ZE89719
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE89719%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for ZE89719: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: VP48054
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: FX33898
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX33898%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for FX33898: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: SD16810
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD16810%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for SD16810: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: CV59379
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: EK65593
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK65593%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for EK65593: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: JS42398
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS42398%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for JS42398: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: SF23261
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF23261%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for SF23261: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: AA72149
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: PR97766
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR97766%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for PR97766: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: NT87512
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT87512%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for NT87512: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: TT47186
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT47186%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for TT47186: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: RL69129
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: AN76341
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN76341%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for AN76341: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: VW08659
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW08659%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for VW08659: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: BE85602
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE85602%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for BE85602: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: AL22636
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: WA74830
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: YM41293
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM41293%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for YM41293: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: UH24894
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH24894%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for UH24894: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: JK70012
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK70012%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for JK70012: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: FF54674
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF54674%27 HTTP/1.1" 200 None
2026-03-28 09:01:26 [auto1.it] INFO: Scrape type for FF54674: 0
2026-03-28 09:01:26 [auto1.it] INFO: Found listing with ID: FV08764
2026-03-28 09:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:27 [auto1.it] INFO: Channel: 24h | Page: 13 | totalHits: 3430 | hits on page: 40
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: RF58149
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF58149%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for RF58149: 0
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: MY00561
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY00561%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for MY00561: 0
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: KM79113
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: RA21109
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA21109%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for RA21109: 0
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: SC24235
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: PC98849
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC98849%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for PC98849: 0
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: UT67830
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: KS82343
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS82343%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for KS82343: 0
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: DX23883
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX23883%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for DX23883: 0
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: YB28185
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB28185%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for YB28185: 0
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: UJ22740
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: JV82162
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV82162%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for JV82162: 0
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: DE25222
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE25222%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for DE25222: 0
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: UX20076
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX20076%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for UX20076: 0
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: SN27991
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: MD06085
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: SS79463
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: MC91027
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: ZT24838
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: JK02005
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK02005%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for JK02005: 0
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: RB72441
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB72441%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for RB72441: 0
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: EC66438
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: VK05865
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: WR22265
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR22265%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for WR22265: 0
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: UN16063
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: YA33323
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: EM46556
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: ZP43872
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP43872%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for ZP43872: 0
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: CP55584
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: VT45573
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: MU13564
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: YY01932
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY01932%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for YY01932: 0
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: UD16121
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD16121%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for UD16121: 0
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: EC11217
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC11217%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for EC11217: 0
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: XV48493
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: MD24560
2026-03-28 09:01:27 [auto1.it] INFO: Found listing with ID: XT99009
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT99009%27 HTTP/1.1" 200 None
2026-03-28 09:01:27 [auto1.it] INFO: Scrape type for XT99009: 2
2026-03-28 09:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd616e74-d774-56c5-a11a-c7e5d1b88150 with identifier: XT99009
2026-03-28 09:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd616e74-d774-56c5-a11a-c7e5d1b88150 with scrape type 2
2026-03-28 09:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd616e74-d774-56c5-a11a-c7e5d1b88150 with scrape type 2
2026-03-28 09:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd616e74-d774-56c5-a11a-c7e5d1b88150, identifier: XT99009
2026-03-28 09:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd616e74-d774-56c5-a11a-c7e5d1b88150 with identifier: XT99009
2026-03-28 09:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd616e74-d774-56c5-a11a-c7e5d1b88150 with identifier: XT99009
2026-03-28 09:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd616e74-d774-56c5-a11a-c7e5d1b88150 with identifier: XT99009 to the API
2026-03-28 09:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:52:12Z',
 'fuel_type': 'diesel',
 'id': 'dd616e74-d774-56c5-a11a-c7e5d1b88150',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT99009',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 470368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-03',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT99009%27 HTTP/1.1" 200 None
2026-03-28 09:01:28 [auto1.it] INFO: Saving data for XT99009: {'auction_closing_time': 1774716732.0, 'created_time': 1773231640.377685, 'last_price_update_time': 1774688488.466375}
2026-03-28 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XT99009') HTTP/1.1" 204 0
2026-03-28 09:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:28 [auto1.it] INFO: Found listing with ID: LC07756
2026-03-28 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC07756%27 HTTP/1.1" 200 None
2026-03-28 09:01:28 [auto1.it] INFO: Scrape type for LC07756: 0
2026-03-28 09:01:28 [auto1.it] INFO: Found listing with ID: EV86886
2026-03-28 09:01:28 [auto1.it] INFO: Found listing with ID: SK38422
2026-03-28 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK38422%27 HTTP/1.1" 200 None
2026-03-28 09:01:28 [auto1.it] INFO: Scrape type for SK38422: 0
2026-03-28 09:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:29 [auto1.it] INFO: Channel: 24h | Page: 14 | totalHits: 3430 | hits on page: 40
2026-03-28 09:01:29 [auto1.it] INFO: Found listing with ID: UR82213
2026-03-28 09:01:29 [auto1.it] INFO: Found listing with ID: TP47209
2026-03-28 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP47209%27 HTTP/1.1" 200 None
2026-03-28 09:01:29 [auto1.it] INFO: Scrape type for TP47209: 2
2026-03-28 09:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66863a10-2986-59d7-97e6-747300fff431 with identifier: TP47209
2026-03-28 09:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66863a10-2986-59d7-97e6-747300fff431 with scrape type 2
2026-03-28 09:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66863a10-2986-59d7-97e6-747300fff431 with scrape type 2
2026-03-28 09:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 66863a10-2986-59d7-97e6-747300fff431, identifier: TP47209
2026-03-28 09:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 66863a10-2986-59d7-97e6-747300fff431 with identifier: TP47209
2026-03-28 09:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 66863a10-2986-59d7-97e6-747300fff431 with identifier: TP47209
2026-03-28 09:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 66863a10-2986-59d7-97e6-747300fff431 with identifier: TP47209 to the API
2026-03-28 09:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:08:18Z',
 'fuel_type': 'gas',
 'id': '66863a10-2986-59d7-97e6-747300fff431',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP47209',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 117229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-18',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 GPL Gold',
 'transmission': 'manual',
 'trim': 'Gold',
 'year': 2017}
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP47209%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Saving data for TP47209: {'auction_closing_time': 1774714098.0, 'created_time': 1774001985.001525, 'last_price_update_time': 1774688490.071867}
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TP47209') HTTP/1.1" 204 0
2026-03-28 09:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: ZA41096
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: HS75117
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS75117%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Scrape type for HS75117: 0
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: US82962
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US82962%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Scrape type for US82962: 0
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: NU85167
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU85167%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Scrape type for NU85167: 0
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: ZY01206
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY01206%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Scrape type for ZY01206: 0
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: NL99769
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL99769%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Scrape type for NL99769: 0
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: MS47082
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS47082%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Scrape type for MS47082: 0
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: UB37048
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: CF64613
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: RE73183
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE73183%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Scrape type for RE73183: 0
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: TY88258
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY88258%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Scrape type for TY88258: 0
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: YJ50893
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ50893%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Scrape type for YJ50893: 0
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: FE47038
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: KS22077
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS22077%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Scrape type for KS22077: 0
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: DF42312
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF42312%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Scrape type for DF42312: 0
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: EX36920
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX36920%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Scrape type for EX36920: 0
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: XZ56129
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: WD53289
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD53289%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Scrape type for WD53289: 0
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: EU76954
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU76954%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Scrape type for EU76954: 2
2026-03-28 09:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c647714-19f9-5334-94b1-01fe441b09e7 with identifier: EU76954
2026-03-28 09:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c647714-19f9-5334-94b1-01fe441b09e7 with scrape type 2
2026-03-28 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c647714-19f9-5334-94b1-01fe441b09e7 with scrape type 2
2026-03-28 09:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c647714-19f9-5334-94b1-01fe441b09e7, identifier: EU76954
2026-03-28 09:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c647714-19f9-5334-94b1-01fe441b09e7 with identifier: EU76954
2026-03-28 09:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c647714-19f9-5334-94b1-01fe441b09e7 with identifier: EU76954
2026-03-28 09:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4c647714-19f9-5334-94b1-01fe441b09e7 with identifier: EU76954 to the API
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:55:49Z',
 'fuel_type': 'petrol',
 'id': '4c647714-19f9-5334-94b1-01fe441b09e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU76954',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 316247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-07',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TGI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU76954%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Saving data for EU76954: {'auction_closing_time': 1774716949.0, 'created_time': 1773674202.897125, 'last_price_update_time': 1774688490.768263}
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EU76954') HTTP/1.1" 204 0
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: YU54798
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU54798%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Scrape type for YU54798: 0
2026-03-28 09:01:30 [auto1.it] INFO: Found listing with ID: RK45899
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK45899%27 HTTP/1.1" 200 None
2026-03-28 09:01:30 [auto1.it] INFO: Scrape type for RK45899: 2
2026-03-28 09:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f32528a1-aa4f-5f21-96ea-85216b9dcfd6 with identifier: RK45899
2026-03-28 09:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f32528a1-aa4f-5f21-96ea-85216b9dcfd6 with scrape type 2
2026-03-28 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f32528a1-aa4f-5f21-96ea-85216b9dcfd6 with scrape type 2
2026-03-28 09:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f32528a1-aa4f-5f21-96ea-85216b9dcfd6, identifier: RK45899
2026-03-28 09:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f32528a1-aa4f-5f21-96ea-85216b9dcfd6 with identifier: RK45899
2026-03-28 09:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f32528a1-aa4f-5f21-96ea-85216b9dcfd6 with identifier: RK45899
2026-03-28 09:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f32528a1-aa4f-5f21-96ea-85216b9dcfd6 with identifier: RK45899 to the API
2026-03-28 09:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:29:42Z',
 'fuel_type': 'petrol',
 'id': 'f32528a1-aa4f-5f21-96ea-85216b9dcfd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK45899',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 58021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-31',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2023}
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK45899%27 HTTP/1.1" 200 None
2026-03-28 09:01:32 [auto1.it] INFO: Saving data for RK45899: {'auction_closing_time': 1774715382.0, 'created_time': 1773662812.868337, 'last_price_update_time': 1774688492.159237}
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RK45899') HTTP/1.1" 204 0
2026-03-28 09:01:32 [auto1.it] INFO: Found listing with ID: KM82179
2026-03-28 09:01:32 [auto1.it] INFO: Found listing with ID: WA14030
2026-03-28 09:01:32 [auto1.it] INFO: Found listing with ID: FJ36281
2026-03-28 09:01:32 [auto1.it] INFO: Found listing with ID: SC05830
2026-03-28 09:01:32 [auto1.it] INFO: Found listing with ID: DX52921
2026-03-28 09:01:32 [auto1.it] INFO: Found listing with ID: TG05681
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG05681%27 HTTP/1.1" 200 None
2026-03-28 09:01:32 [auto1.it] INFO: Scrape type for TG05681: 0
2026-03-28 09:01:32 [auto1.it] INFO: Found listing with ID: ZJ11157
2026-03-28 09:01:32 [auto1.it] INFO: Found listing with ID: FG85862
2026-03-28 09:01:32 [auto1.it] INFO: Found listing with ID: SH24960
2026-03-28 09:01:32 [auto1.it] INFO: Found listing with ID: WR20789
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR20789%27 HTTP/1.1" 200 None
2026-03-28 09:01:32 [auto1.it] INFO: Scrape type for WR20789: 0
2026-03-28 09:01:32 [auto1.it] INFO: Found listing with ID: XY73038
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY73038%27 HTTP/1.1" 200 None
2026-03-28 09:01:32 [auto1.it] INFO: Scrape type for XY73038: 0
2026-03-28 09:01:32 [auto1.it] INFO: Found listing with ID: TK53428
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK53428%27 HTTP/1.1" 200 None
2026-03-28 09:01:32 [auto1.it] INFO: Scrape type for TK53428: 0
2026-03-28 09:01:32 [auto1.it] INFO: Found listing with ID: NT25208
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT25208%27 HTTP/1.1" 200 None
2026-03-28 09:01:32 [auto1.it] INFO: Scrape type for NT25208: 0
2026-03-28 09:01:32 [auto1.it] INFO: Found listing with ID: ZM39630
2026-03-28 09:01:32 [auto1.it] INFO: Found listing with ID: SK44334
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK44334%27 HTTP/1.1" 200 None
2026-03-28 09:01:32 [auto1.it] INFO: Scrape type for SK44334: 2
2026-03-28 09:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f114e7c-3914-5de5-a15c-0b1eb1e1f8bf with identifier: SK44334
2026-03-28 09:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f114e7c-3914-5de5-a15c-0b1eb1e1f8bf with scrape type 2
2026-03-28 09:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f114e7c-3914-5de5-a15c-0b1eb1e1f8bf with scrape type 2
2026-03-28 09:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2f114e7c-3914-5de5-a15c-0b1eb1e1f8bf, identifier: SK44334
2026-03-28 09:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2f114e7c-3914-5de5-a15c-0b1eb1e1f8bf with identifier: SK44334
2026-03-28 09:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2f114e7c-3914-5de5-a15c-0b1eb1e1f8bf with identifier: SK44334
2026-03-28 09:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2f114e7c-3914-5de5-a15c-0b1eb1e1f8bf with identifier: SK44334 to the API
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:41:02Z',
 'fuel_type': 'diesel',
 'id': '2f114e7c-3914-5de5-a15c-0b1eb1e1f8bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK44334',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 174610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-09',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2019}
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK44334%27 HTTP/1.1" 200 None
2026-03-28 09:01:32 [auto1.it] INFO: Saving data for SK44334: {'auction_closing_time': 1774716062.0, 'created_time': 1773675080.159461, 'last_price_update_time': 1774688492.680293}
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SK44334') HTTP/1.1" 204 0
2026-03-28 09:01:32 [auto1.it] INFO: Found listing with ID: DP62662
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP62662%27 HTTP/1.1" 200 None
2026-03-28 09:01:32 [auto1.it] INFO: Scrape type for DP62662: 2
2026-03-28 09:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b33fb35-ee30-51b6-9e5e-4e5acb8199d5 with identifier: DP62662
2026-03-28 09:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b33fb35-ee30-51b6-9e5e-4e5acb8199d5 with scrape type 2
2026-03-28 09:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b33fb35-ee30-51b6-9e5e-4e5acb8199d5 with scrape type 2
2026-03-28 09:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3b33fb35-ee30-51b6-9e5e-4e5acb8199d5, identifier: DP62662
2026-03-28 09:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3b33fb35-ee30-51b6-9e5e-4e5acb8199d5 with identifier: DP62662
2026-03-28 09:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3b33fb35-ee30-51b6-9e5e-4e5acb8199d5 with identifier: DP62662
2026-03-28 09:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3b33fb35-ee30-51b6-9e5e-4e5acb8199d5 with identifier: DP62662 to the API
2026-03-28 09:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:42:09Z',
 'fuel_type': 'diesel',
 'id': '3b33fb35-ee30-51b6-9e5e-4e5acb8199d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP62662',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 102110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-15',
 'seller_name': None,
 'title': 'Volvo V90 2.0 D4 BUSINESS PLUS',
 'transmission': 'automatic',
 'trim': 'BUSINESS PLUS',
 'year': 2019}
2026-03-28 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP62662%27 HTTP/1.1" 200 None
2026-03-28 09:01:33 [auto1.it] INFO: Saving data for DP62662: {'auction_closing_time': 1774716129.0, 'created_time': 1774472831.844488, 'last_price_update_time': 1774688493.249278}
2026-03-28 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DP62662') HTTP/1.1" 204 0
2026-03-28 09:01:33 [auto1.it] INFO: Found listing with ID: XD24823
2026-03-28 09:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:34 [auto1.it] INFO: Channel: 24h | Page: 15 | totalHits: 3431 | hits on page: 40
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: XD24823
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: NB02021
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB02021%27 HTTP/1.1" 200 None
2026-03-28 09:01:34 [auto1.it] INFO: Scrape type for NB02021: 0
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: VC74933
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC74933%27 HTTP/1.1" 200 None
2026-03-28 09:01:34 [auto1.it] INFO: Scrape type for VC74933: 0
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: UT52795
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: MX71384
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: EB41992
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB41992%27 HTTP/1.1" 200 None
2026-03-28 09:01:34 [auto1.it] INFO: Scrape type for EB41992: 2
2026-03-28 09:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a94faca-51f3-5d33-93bd-ec3029473a4d with identifier: EB41992
2026-03-28 09:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a94faca-51f3-5d33-93bd-ec3029473a4d with scrape type 2
2026-03-28 09:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a94faca-51f3-5d33-93bd-ec3029473a4d with scrape type 2
2026-03-28 09:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5a94faca-51f3-5d33-93bd-ec3029473a4d, identifier: EB41992
2026-03-28 09:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5a94faca-51f3-5d33-93bd-ec3029473a4d with identifier: EB41992
2026-03-28 09:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5a94faca-51f3-5d33-93bd-ec3029473a4d with identifier: EB41992
2026-03-28 09:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5a94faca-51f3-5d33-93bd-ec3029473a4d with identifier: EB41992 to the API
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:00:14Z',
 'fuel_type': 'diesel',
 'id': '5a94faca-51f3-5d33-93bd-ec3029473a4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB41992',
 'listing': 'auction',
 'make': 'Iveco',
 'model': 'Daily',
 'odometer': 174920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-11',
 'seller_name': None,
 'title': 'Iveco Daily 2.3 Diesel HKa 35 S V Radstand 3520 L',
 'transmission': 'manual',
 'trim': 'HKa 35 S V Radstand 3520 L',
 'year': 2017}
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB41992%27 HTTP/1.1" 200 None
2026-03-28 09:01:34 [auto1.it] INFO: Saving data for EB41992: {'auction_closing_time': 1774713614.0, 'created_time': 1772784355.328497, 'last_price_update_time': 1774688494.495138}
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EB41992') HTTP/1.1" 204 0
2026-03-28 09:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: ZF01479
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: CT94493
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: TZ83635
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ83635%27 HTTP/1.1" 200 None
2026-03-28 09:01:34 [auto1.it] INFO: Scrape type for TZ83635: 0
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: BS51992
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: WJ94048
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ94048%27 HTTP/1.1" 200 None
2026-03-28 09:01:34 [auto1.it] INFO: Scrape type for WJ94048: 0
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: ZU06634
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU06634%27 HTTP/1.1" 200 None
2026-03-28 09:01:34 [auto1.it] INFO: Scrape type for ZU06634: 0
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: WE26685
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: NU40150
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: TL80990
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: YL27459
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: AG12486
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG12486%27 HTTP/1.1" 200 None
2026-03-28 09:01:34 [auto1.it] INFO: Scrape type for AG12486: 0
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: VS63609
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS63609%27 HTTP/1.1" 200 None
2026-03-28 09:01:34 [auto1.it] INFO: Scrape type for VS63609: 0
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: UH61240
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH61240%27 HTTP/1.1" 200 None
2026-03-28 09:01:34 [auto1.it] INFO: Scrape type for UH61240: 0
2026-03-28 09:01:34 [auto1.it] INFO: Found listing with ID: DM21687
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM21687%27 HTTP/1.1" 200 None
2026-03-28 09:01:34 [auto1.it] INFO: Scrape type for DM21687: 2
2026-03-28 09:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad64d2d7-5163-53c8-ad7b-455541a73eba with identifier: DM21687
2026-03-28 09:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad64d2d7-5163-53c8-ad7b-455541a73eba with scrape type 2
2026-03-28 09:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad64d2d7-5163-53c8-ad7b-455541a73eba with scrape type 2
2026-03-28 09:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ad64d2d7-5163-53c8-ad7b-455541a73eba, identifier: DM21687
2026-03-28 09:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ad64d2d7-5163-53c8-ad7b-455541a73eba with identifier: DM21687
2026-03-28 09:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ad64d2d7-5163-53c8-ad7b-455541a73eba with identifier: DM21687
2026-03-28 09:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ad64d2d7-5163-53c8-ad7b-455541a73eba with identifier: DM21687 to the API
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:22:33Z',
 'fuel_type': 'petrol',
 'id': 'ad64d2d7-5163-53c8-ad7b-455541a73eba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM21687',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 105883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-28',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2012}
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM21687%27 HTTP/1.1" 200 None
2026-03-28 09:01:35 [auto1.it] INFO: Saving data for DM21687: {'auction_closing_time': 1774714953.0, 'created_time': 1773695005.012591, 'last_price_update_time': 1774688495.079316}
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DM21687') HTTP/1.1" 204 0
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: ZL42866
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: YA38395
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: TC50511
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC50511%27 HTTP/1.1" 200 None
2026-03-28 09:01:35 [auto1.it] INFO: Scrape type for TC50511: 0
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: TK21240
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK21240%27 HTTP/1.1" 200 None
2026-03-28 09:01:35 [auto1.it] INFO: Scrape type for TK21240: 0
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: VP75887
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: RC55633
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: DB38288
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: ZF04289
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: NP33035
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: PA22608
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: FH02566
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: XZ64969
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: LJ35523
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: HH64433
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH64433%27 HTTP/1.1" 200 None
2026-03-28 09:01:35 [auto1.it] INFO: Scrape type for HH64433: 2
2026-03-28 09:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd03135a-abc2-5ffa-8272-e9def698d29d with identifier: HH64433
2026-03-28 09:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd03135a-abc2-5ffa-8272-e9def698d29d with scrape type 2
2026-03-28 09:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd03135a-abc2-5ffa-8272-e9def698d29d with scrape type 2
2026-03-28 09:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cd03135a-abc2-5ffa-8272-e9def698d29d, identifier: HH64433
2026-03-28 09:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cd03135a-abc2-5ffa-8272-e9def698d29d with identifier: HH64433
2026-03-28 09:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cd03135a-abc2-5ffa-8272-e9def698d29d with identifier: HH64433
2026-03-28 09:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cd03135a-abc2-5ffa-8272-e9def698d29d with identifier: HH64433 to the API
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:06:52Z',
 'fuel_type': 'diesel',
 'id': 'cd03135a-abc2-5ffa-8272-e9def698d29d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH64433',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Bravo',
 'odometer': 142425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-24',
 'seller_name': None,
 'title': 'Fiat Bravo 1.6 JTDM Multijet Dynamic',
 'transmission': 'manual',
 'trim': 'Multijet Dynamic',
 'year': 2011}
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH64433%27 HTTP/1.1" 200 None
2026-03-28 09:01:35 [auto1.it] INFO: Saving data for HH64433: {'auction_closing_time': 1774714012.0, 'created_time': 1772778861.149798, 'last_price_update_time': 1774688495.64476}
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HH64433') HTTP/1.1" 204 0
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: GT36426
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT36426%27 HTTP/1.1" 200 None
2026-03-28 09:01:35 [auto1.it] INFO: Scrape type for GT36426: 0
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: GB77184
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: FC91970
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: RK33520
2026-03-28 09:01:35 [auto1.it] INFO: Found listing with ID: RU39980
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU39980%27 HTTP/1.1" 200 None
2026-03-28 09:01:35 [auto1.it] INFO: Scrape type for RU39980: 2
2026-03-28 09:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0571287e-a830-5fc2-b89d-f3c31f104f37 with identifier: RU39980
2026-03-28 09:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0571287e-a830-5fc2-b89d-f3c31f104f37 with scrape type 2
2026-03-28 09:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0571287e-a830-5fc2-b89d-f3c31f104f37 with scrape type 2
2026-03-28 09:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0571287e-a830-5fc2-b89d-f3c31f104f37, identifier: RU39980
2026-03-28 09:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0571287e-a830-5fc2-b89d-f3c31f104f37 with identifier: RU39980
2026-03-28 09:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0571287e-a830-5fc2-b89d-f3c31f104f37 with identifier: RU39980
2026-03-28 09:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0571287e-a830-5fc2-b89d-f3c31f104f37 with identifier: RU39980 to the API
2026-03-28 09:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:24:57Z',
 'fuel_type': 'hybrid',
 'id': '0571287e-a830-5fc2-b89d-f3c31f104f37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU39980',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'CT-Serie',
 'odometer': 143934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-10',
 'seller_name': None,
 'title': 'Lexus CT-Serie CT 200h Executive Line',
 'transmission': 'automatic',
 'trim': 'Executive Line',
 'year': 2014}
2026-03-28 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU39980%27 HTTP/1.1" 200 None
2026-03-28 09:01:36 [auto1.it] INFO: Saving data for RU39980: {'auction_closing_time': 1774715097.0, 'created_time': 1774472805.578017, 'last_price_update_time': 1774688496.174881}
2026-03-28 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RU39980') HTTP/1.1" 204 0
2026-03-28 09:01:36 [auto1.it] INFO: Found listing with ID: NG82914
2026-03-28 09:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:37 [auto1.it] INFO: Channel: 24h | Page: 16 | totalHits: 3431 | hits on page: 40
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: JD30560
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: LC51604
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: VV63992
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: BP08183
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: DZ95846
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ95846%27 HTTP/1.1" 200 None
2026-03-28 09:01:37 [auto1.it] INFO: Scrape type for DZ95846: 0
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: ZT44032
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: UF05417
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF05417%27 HTTP/1.1" 200 None
2026-03-28 09:01:37 [auto1.it] INFO: Scrape type for UF05417: 0
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: DX27899
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX27899%27 HTTP/1.1" 200 None
2026-03-28 09:01:37 [auto1.it] INFO: Scrape type for DX27899: 0
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: ZT61879
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: YV19719
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: GV78973
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV78973%27 HTTP/1.1" 200 None
2026-03-28 09:01:37 [auto1.it] INFO: Scrape type for GV78973: 0
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: DK34642
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: AB97936
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB97936%27 HTTP/1.1" 200 None
2026-03-28 09:01:37 [auto1.it] INFO: Scrape type for AB97936: 0
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: UJ97267
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: GT90987
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: UM32234
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM32234%27 HTTP/1.1" 200 None
2026-03-28 09:01:37 [auto1.it] INFO: Scrape type for UM32234: 0
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: HT07247
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT07247%27 HTTP/1.1" 200 None
2026-03-28 09:01:37 [auto1.it] INFO: Scrape type for HT07247: 0
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: AF88379
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF88379%27 HTTP/1.1" 200 None
2026-03-28 09:01:37 [auto1.it] INFO: Scrape type for AF88379: 0
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: MT61619
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT61619%27 HTTP/1.1" 200 None
2026-03-28 09:01:37 [auto1.it] INFO: Scrape type for MT61619: 2
2026-03-28 09:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2abfedd7-6605-5a54-bdd0-20ea76fc787b with identifier: MT61619
2026-03-28 09:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2abfedd7-6605-5a54-bdd0-20ea76fc787b with scrape type 2
2026-03-28 09:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2abfedd7-6605-5a54-bdd0-20ea76fc787b with scrape type 2
2026-03-28 09:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2abfedd7-6605-5a54-bdd0-20ea76fc787b, identifier: MT61619
2026-03-28 09:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2abfedd7-6605-5a54-bdd0-20ea76fc787b with identifier: MT61619
2026-03-28 09:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2abfedd7-6605-5a54-bdd0-20ea76fc787b with identifier: MT61619
2026-03-28 09:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2abfedd7-6605-5a54-bdd0-20ea76fc787b with identifier: MT61619 to the API
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:31:15Z',
 'fuel_type': 'diesel',
 'id': '2abfedd7-6605-5a54-bdd0-20ea76fc787b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT61619',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 159372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Advance BlueMotion',
 'transmission': 'manual',
 'trim': 'Advance BlueMotion',
 'year': 2011}
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT61619%27 HTTP/1.1" 200 None
2026-03-28 09:01:37 [auto1.it] INFO: Saving data for MT61619: {'auction_closing_time': 1774715475.0, 'created_time': 1773138497.829802, 'last_price_update_time': 1774688497.686019}
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MT61619') HTTP/1.1" 204 0
2026-03-28 09:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: GS31423
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: EH64041
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: FX46616
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: PG69305
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: BJ50784
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: CC86207
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: YK89440
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK89440%27 HTTP/1.1" 200 None
2026-03-28 09:01:37 [auto1.it] INFO: Scrape type for YK89440: 0
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: SW20348
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW20348%27 HTTP/1.1" 200 None
2026-03-28 09:01:37 [auto1.it] INFO: Scrape type for SW20348: 0
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: PZ47386
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ47386%27 HTTP/1.1" 200 None
2026-03-28 09:01:37 [auto1.it] INFO: Scrape type for PZ47386: 0
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: SD88431
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: DP81604
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: ZU90701
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU90701%27 HTTP/1.1" 200 None
2026-03-28 09:01:37 [auto1.it] INFO: Scrape type for ZU90701: 0
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: LD73585
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: MU03817
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU03817%27 HTTP/1.1" 200 None
2026-03-28 09:01:37 [auto1.it] INFO: Scrape type for MU03817: 0
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: LP02443
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP02443%27 HTTP/1.1" 200 None
2026-03-28 09:01:37 [auto1.it] INFO: Scrape type for LP02443: 0
2026-03-28 09:01:37 [auto1.it] INFO: Found listing with ID: FB11512
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB11512%27 HTTP/1.1" 200 None
2026-03-28 09:01:37 [auto1.it] INFO: Scrape type for FB11512: 2
2026-03-28 09:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2fe0fba-e0a1-57c6-90b2-56e54e73ecbb with identifier: FB11512
2026-03-28 09:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2fe0fba-e0a1-57c6-90b2-56e54e73ecbb with scrape type 2
2026-03-28 09:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2fe0fba-e0a1-57c6-90b2-56e54e73ecbb with scrape type 2
2026-03-28 09:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c2fe0fba-e0a1-57c6-90b2-56e54e73ecbb, identifier: FB11512
2026-03-28 09:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c2fe0fba-e0a1-57c6-90b2-56e54e73ecbb with identifier: FB11512
2026-03-28 09:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c2fe0fba-e0a1-57c6-90b2-56e54e73ecbb with identifier: FB11512
2026-03-28 09:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c2fe0fba-e0a1-57c6-90b2-56e54e73ecbb with identifier: FB11512 to the API
2026-03-28 09:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:46:02Z',
 'fuel_type': 'diesel',
 'id': 'c2fe0fba-e0a1-57c6-90b2-56e54e73ecbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB11512',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 49752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Mild-Hybrid Business Class 2WD',
 'transmission': 'automatic',
 'trim': 'Business Class 2WD',
 'year': 2021}
2026-03-28 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB11512%27 HTTP/1.1" 200 None
2026-03-28 09:01:38 [auto1.it] INFO: Saving data for FB11512: {'auction_closing_time': 1774716362.0, 'created_time': 1773132581.351187, 'last_price_update_time': 1774688498.390183}
2026-03-28 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FB11512') HTTP/1.1" 204 0
2026-03-28 09:01:38 [auto1.it] INFO: Found listing with ID: NR94524
2026-03-28 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR94524%27 HTTP/1.1" 200 None
2026-03-28 09:01:38 [auto1.it] INFO: Scrape type for NR94524: 0
2026-03-28 09:01:38 [auto1.it] INFO: Found listing with ID: KB15233
2026-03-28 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB15233%27 HTTP/1.1" 200 None
2026-03-28 09:01:38 [auto1.it] INFO: Scrape type for KB15233: 0
2026-03-28 09:01:38 [auto1.it] INFO: Found listing with ID: AC52318
2026-03-28 09:01:38 [auto1.it] INFO: Found listing with ID: NR89039
2026-03-28 09:01:38 [auto1.it] INFO: Found listing with ID: UY23152
2026-03-28 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY23152%27 HTTP/1.1" 200 None
2026-03-28 09:01:38 [auto1.it] INFO: Scrape type for UY23152: 0
2026-03-28 09:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:39 [auto1.it] INFO: Channel: 24h | Page: 17 | totalHits: 3432 | hits on page: 40
2026-03-28 09:01:39 [auto1.it] INFO: Found listing with ID: UY23152
2026-03-28 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY23152%27 HTTP/1.1" 200 None
2026-03-28 09:01:39 [auto1.it] INFO: Scrape type for UY23152: 0
2026-03-28 09:01:39 [auto1.it] INFO: Found listing with ID: BC74314
2026-03-28 09:01:39 [auto1.it] INFO: Found listing with ID: HU90356
2026-03-28 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU90356%27 HTTP/1.1" 200 None
2026-03-28 09:01:39 [auto1.it] INFO: Scrape type for HU90356: 0
2026-03-28 09:01:39 [auto1.it] INFO: Found listing with ID: AU61443
2026-03-28 09:01:39 [auto1.it] INFO: Found listing with ID: LS03457
2026-03-28 09:01:39 [auto1.it] INFO: Found listing with ID: SU12582
2026-03-28 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU12582%27 HTTP/1.1" 200 None
2026-03-28 09:01:39 [auto1.it] INFO: Scrape type for SU12582: 0
2026-03-28 09:01:39 [auto1.it] INFO: Found listing with ID: CH03473
2026-03-28 09:01:39 [auto1.it] INFO: Found listing with ID: BF84159
2026-03-28 09:01:39 [auto1.it] INFO: Found listing with ID: PE07911
2026-03-28 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE07911%27 HTTP/1.1" 200 None
2026-03-28 09:01:39 [auto1.it] INFO: Scrape type for PE07911: 0
2026-03-28 09:01:39 [auto1.it] INFO: Found listing with ID: LP76273
2026-03-28 09:01:39 [auto1.it] INFO: Found listing with ID: WD39478
2026-03-28 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD39478%27 HTTP/1.1" 200 None
2026-03-28 09:01:39 [auto1.it] INFO: Scrape type for WD39478: 2
2026-03-28 09:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2075c451-6898-59e7-a45a-7047ef40a161 with identifier: WD39478
2026-03-28 09:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2075c451-6898-59e7-a45a-7047ef40a161 with scrape type 2
2026-03-28 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2075c451-6898-59e7-a45a-7047ef40a161 with scrape type 2
2026-03-28 09:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2075c451-6898-59e7-a45a-7047ef40a161, identifier: WD39478
2026-03-28 09:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2075c451-6898-59e7-a45a-7047ef40a161 with identifier: WD39478
2026-03-28 09:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2075c451-6898-59e7-a45a-7047ef40a161 with identifier: WD39478
2026-03-28 09:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2075c451-6898-59e7-a45a-7047ef40a161 with identifier: WD39478 to the API
2026-03-28 09:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:20:07Z',
 'fuel_type': 'diesel',
 'id': '2075c451-6898-59e7-a45a-7047ef40a161',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD39478',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 317038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-06-23',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 D-4D Special 4x4',
 'transmission': 'manual',
 'trim': 'Special 4x4',
 'year': 2003}
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD39478%27 HTTP/1.1" 200 None
2026-03-28 09:01:40 [auto1.it] INFO: Saving data for WD39478: {'auction_closing_time': 1774714807.0, 'created_time': 1773132014.268709, 'last_price_update_time': 1774688500.106248}
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WD39478') HTTP/1.1" 204 0
2026-03-28 09:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:40 [auto1.it] INFO: Found listing with ID: AB43384
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB43384%27 HTTP/1.1" 200 None
2026-03-28 09:01:40 [auto1.it] INFO: Scrape type for AB43384: 0
2026-03-28 09:01:40 [auto1.it] INFO: Found listing with ID: CS05902
2026-03-28 09:01:40 [auto1.it] INFO: Found listing with ID: LY95127
2026-03-28 09:01:40 [auto1.it] INFO: Found listing with ID: NN95348
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN95348%27 HTTP/1.1" 200 None
2026-03-28 09:01:40 [auto1.it] INFO: Scrape type for NN95348: 2
2026-03-28 09:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd6b0c36-a9fc-558c-980a-898df9922ffb with identifier: NN95348
2026-03-28 09:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd6b0c36-a9fc-558c-980a-898df9922ffb with scrape type 2
2026-03-28 09:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd6b0c36-a9fc-558c-980a-898df9922ffb with scrape type 2
2026-03-28 09:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd6b0c36-a9fc-558c-980a-898df9922ffb, identifier: NN95348
2026-03-28 09:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd6b0c36-a9fc-558c-980a-898df9922ffb with identifier: NN95348
2026-03-28 09:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd6b0c36-a9fc-558c-980a-898df9922ffb with identifier: NN95348
2026-03-28 09:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd6b0c36-a9fc-558c-980a-898df9922ffb with identifier: NN95348 to the API
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:43:25Z',
 'fuel_type': 'diesel',
 'id': 'dd6b0c36-a9fc-558c-980a-898df9922ffb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN95348',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 232982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-05',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN95348%27 HTTP/1.1" 200 None
2026-03-28 09:01:40 [auto1.it] INFO: Saving data for NN95348: {'auction_closing_time': 1774716205.0, 'created_time': 1772621703.264371, 'last_price_update_time': 1774688500.670965}
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NN95348') HTTP/1.1" 204 0
2026-03-28 09:01:40 [auto1.it] INFO: Found listing with ID: RR71637
2026-03-28 09:01:40 [auto1.it] INFO: Found listing with ID: YT62048
2026-03-28 09:01:40 [auto1.it] INFO: Found listing with ID: HN00760
2026-03-28 09:01:40 [auto1.it] INFO: Found listing with ID: TA79833
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA79833%27 HTTP/1.1" 200 None
2026-03-28 09:01:40 [auto1.it] INFO: Scrape type for TA79833: 2
2026-03-28 09:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b67e0110-345d-5849-b86c-b061341d9eb7 with identifier: TA79833
2026-03-28 09:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b67e0110-345d-5849-b86c-b061341d9eb7 with scrape type 2
2026-03-28 09:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b67e0110-345d-5849-b86c-b061341d9eb7 with scrape type 2
2026-03-28 09:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b67e0110-345d-5849-b86c-b061341d9eb7, identifier: TA79833
2026-03-28 09:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b67e0110-345d-5849-b86c-b061341d9eb7 with identifier: TA79833
2026-03-28 09:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b67e0110-345d-5849-b86c-b061341d9eb7 with identifier: TA79833
2026-03-28 09:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b67e0110-345d-5849-b86c-b061341d9eb7 with identifier: TA79833 to the API
2026-03-28 09:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:16:11Z',
 'fuel_type': 'petrol',
 'id': 'b67e0110-345d-5849-b86c-b061341d9eb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA79833',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 83007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-30',
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2019}
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA79833%27 HTTP/1.1" 200 None
2026-03-28 09:01:41 [auto1.it] INFO: Saving data for TA79833: {'auction_closing_time': 1774714571.0, 'created_time': 1774472555.700417, 'last_price_update_time': 1774688501.146807}
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TA79833') HTTP/1.1" 204 0
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: VH62552
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH62552%27 HTTP/1.1" 200 None
2026-03-28 09:01:41 [auto1.it] INFO: Scrape type for VH62552: 0
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: JV70876
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: NY67397
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY67397%27 HTTP/1.1" 200 None
2026-03-28 09:01:41 [auto1.it] INFO: Scrape type for NY67397: 0
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: GG13380
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG13380%27 HTTP/1.1" 200 None
2026-03-28 09:01:41 [auto1.it] INFO: Scrape type for GG13380: 0
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: EF94220
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF94220%27 HTTP/1.1" 200 None
2026-03-28 09:01:41 [auto1.it] INFO: Scrape type for EF94220: 0
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: SP82579
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP82579%27 HTTP/1.1" 200 None
2026-03-28 09:01:41 [auto1.it] INFO: Scrape type for SP82579: 0
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: LJ38222
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ38222%27 HTTP/1.1" 200 None
2026-03-28 09:01:41 [auto1.it] INFO: Scrape type for LJ38222: 0
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: EZ15489
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ15489%27 HTTP/1.1" 200 None
2026-03-28 09:01:41 [auto1.it] INFO: Scrape type for EZ15489: 0
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: HY22945
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: PY49742
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: VX37353
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX37353%27 HTTP/1.1" 200 None
2026-03-28 09:01:41 [auto1.it] INFO: Scrape type for VX37353: 0
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: ZP51405
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP51405%27 HTTP/1.1" 200 None
2026-03-28 09:01:41 [auto1.it] INFO: Scrape type for ZP51405: 0
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: EG41470
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: UD85899
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD85899%27 HTTP/1.1" 200 None
2026-03-28 09:01:41 [auto1.it] INFO: Scrape type for UD85899: 0
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: JZ67202
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ67202%27 HTTP/1.1" 200 None
2026-03-28 09:01:41 [auto1.it] INFO: Scrape type for JZ67202: 0
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: ZM49441
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM49441%27 HTTP/1.1" 200 None
2026-03-28 09:01:41 [auto1.it] INFO: Scrape type for ZM49441: 0
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: VV14244
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: JR03876
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR03876%27 HTTP/1.1" 200 None
2026-03-28 09:01:41 [auto1.it] INFO: Scrape type for JR03876: 0
2026-03-28 09:01:41 [auto1.it] INFO: Found listing with ID: VH71925
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH71925%27 HTTP/1.1" 200 None
2026-03-28 09:01:41 [auto1.it] INFO: Scrape type for VH71925: 2
2026-03-28 09:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bf2bad4-ec15-536c-8bdc-94ac908c85b1 with identifier: VH71925
2026-03-28 09:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bf2bad4-ec15-536c-8bdc-94ac908c85b1 with scrape type 2
2026-03-28 09:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bf2bad4-ec15-536c-8bdc-94ac908c85b1 with scrape type 2
2026-03-28 09:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6bf2bad4-ec15-536c-8bdc-94ac908c85b1, identifier: VH71925
2026-03-28 09:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6bf2bad4-ec15-536c-8bdc-94ac908c85b1 with identifier: VH71925
2026-03-28 09:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6bf2bad4-ec15-536c-8bdc-94ac908c85b1 with identifier: VH71925
2026-03-28 09:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6bf2bad4-ec15-536c-8bdc-94ac908c85b1 with identifier: VH71925 to the API
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:27:42Z',
 'fuel_type': 'diesel',
 'id': '6bf2bad4-ec15-536c-8bdc-94ac908c85b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH71925',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 129618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-20',
 'seller_name': None,
 'title': 'Skoda Karoq 1.6 TDI Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2019}
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH71925%27 HTTP/1.1" 200 None
2026-03-28 09:01:41 [auto1.it] INFO: Saving data for VH71925: {'auction_closing_time': 1774715262.0, 'created_time': 1772621465.246539, 'last_price_update_time': 1774688501.905021}
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VH71925') HTTP/1.1" 204 0
2026-03-28 09:01:42 [auto1.it] INFO: Found listing with ID: TE89149
2026-03-28 09:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE89149%27 HTTP/1.1" 200 None
2026-03-28 09:01:42 [auto1.it] INFO: Scrape type for TE89149: 0
2026-03-28 09:01:42 [auto1.it] INFO: Found listing with ID: CC36566
2026-03-28 09:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC36566%27 HTTP/1.1" 200 None
2026-03-28 09:01:42 [auto1.it] INFO: Scrape type for CC36566: 0
2026-03-28 09:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:42 [auto1.it] INFO: Channel: 24h | Page: 18 | totalHits: 3432 | hits on page: 40
2026-03-28 09:01:42 [auto1.it] INFO: Found listing with ID: RT91263
2026-03-28 09:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT91263%27 HTTP/1.1" 200 None
2026-03-28 09:01:43 [auto1.it] INFO: Scrape type for RT91263: 0
2026-03-28 09:01:43 [auto1.it] INFO: Found listing with ID: VP99832
2026-03-28 09:01:43 [auto1.it] INFO: Found listing with ID: DS58810
2026-03-28 09:01:43 [auto1.it] INFO: Found listing with ID: JT10117
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT10117%27 HTTP/1.1" 200 None
2026-03-28 09:01:43 [auto1.it] INFO: Scrape type for JT10117: 0
2026-03-28 09:01:43 [auto1.it] INFO: Found listing with ID: HS83274
2026-03-28 09:01:43 [auto1.it] INFO: Found listing with ID: LA76603
2026-03-28 09:01:43 [auto1.it] INFO: Found listing with ID: CC08861
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC08861%27 HTTP/1.1" 200 None
2026-03-28 09:01:43 [auto1.it] INFO: Scrape type for CC08861: 0
2026-03-28 09:01:43 [auto1.it] INFO: Found listing with ID: XN65989
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN65989%27 HTTP/1.1" 200 None
2026-03-28 09:01:43 [auto1.it] INFO: Scrape type for XN65989: 0
2026-03-28 09:01:43 [auto1.it] INFO: Found listing with ID: UP48367
2026-03-28 09:01:43 [auto1.it] INFO: Found listing with ID: HD54235
2026-03-28 09:01:43 [auto1.it] INFO: Found listing with ID: HS60587
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS60587%27 HTTP/1.1" 200 None
2026-03-28 09:01:43 [auto1.it] INFO: Scrape type for HS60587: 2
2026-03-28 09:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b440329-481c-529e-8b4b-968b999eba2f with identifier: HS60587
2026-03-28 09:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b440329-481c-529e-8b4b-968b999eba2f with scrape type 2
2026-03-28 09:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b440329-481c-529e-8b4b-968b999eba2f with scrape type 2
2026-03-28 09:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6b440329-481c-529e-8b4b-968b999eba2f, identifier: HS60587
2026-03-28 09:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6b440329-481c-529e-8b4b-968b999eba2f with identifier: HS60587
2026-03-28 09:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6b440329-481c-529e-8b4b-968b999eba2f with identifier: HS60587
2026-03-28 09:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6b440329-481c-529e-8b4b-968b999eba2f with identifier: HS60587 to the API
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-28T16:36:20Z',
 'fuel_type': 'diesel',
 'id': '6b440329-481c-529e-8b4b-968b999eba2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS60587',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 97985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-28',
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi EcoBlue Vignale 4x4',
 'transmission': 'automatic',
 'trim': 'Vignale 4x4',
 'year': 2020}
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS60587%27 HTTP/1.1" 200 None
2026-03-28 09:01:43 [auto1.it] INFO: Saving data for HS60587: {'auction_closing_time': 1774715780.0, 'created_time': 1774008053.529387, 'last_price_update_time': 1774688503.477228}
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HS60587') HTTP/1.1" 204 0
2026-03-28 09:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:43 [auto1.it] INFO: Found listing with ID: TX80961
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX80961%27 HTTP/1.1" 200 None
2026-03-28 09:01:43 [auto1.it] INFO: Scrape type for TX80961: 0
2026-03-28 09:01:43 [auto1.it] INFO: Found listing with ID: BP45354
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP45354%27 HTTP/1.1" 200 None
2026-03-28 09:01:43 [auto1.it] INFO: Scrape type for BP45354: 0
2026-03-28 09:01:43 [auto1.it] INFO: Found listing with ID: SS67586
2026-03-28 09:01:43 [auto1.it] INFO: Found listing with ID: ZW77638
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW77638%27 HTTP/1.1" 200 None
2026-03-28 09:01:43 [auto1.it] INFO: Scrape type for ZW77638: 2
2026-03-28 09:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d540da2c-d02c-5a10-9b7e-d7bb825c54d2 with identifier: ZW77638
2026-03-28 09:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d540da2c-d02c-5a10-9b7e-d7bb825c54d2 with scrape type 2
2026-03-28 09:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d540da2c-d02c-5a10-9b7e-d7bb825c54d2 with scrape type 2
2026-03-28 09:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d540da2c-d02c-5a10-9b7e-d7bb825c54d2, identifier: ZW77638
2026-03-28 09:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d540da2c-d02c-5a10-9b7e-d7bb825c54d2 with identifier: ZW77638
2026-03-28 09:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d540da2c-d02c-5a10-9b7e-d7bb825c54d2 with identifier: ZW77638
2026-03-28 09:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d540da2c-d02c-5a10-9b7e-d7bb825c54d2 with identifier: ZW77638 to the API
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:00:21Z',
 'fuel_type': 'diesel',
 'id': 'd540da2c-d02c-5a10-9b7e-d7bb825c54d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW77638',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 163525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-25',
 'seller_name': None,
 'title': 'Hyundai ix20 1.4 CRDi Comfort Blue',
 'transmission': 'manual',
 'trim': 'Comfort Blue',
 'year': 2015}
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW77638%27 HTTP/1.1" 200 None
2026-03-28 09:01:44 [auto1.it] INFO: Saving data for ZW77638: {'auction_closing_time': 1774713621.0, 'created_time': 1773232167.330874, 'last_price_update_time': 1774688504.083054}
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZW77638') HTTP/1.1" 204 0
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: DS11019
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS11019%27 HTTP/1.1" 200 None
2026-03-28 09:01:44 [auto1.it] INFO: Scrape type for DS11019: 0
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: MT42798
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT42798%27 HTTP/1.1" 200 None
2026-03-28 09:01:44 [auto1.it] INFO: Scrape type for MT42798: 2
2026-03-28 09:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e85081b7-f032-57b5-bee9-c5f096dadb26 with identifier: MT42798
2026-03-28 09:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e85081b7-f032-57b5-bee9-c5f096dadb26 with scrape type 2
2026-03-28 09:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e85081b7-f032-57b5-bee9-c5f096dadb26 with scrape type 2
2026-03-28 09:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e85081b7-f032-57b5-bee9-c5f096dadb26, identifier: MT42798
2026-03-28 09:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e85081b7-f032-57b5-bee9-c5f096dadb26 with identifier: MT42798
2026-03-28 09:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e85081b7-f032-57b5-bee9-c5f096dadb26 with identifier: MT42798
2026-03-28 09:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e85081b7-f032-57b5-bee9-c5f096dadb26 with identifier: MT42798 to the API
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:00:36Z',
 'fuel_type': 'diesel',
 'id': 'e85081b7-f032-57b5-bee9-c5f096dadb26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT42798',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 96512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-04',
 'seller_name': None,
 'title': 'Land Rover Evoque D200 Mild-Hybrid R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2022}
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT42798%27 HTTP/1.1" 200 None
2026-03-28 09:01:44 [auto1.it] INFO: Saving data for MT42798: {'auction_closing_time': 1774713636.0, 'created_time': 1773231828.05362, 'last_price_update_time': 1774688504.644125}
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MT42798') HTTP/1.1" 204 0
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: AY21125
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: XF71251
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF71251%27 HTTP/1.1" 200 None
2026-03-28 09:01:44 [auto1.it] INFO: Scrape type for XF71251: 0
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: YG03340
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: HV87754
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: UE23071
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE23071%27 HTTP/1.1" 200 None
2026-03-28 09:01:44 [auto1.it] INFO: Scrape type for UE23071: 0
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: SP98700
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: CH78028
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: RS56443
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS56443%27 HTTP/1.1" 200 None
2026-03-28 09:01:44 [auto1.it] INFO: Scrape type for RS56443: 0
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: VZ89804
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: FP61129
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP61129%27 HTTP/1.1" 200 None
2026-03-28 09:01:44 [auto1.it] INFO: Scrape type for FP61129: 0
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: AT32399
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT32399%27 HTTP/1.1" 200 None
2026-03-28 09:01:44 [auto1.it] INFO: Scrape type for AT32399: 0
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: LC14849
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC14849%27 HTTP/1.1" 200 None
2026-03-28 09:01:44 [auto1.it] INFO: Scrape type for LC14849: 0
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: WJ96008
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: AF81201
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF81201%27 HTTP/1.1" 200 None
2026-03-28 09:01:44 [auto1.it] INFO: Scrape type for AF81201: 0
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: RR40401
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR40401%27 HTTP/1.1" 200 None
2026-03-28 09:01:44 [auto1.it] INFO: Scrape type for RR40401: 0
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: TA22060
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: ZW69892
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW69892%27 HTTP/1.1" 200 None
2026-03-28 09:01:44 [auto1.it] INFO: Scrape type for ZW69892: 0
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: VS11522
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: NU78956
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: PT72554
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: BV97691
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV97691%27 HTTP/1.1" 200 None
2026-03-28 09:01:44 [auto1.it] INFO: Scrape type for BV97691: 0
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: CF78450
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF78450%27 HTTP/1.1" 200 None
2026-03-28 09:01:44 [auto1.it] INFO: Scrape type for CF78450: 0
2026-03-28 09:01:44 [auto1.it] INFO: Found listing with ID: FU36199
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU36199%27 HTTP/1.1" 200 None
2026-03-28 09:01:44 [auto1.it] INFO: Scrape type for FU36199: 0
2026-03-28 09:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:48 [auto1.it] INFO: Channel: 24h | Page: 19 | totalHits: 3432 | hits on page: 40
2026-03-28 09:01:48 [auto1.it] INFO: Found listing with ID: AD96495
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD96495%27 HTTP/1.1" 200 None
2026-03-28 09:01:48 [auto1.it] INFO: Scrape type for AD96495: 0
2026-03-28 09:01:48 [auto1.it] INFO: Found listing with ID: DJ66527
2026-03-28 09:01:48 [auto1.it] INFO: Found listing with ID: EC51019
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC51019%27 HTTP/1.1" 200 None
2026-03-28 09:01:48 [auto1.it] INFO: Scrape type for EC51019: 0
2026-03-28 09:01:48 [auto1.it] INFO: Found listing with ID: CH88707
2026-03-28 09:01:48 [auto1.it] INFO: Found listing with ID: LY98983
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY98983%27 HTTP/1.1" 200 None
2026-03-28 09:01:48 [auto1.it] INFO: Scrape type for LY98983: 0
2026-03-28 09:01:48 [auto1.it] INFO: Found listing with ID: YP32890
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP32890%27 HTTP/1.1" 200 None
2026-03-28 09:01:48 [auto1.it] INFO: Scrape type for YP32890: 0
2026-03-28 09:01:48 [auto1.it] INFO: Found listing with ID: WL70343
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL70343%27 HTTP/1.1" 200 None
2026-03-28 09:01:48 [auto1.it] INFO: Scrape type for WL70343: 0
2026-03-28 09:01:48 [auto1.it] INFO: Found listing with ID: JD09994
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD09994%27 HTTP/1.1" 200 None
2026-03-28 09:01:48 [auto1.it] INFO: Scrape type for JD09994: 0
2026-03-28 09:01:48 [auto1.it] INFO: Found listing with ID: AA32249
2026-03-28 09:01:48 [auto1.it] INFO: Found listing with ID: AX60042
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX60042%27 HTTP/1.1" 200 None
2026-03-28 09:01:48 [auto1.it] INFO: Scrape type for AX60042: 0
2026-03-28 09:01:48 [auto1.it] INFO: Found listing with ID: NN95862
2026-03-28 09:01:48 [auto1.it] INFO: Found listing with ID: MH62974
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH62974%27 HTTP/1.1" 200 None
2026-03-28 09:01:48 [auto1.it] INFO: Scrape type for MH62974: 0
2026-03-28 09:01:48 [auto1.it] INFO: Found listing with ID: VS31933
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS31933%27 HTTP/1.1" 200 None
2026-03-28 09:01:48 [auto1.it] INFO: Scrape type for VS31933: 0
2026-03-28 09:01:48 [auto1.it] INFO: Found listing with ID: KH50025
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH50025%27 HTTP/1.1" 200 None
2026-03-28 09:01:48 [auto1.it] INFO: Scrape type for KH50025: 0
2026-03-28 09:01:48 [auto1.it] INFO: Found listing with ID: KZ03059
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ03059%27 HTTP/1.1" 200 None
2026-03-28 09:01:48 [auto1.it] INFO: Scrape type for KZ03059: 0
2026-03-28 09:01:48 [auto1.it] INFO: Found listing with ID: BA03672
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA03672%27 HTTP/1.1" 200 None
2026-03-28 09:01:48 [auto1.it] INFO: Scrape type for BA03672: 2
2026-03-28 09:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60395ac8-d375-5fd8-90ce-ee32d742bc10 with identifier: BA03672
2026-03-28 09:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60395ac8-d375-5fd8-90ce-ee32d742bc10 with scrape type 2
2026-03-28 09:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60395ac8-d375-5fd8-90ce-ee32d742bc10 with scrape type 2
2026-03-28 09:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 60395ac8-d375-5fd8-90ce-ee32d742bc10, identifier: BA03672
2026-03-28 09:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 60395ac8-d375-5fd8-90ce-ee32d742bc10 with identifier: BA03672
2026-03-28 09:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 60395ac8-d375-5fd8-90ce-ee32d742bc10 with identifier: BA03672
2026-03-28 09:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 60395ac8-d375-5fd8-90ce-ee32d742bc10 with identifier: BA03672 to the API
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:59:26Z',
 'fuel_type': 'diesel',
 'id': '60395ac8-d375-5fd8-90ce-ee32d742bc10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA03672',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 227142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-14',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2019}
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA03672%27 HTTP/1.1" 200 None
2026-03-28 09:01:48 [auto1.it] INFO: Saving data for BA03672: {'auction_closing_time': 1774717166.0, 'created_time': 1773694975.771319, 'last_price_update_time': 1774688508.956052}
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BA03672') HTTP/1.1" 204 0
2026-03-28 09:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: DY31540
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY31540%27 HTTP/1.1" 200 None
2026-03-28 09:01:49 [auto1.it] INFO: Scrape type for DY31540: 2
2026-03-28 09:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2cba162-caa6-55ab-a68d-2b24a1cc9f06 with identifier: DY31540
2026-03-28 09:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2cba162-caa6-55ab-a68d-2b24a1cc9f06 with scrape type 2
2026-03-28 09:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2cba162-caa6-55ab-a68d-2b24a1cc9f06 with scrape type 2
2026-03-28 09:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e2cba162-caa6-55ab-a68d-2b24a1cc9f06, identifier: DY31540
2026-03-28 09:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e2cba162-caa6-55ab-a68d-2b24a1cc9f06 with identifier: DY31540
2026-03-28 09:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e2cba162-caa6-55ab-a68d-2b24a1cc9f06 with identifier: DY31540
2026-03-28 09:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e2cba162-caa6-55ab-a68d-2b24a1cc9f06 with identifier: DY31540 to the API
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:14:03Z',
 'fuel_type': 'diesel',
 'id': 'e2cba162-caa6-55ab-a68d-2b24a1cc9f06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY31540',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 293247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-28',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2014}
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY31540%27 HTTP/1.1" 200 None
2026-03-28 09:01:49 [auto1.it] INFO: Saving data for DY31540: {'auction_closing_time': 1774714443.0, 'created_time': 1773269642.084169, 'last_price_update_time': 1774688509.471127}
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DY31540') HTTP/1.1" 204 0
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: WG30264
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG30264%27 HTTP/1.1" 200 None
2026-03-28 09:01:49 [auto1.it] INFO: Scrape type for WG30264: 0
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: LH23447
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH23447%27 HTTP/1.1" 200 None
2026-03-28 09:01:49 [auto1.it] INFO: Scrape type for LH23447: 0
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: DB60512
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: ER97620
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: LW22359
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW22359%27 HTTP/1.1" 200 None
2026-03-28 09:01:49 [auto1.it] INFO: Scrape type for LW22359: 0
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: RA17642
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA17642%27 HTTP/1.1" 200 None
2026-03-28 09:01:49 [auto1.it] INFO: Scrape type for RA17642: 0
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: XA69003
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: FA25945
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: XH39362
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: EE84208
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: AM77280
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: VH07550
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: DW53696
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: HA02667
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: VF37743
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF37743%27 HTTP/1.1" 200 None
2026-03-28 09:01:49 [auto1.it] INFO: Scrape type for VF37743: 0
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: YF99217
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF99217%27 HTTP/1.1" 200 None
2026-03-28 09:01:49 [auto1.it] INFO: Scrape type for YF99217: 0
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: DY73296
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY73296%27 HTTP/1.1" 200 None
2026-03-28 09:01:49 [auto1.it] INFO: Scrape type for DY73296: 0
2026-03-28 09:01:49 [auto1.it] INFO: Found listing with ID: EG78333
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG78333%27 HTTP/1.1" 200 None
2026-03-28 09:01:49 [auto1.it] INFO: Scrape type for EG78333: 2
2026-03-28 09:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e405db9f-ecb0-557c-8283-ca262614bcf8 with identifier: EG78333
2026-03-28 09:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e405db9f-ecb0-557c-8283-ca262614bcf8 with scrape type 2
2026-03-28 09:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e405db9f-ecb0-557c-8283-ca262614bcf8 with scrape type 2
2026-03-28 09:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e405db9f-ecb0-557c-8283-ca262614bcf8, identifier: EG78333
2026-03-28 09:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e405db9f-ecb0-557c-8283-ca262614bcf8 with identifier: EG78333
2026-03-28 09:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e405db9f-ecb0-557c-8283-ca262614bcf8 with identifier: EG78333
2026-03-28 09:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e405db9f-ecb0-557c-8283-ca262614bcf8 with identifier: EG78333 to the API
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:55:49Z',
 'fuel_type': 'diesel',
 'id': 'e405db9f-ecb0-557c-8283-ca262614bcf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG78333',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 135978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-12',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.5 Blue-HDi C-Series',
 'transmission': 'automatic',
 'trim': 'C-Series',
 'year': 2021}
2026-03-28 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG78333%27 HTTP/1.1" 200 None
2026-03-28 09:01:50 [auto1.it] INFO: Saving data for EG78333: {'auction_closing_time': 1774716949.0, 'created_time': 1774472758.231499, 'last_price_update_time': 1774688510.010485}
2026-03-28 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EG78333') HTTP/1.1" 204 0
2026-03-28 09:01:50 [auto1.it] INFO: Found listing with ID: PY58212
2026-03-28 09:01:50 [auto1.it] INFO: Found listing with ID: RZ99853
2026-03-28 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ99853%27 HTTP/1.1" 200 None
2026-03-28 09:01:50 [auto1.it] INFO: Scrape type for RZ99853: 0
2026-03-28 09:01:50 [auto1.it] INFO: Found listing with ID: RL06920
2026-03-28 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL06920%27 HTTP/1.1" 200 None
2026-03-28 09:01:50 [auto1.it] INFO: Scrape type for RL06920: 0
2026-03-28 09:01:50 [auto1.it] INFO: Found listing with ID: GK45626
2026-03-28 09:01:50 [auto1.it] INFO: Found listing with ID: TY80704
2026-03-28 09:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:51 [auto1.it] INFO: Channel: 24h | Page: 20 | totalHits: 3432 | hits on page: 40
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: TU01190
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU01190%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for TU01190: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: LW64667
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW64667%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for LW64667: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: AG51649
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: HY24657
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY24657%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for HY24657: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: BA90157
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA90157%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for BA90157: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: AZ56413
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: EV65529
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: HK54342
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK54342%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for HK54342: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: TD67992
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD67992%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for TD67992: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: BD83162
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: WZ30101
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: FP75199
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: KX92942
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: HC85966
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: RC69852
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC69852%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for RC69852: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: NB44357
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB44357%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for NB44357: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: NV42271
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: CS16004
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: YA80598
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: EX06021
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX06021%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for EX06021: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: MS41612
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS41612%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for MS41612: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: RN15914
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: TP79080
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP79080%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for TP79080: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: WE89582
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: EF87195
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF87195%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for EF87195: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: WE25816
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: BH62739
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH62739%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for BH62739: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: HE61861
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: ZP49610
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP49610%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for ZP49610: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: JF46642
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: PD12623
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: KZ30481
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: XG03695
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XG03695%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for XG03695: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: ZM05911
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM05911%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for ZM05911: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: SK71918
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK71918%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for SK71918: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: RY16068
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY16068%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for RY16068: 0
2026-03-28 09:01:51 [auto1.it] INFO: Found listing with ID: ZL28386
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL28386%27 HTTP/1.1" 200 None
2026-03-28 09:01:51 [auto1.it] INFO: Scrape type for ZL28386: 2
2026-03-28 09:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 201ace3f-a3d9-54ef-a0a1-f5df8b827770 with identifier: ZL28386
2026-03-28 09:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 201ace3f-a3d9-54ef-a0a1-f5df8b827770 with scrape type 2
2026-03-28 09:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 201ace3f-a3d9-54ef-a0a1-f5df8b827770 with scrape type 2
2026-03-28 09:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 201ace3f-a3d9-54ef-a0a1-f5df8b827770, identifier: ZL28386
2026-03-28 09:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 201ace3f-a3d9-54ef-a0a1-f5df8b827770 with identifier: ZL28386
2026-03-28 09:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 201ace3f-a3d9-54ef-a0a1-f5df8b827770 with identifier: ZL28386
2026-03-28 09:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 201ace3f-a3d9-54ef-a0a1-f5df8b827770 with identifier: ZL28386 to the API
2026-03-28 09:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:11:06Z',
 'fuel_type': 'diesel',
 'id': '201ace3f-a3d9-54ef-a0a1-f5df8b827770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL28386',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 159767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-15',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-28 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL28386%27 HTTP/1.1" 200 None
2026-03-28 09:01:52 [auto1.it] INFO: Saving data for ZL28386: {'auction_closing_time': 1774714266.0, 'created_time': 1772779088.410196, 'last_price_update_time': 1774688512.114814}
2026-03-28 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZL28386') HTTP/1.1" 204 0
2026-03-28 09:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:52 [auto1.it] INFO: Found listing with ID: HA95428
2026-03-28 09:01:52 [auto1.it] INFO: Found listing with ID: YV30830
2026-03-28 09:01:52 [auto1.it] INFO: Found listing with ID: GW68034
2026-03-28 09:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:53 [auto1.it] INFO: Channel: 24h | Page: 21 | totalHits: 3432 | hits on page: 40
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: CC46702
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC46702%27 HTTP/1.1" 200 None
2026-03-28 09:01:53 [auto1.it] INFO: Scrape type for CC46702: 0
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: GY41303
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY41303%27 HTTP/1.1" 200 None
2026-03-28 09:01:53 [auto1.it] INFO: Scrape type for GY41303: 0
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: JN64307
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: DT10688
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: KW88913
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: WR05757
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: KN14536
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: GR13537
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR13537%27 HTTP/1.1" 200 None
2026-03-28 09:01:53 [auto1.it] INFO: Scrape type for GR13537: 0
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: PU36388
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: CJ46241
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: DF43050
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF43050%27 HTTP/1.1" 200 None
2026-03-28 09:01:53 [auto1.it] INFO: Scrape type for DF43050: 0
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: PN79982
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN79982%27 HTTP/1.1" 200 None
2026-03-28 09:01:53 [auto1.it] INFO: Scrape type for PN79982: 0
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: VS33073
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS33073%27 HTTP/1.1" 200 None
2026-03-28 09:01:53 [auto1.it] INFO: Scrape type for VS33073: 0
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: GR09815
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: RG52060
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: SJ09087
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ09087%27 HTTP/1.1" 200 None
2026-03-28 09:01:53 [auto1.it] INFO: Scrape type for SJ09087: 0
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: CV33669
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: UB96617
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB96617%27 HTTP/1.1" 200 None
2026-03-28 09:01:53 [auto1.it] INFO: Scrape type for UB96617: 0
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: CC54288
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC54288%27 HTTP/1.1" 200 None
2026-03-28 09:01:53 [auto1.it] INFO: Scrape type for CC54288: 0
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: SR46685
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR46685%27 HTTP/1.1" 200 None
2026-03-28 09:01:53 [auto1.it] INFO: Scrape type for SR46685: 0
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: ZK89803
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK89803%27 HTTP/1.1" 200 None
2026-03-28 09:01:53 [auto1.it] INFO: Scrape type for ZK89803: 0
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: BX02357
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: GH50385
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GH50385%27 HTTP/1.1" 200 None
2026-03-28 09:01:53 [auto1.it] INFO: Scrape type for GH50385: 0
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: JK53283
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: JF95895
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: NT74531
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT74531%27 HTTP/1.1" 200 None
2026-03-28 09:01:53 [auto1.it] INFO: Scrape type for NT74531: 0
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: TS34792
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS34792%27 HTTP/1.1" 200 None
2026-03-28 09:01:53 [auto1.it] INFO: Scrape type for TS34792: 0
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: CS89848
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS89848%27 HTTP/1.1" 200 None
2026-03-28 09:01:53 [auto1.it] INFO: Scrape type for CS89848: 0
2026-03-28 09:01:53 [auto1.it] INFO: Found listing with ID: UY09098
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY09098%27 HTTP/1.1" 200 None
2026-03-28 09:01:53 [auto1.it] INFO: Scrape type for UY09098: 2
2026-03-28 09:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 030a492c-1a9f-5a70-a797-33cd5a396fc0 with identifier: UY09098
2026-03-28 09:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 030a492c-1a9f-5a70-a797-33cd5a396fc0 with scrape type 2
2026-03-28 09:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 030a492c-1a9f-5a70-a797-33cd5a396fc0 with scrape type 2
2026-03-28 09:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 030a492c-1a9f-5a70-a797-33cd5a396fc0, identifier: UY09098
2026-03-28 09:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 030a492c-1a9f-5a70-a797-33cd5a396fc0 with identifier: UY09098
2026-03-28 09:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 030a492c-1a9f-5a70-a797-33cd5a396fc0 with identifier: UY09098
2026-03-28 09:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 030a492c-1a9f-5a70-a797-33cd5a396fc0 with identifier: UY09098 to the API
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:02:35Z',
 'fuel_type': 'petrol',
 'id': '030a492c-1a9f-5a70-a797-33cd5a396fc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY09098',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 67394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-23',
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2019}
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY09098%27 HTTP/1.1" 200 None
2026-03-28 09:01:53 [auto1.it] INFO: Saving data for UY09098: {'auction_closing_time': 1774713755.0, 'created_time': 1773237584.211928, 'last_price_update_time': 1774688513.962721}
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UY09098') HTTP/1.1" 204 0
2026-03-28 09:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:54 [auto1.it] INFO: Found listing with ID: CP19767
2026-03-28 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP19767%27 HTTP/1.1" 200 None
2026-03-28 09:01:54 [auto1.it] INFO: Scrape type for CP19767: 0
2026-03-28 09:01:54 [auto1.it] INFO: Found listing with ID: KR43222
2026-03-28 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR43222%27 HTTP/1.1" 200 None
2026-03-28 09:01:54 [auto1.it] INFO: Scrape type for KR43222: 0
2026-03-28 09:01:54 [auto1.it] INFO: Found listing with ID: SU00968
2026-03-28 09:01:54 [auto1.it] INFO: Found listing with ID: NT59940
2026-03-28 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT59940%27 HTTP/1.1" 200 None
2026-03-28 09:01:54 [auto1.it] INFO: Scrape type for NT59940: 0
2026-03-28 09:01:54 [auto1.it] INFO: Found listing with ID: JA46265
2026-03-28 09:01:54 [auto1.it] INFO: Found listing with ID: RR88002
2026-03-28 09:01:54 [auto1.it] INFO: Found listing with ID: KJ52341
2026-03-28 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ52341%27 HTTP/1.1" 200 None
2026-03-28 09:01:54 [auto1.it] INFO: Scrape type for KJ52341: 0
2026-03-28 09:01:54 [auto1.it] INFO: Found listing with ID: ZS89496
2026-03-28 09:01:54 [auto1.it] INFO: Found listing with ID: LF91623
2026-03-28 09:01:54 [auto1.it] INFO: Found listing with ID: EB44721
2026-03-28 09:01:54 [auto1.it] INFO: Found listing with ID: TZ05140
2026-03-28 09:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:01:58 [auto1.it] INFO: Channel: 24h | Page: 22 | totalHits: 3432 | hits on page: 40
2026-03-28 09:01:58 [auto1.it] INFO: Found listing with ID: NG93941
2026-03-28 09:01:58 [auto1.it] INFO: Found listing with ID: NL26741
2026-03-28 09:01:58 [auto1.it] INFO: Found listing with ID: BF95758
2026-03-28 09:01:58 [auto1.it] INFO: Found listing with ID: LG12773
2026-03-28 09:01:58 [auto1.it] INFO: Found listing with ID: SK24078
2026-03-28 09:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK24078%27 HTTP/1.1" 200 None
2026-03-28 09:01:58 [auto1.it] INFO: Scrape type for SK24078: 2
2026-03-28 09:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 830a40c6-1431-59f1-bc18-21c6a6afd5fd with identifier: SK24078
2026-03-28 09:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 830a40c6-1431-59f1-bc18-21c6a6afd5fd with scrape type 2
2026-03-28 09:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 830a40c6-1431-59f1-bc18-21c6a6afd5fd with scrape type 2
2026-03-28 09:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 830a40c6-1431-59f1-bc18-21c6a6afd5fd, identifier: SK24078
2026-03-28 09:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 830a40c6-1431-59f1-bc18-21c6a6afd5fd with identifier: SK24078
2026-03-28 09:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 830a40c6-1431-59f1-bc18-21c6a6afd5fd with identifier: SK24078
2026-03-28 09:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 830a40c6-1431-59f1-bc18-21c6a6afd5fd with identifier: SK24078 to the API
2026-03-28 09:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:39:31Z',
 'fuel_type': 'diesel',
 'id': '830a40c6-1431-59f1-bc18-21c6a6afd5fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK24078',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 161181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-26',
 'seller_name': None,
 'title': 'BMW 3er 316d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 09:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK24078%27 HTTP/1.1" 200 None
2026-03-28 09:01:58 [auto1.it] INFO: Saving data for SK24078: {'auction_closing_time': 1774715971.0, 'created_time': 1774472788.194562, 'last_price_update_time': 1774688518.717376}
2026-03-28 09:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SK24078') HTTP/1.1" 204 0
2026-03-28 09:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:01:58 [auto1.it] INFO: Found listing with ID: AN86148
2026-03-28 09:01:58 [auto1.it] INFO: Found listing with ID: EM78419
2026-03-28 09:01:58 [auto1.it] INFO: Found listing with ID: TT32643
2026-03-28 09:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT32643%27 HTTP/1.1" 200 None
2026-03-28 09:01:58 [auto1.it] INFO: Scrape type for TT32643: 0
2026-03-28 09:01:58 [auto1.it] INFO: Found listing with ID: GD67829
2026-03-28 09:01:58 [auto1.it] INFO: Found listing with ID: RA70814
2026-03-28 09:01:58 [auto1.it] INFO: Found listing with ID: BX38119
2026-03-28 09:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX38119%27 HTTP/1.1" 200 None
2026-03-28 09:01:58 [auto1.it] INFO: Scrape type for BX38119: 2
2026-03-28 09:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b679fff2-be4a-5a33-9dee-5793478636e6 with identifier: BX38119
2026-03-28 09:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b679fff2-be4a-5a33-9dee-5793478636e6 with scrape type 2
2026-03-28 09:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b679fff2-be4a-5a33-9dee-5793478636e6 with scrape type 2
2026-03-28 09:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b679fff2-be4a-5a33-9dee-5793478636e6, identifier: BX38119
2026-03-28 09:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b679fff2-be4a-5a33-9dee-5793478636e6 with identifier: BX38119
2026-03-28 09:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b679fff2-be4a-5a33-9dee-5793478636e6 with identifier: BX38119
2026-03-28 09:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b679fff2-be4a-5a33-9dee-5793478636e6 with identifier: BX38119 to the API
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:30:45Z',
 'fuel_type': 'diesel',
 'id': 'b679fff2-be4a-5a33-9dee-5793478636e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX38119',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 209470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-18',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX38119%27 HTTP/1.1" 200 None
2026-03-28 09:01:59 [auto1.it] INFO: Saving data for BX38119: {'auction_closing_time': 1774715445.0, 'created_time': 1773130450.924802, 'last_price_update_time': 1774688519.271153}
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BX38119') HTTP/1.1" 204 0
2026-03-28 09:01:59 [auto1.it] INFO: Found listing with ID: FR55609
2026-03-28 09:01:59 [auto1.it] INFO: Found listing with ID: ZW61080
2026-03-28 09:01:59 [auto1.it] INFO: Found listing with ID: ZN01061
2026-03-28 09:01:59 [auto1.it] INFO: Found listing with ID: CB66149
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB66149%27 HTTP/1.1" 200 None
2026-03-28 09:01:59 [auto1.it] INFO: Scrape type for CB66149: 0
2026-03-28 09:01:59 [auto1.it] INFO: Found listing with ID: PY10905
2026-03-28 09:01:59 [auto1.it] INFO: Found listing with ID: AR54345
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR54345%27 HTTP/1.1" 200 None
2026-03-28 09:01:59 [auto1.it] INFO: Scrape type for AR54345: 0
2026-03-28 09:01:59 [auto1.it] INFO: Found listing with ID: HH71659
2026-03-28 09:01:59 [auto1.it] INFO: Found listing with ID: YL77107
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL77107%27 HTTP/1.1" 200 None
2026-03-28 09:01:59 [auto1.it] INFO: Scrape type for YL77107: 0
2026-03-28 09:01:59 [auto1.it] INFO: Found listing with ID: NZ65760
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ65760%27 HTTP/1.1" 200 None
2026-03-28 09:01:59 [auto1.it] INFO: Scrape type for NZ65760: 2
2026-03-28 09:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef8ec634-abf7-5dfe-9472-b6f95663d5cb with identifier: NZ65760
2026-03-28 09:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef8ec634-abf7-5dfe-9472-b6f95663d5cb with scrape type 2
2026-03-28 09:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef8ec634-abf7-5dfe-9472-b6f95663d5cb with scrape type 2
2026-03-28 09:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ef8ec634-abf7-5dfe-9472-b6f95663d5cb, identifier: NZ65760
2026-03-28 09:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ef8ec634-abf7-5dfe-9472-b6f95663d5cb with identifier: NZ65760
2026-03-28 09:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ef8ec634-abf7-5dfe-9472-b6f95663d5cb with identifier: NZ65760
2026-03-28 09:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ef8ec634-abf7-5dfe-9472-b6f95663d5cb with identifier: NZ65760 to the API
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:16:06Z',
 'fuel_type': 'diesel',
 'id': 'ef8ec634-abf7-5dfe-9472-b6f95663d5cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ65760',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 210464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-24',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ65760%27 HTTP/1.1" 200 None
2026-03-28 09:01:59 [auto1.it] INFO: Saving data for NZ65760: {'auction_closing_time': 1774714566.0, 'created_time': 1773231476.294218, 'last_price_update_time': 1774688519.786558}
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NZ65760') HTTP/1.1" 204 0
2026-03-28 09:01:59 [auto1.it] INFO: Found listing with ID: EZ92268
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ92268%27 HTTP/1.1" 200 None
2026-03-28 09:01:59 [auto1.it] INFO: Scrape type for EZ92268: 0
2026-03-28 09:01:59 [auto1.it] INFO: Found listing with ID: SS19742
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS19742%27 HTTP/1.1" 200 None
2026-03-28 09:01:59 [auto1.it] INFO: Scrape type for SS19742: 2
2026-03-28 09:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 423edee7-8a09-54b9-9a71-d76e1fbd024c with identifier: SS19742
2026-03-28 09:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 423edee7-8a09-54b9-9a71-d76e1fbd024c with scrape type 2
2026-03-28 09:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 423edee7-8a09-54b9-9a71-d76e1fbd024c with scrape type 2
2026-03-28 09:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 423edee7-8a09-54b9-9a71-d76e1fbd024c, identifier: SS19742
2026-03-28 09:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 423edee7-8a09-54b9-9a71-d76e1fbd024c with identifier: SS19742
2026-03-28 09:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 423edee7-8a09-54b9-9a71-d76e1fbd024c with identifier: SS19742
2026-03-28 09:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 423edee7-8a09-54b9-9a71-d76e1fbd024c with identifier: SS19742 to the API
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:52:15Z',
 'fuel_type': 'hybrid',
 'id': '423edee7-8a09-54b9-9a71-d76e1fbd024c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS19742',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris Touring Sports',
 'odometer': 172862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-27',
 'seller_name': None,
 'title': 'Toyota Auris Touring Sports 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS19742%27 HTTP/1.1" 200 None
2026-03-28 09:02:00 [auto1.it] INFO: Saving data for SS19742: {'auction_closing_time': 1774716735.0, 'created_time': 1773269141.831983, 'last_price_update_time': 1774688520.367899}
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SS19742') HTTP/1.1" 204 0
2026-03-28 09:02:00 [auto1.it] INFO: Found listing with ID: UA22723
2026-03-28 09:02:00 [auto1.it] INFO: Found listing with ID: WN10249
2026-03-28 09:02:00 [auto1.it] INFO: Found listing with ID: BS22593
2026-03-28 09:02:00 [auto1.it] INFO: Found listing with ID: RS53925
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS53925%27 HTTP/1.1" 200 None
2026-03-28 09:02:00 [auto1.it] INFO: Scrape type for RS53925: 0
2026-03-28 09:02:00 [auto1.it] INFO: Found listing with ID: WF98355
2026-03-28 09:02:00 [auto1.it] INFO: Found listing with ID: KK16501
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK16501%27 HTTP/1.1" 200 None
2026-03-28 09:02:00 [auto1.it] INFO: Scrape type for KK16501: 0
2026-03-28 09:02:00 [auto1.it] INFO: Found listing with ID: AL46410
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL46410%27 HTTP/1.1" 200 None
2026-03-28 09:02:00 [auto1.it] INFO: Scrape type for AL46410: 2
2026-03-28 09:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ad5005c-944c-506e-be1f-a60795aa8a73 with identifier: AL46410
2026-03-28 09:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ad5005c-944c-506e-be1f-a60795aa8a73 with scrape type 2
2026-03-28 09:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ad5005c-944c-506e-be1f-a60795aa8a73 with scrape type 2
2026-03-28 09:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0ad5005c-944c-506e-be1f-a60795aa8a73, identifier: AL46410
2026-03-28 09:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0ad5005c-944c-506e-be1f-a60795aa8a73 with identifier: AL46410
2026-03-28 09:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0ad5005c-944c-506e-be1f-a60795aa8a73 with identifier: AL46410
2026-03-28 09:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0ad5005c-944c-506e-be1f-a60795aa8a73 with identifier: AL46410 to the API
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:02:38Z',
 'fuel_type': 'petrol',
 'id': '0ad5005c-944c-506e-be1f-a60795aa8a73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL46410',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 143616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-30',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2018}
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL46410%27 HTTP/1.1" 200 None
2026-03-28 09:02:00 [auto1.it] INFO: Saving data for AL46410: {'auction_closing_time': 1774713758.0, 'created_time': 1772654578.555696, 'last_price_update_time': 1774688520.862912}
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AL46410') HTTP/1.1" 204 0
2026-03-28 09:02:00 [auto1.it] INFO: Found listing with ID: EY73607
2026-03-28 09:02:00 [auto1.it] INFO: Found listing with ID: NR08149
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR08149%27 HTTP/1.1" 200 None
2026-03-28 09:02:00 [auto1.it] INFO: Scrape type for NR08149: 2
2026-03-28 09:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e212511f-7c46-53a3-87fd-2c073245daf2 with identifier: NR08149
2026-03-28 09:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e212511f-7c46-53a3-87fd-2c073245daf2 with scrape type 2
2026-03-28 09:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e212511f-7c46-53a3-87fd-2c073245daf2 with scrape type 2
2026-03-28 09:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e212511f-7c46-53a3-87fd-2c073245daf2, identifier: NR08149
2026-03-28 09:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e212511f-7c46-53a3-87fd-2c073245daf2 with identifier: NR08149
2026-03-28 09:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e212511f-7c46-53a3-87fd-2c073245daf2 with identifier: NR08149
2026-03-28 09:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e212511f-7c46-53a3-87fd-2c073245daf2 with identifier: NR08149 to the API
2026-03-28 09:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:06:28Z',
 'fuel_type': 'diesel',
 'id': 'e212511f-7c46-53a3-87fd-2c073245daf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR08149',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 256825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-28',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.2 D-CAT Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2006}
2026-03-28 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR08149%27 HTTP/1.1" 200 None
2026-03-28 09:02:01 [auto1.it] INFO: Saving data for NR08149: {'auction_closing_time': 1774713988.0, 'created_time': 1773267625.916246, 'last_price_update_time': 1774688521.367851}
2026-03-28 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR08149') HTTP/1.1" 204 0
2026-03-28 09:02:01 [auto1.it] INFO: Found listing with ID: BR68512
2026-03-28 09:02:01 [auto1.it] INFO: Found listing with ID: ED61814
2026-03-28 09:02:01 [auto1.it] INFO: Found listing with ID: EW91722
2026-03-28 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW91722%27 HTTP/1.1" 200 None
2026-03-28 09:02:01 [auto1.it] INFO: Scrape type for EW91722: 2
2026-03-28 09:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1eea1f32-d979-55ce-a765-3a5d0e549e48 with identifier: EW91722
2026-03-28 09:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1eea1f32-d979-55ce-a765-3a5d0e549e48 with scrape type 2
2026-03-28 09:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1eea1f32-d979-55ce-a765-3a5d0e549e48 with scrape type 2
2026-03-28 09:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1eea1f32-d979-55ce-a765-3a5d0e549e48, identifier: EW91722
2026-03-28 09:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1eea1f32-d979-55ce-a765-3a5d0e549e48 with identifier: EW91722
2026-03-28 09:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1eea1f32-d979-55ce-a765-3a5d0e549e48 with identifier: EW91722
2026-03-28 09:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1eea1f32-d979-55ce-a765-3a5d0e549e48 with identifier: EW91722 to the API
2026-03-28 09:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:05:00Z',
 'fuel_type': 'diesel',
 'id': '1eea1f32-d979-55ce-a765-3a5d0e549e48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW91722',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 202607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-22',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 d Shooting Brake Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW91722%27 HTTP/1.1" 200 None
2026-03-28 09:02:01 [auto1.it] INFO: Saving data for EW91722: {'auction_closing_time': 1774713900.0, 'created_time': 1773694880.075355, 'last_price_update_time': 1774688521.876358}
2026-03-28 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EW91722') HTTP/1.1" 204 0
2026-03-28 09:02:01 [auto1.it] INFO: Found listing with ID: JC71555
2026-03-28 09:02:01 [auto1.it] INFO: Found listing with ID: ZF01645
2026-03-28 09:02:01 [auto1.it] INFO: Found listing with ID: NX47141
2026-03-28 09:02:01 [auto1.it] INFO: Found listing with ID: DN07271
2026-03-28 09:02:01 [auto1.it] INFO: Found listing with ID: GY11839
2026-03-28 09:02:01 [auto1.it] INFO: Found listing with ID: AV12122
2026-03-28 09:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:03 [auto1.it] INFO: Channel: 24h | Page: 23 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: TW69998
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW69998%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for TW69998: 0
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: WX96902
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX96902%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for WX96902: 0
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: ZZ84284
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: ST13349
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: AT74871
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: LZ72377
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: ZE71737
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: LG98930
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: CX09724
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: MK54778
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: PZ08956
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: XY83174
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY83174%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for XY83174: 0
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: JK67025
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK67025%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for JK67025: 0
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: WS86026
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: ZA88698
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA88698%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for ZA88698: 0
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: PM10461
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: SP76213
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: CS00409
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS00409%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for CS00409: 0
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: VM52207
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM52207%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for VM52207: 0
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: HA26046
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA26046%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for HA26046: 0
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: NP04036
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP04036%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for NP04036: 0
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: TR59701
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR59701%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for TR59701: 0
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: KX10481
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: YH31612
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: YM20104
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: NW69655
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: GS12960
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: LL73922
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: CG84087
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG84087%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for CG84087: 0
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: CV08843
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV08843%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for CV08843: 2
2026-03-28 09:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c178d46-3d13-5ac7-94a4-d10cd3a11620 with identifier: CV08843
2026-03-28 09:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c178d46-3d13-5ac7-94a4-d10cd3a11620 with scrape type 2
2026-03-28 09:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c178d46-3d13-5ac7-94a4-d10cd3a11620 with scrape type 2
2026-03-28 09:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1c178d46-3d13-5ac7-94a4-d10cd3a11620, identifier: CV08843
2026-03-28 09:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1c178d46-3d13-5ac7-94a4-d10cd3a11620 with identifier: CV08843
2026-03-28 09:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1c178d46-3d13-5ac7-94a4-d10cd3a11620 with identifier: CV08843
2026-03-28 09:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1c178d46-3d13-5ac7-94a4-d10cd3a11620 with identifier: CV08843 to the API
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:38:21Z',
 'fuel_type': 'petrol',
 'id': '1c178d46-3d13-5ac7-94a4-d10cd3a11620',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV08843',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 98987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-30',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.4 Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2010}
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV08843%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Saving data for CV08843: {'auction_closing_time': 1774715901.0, 'created_time': 1773267467.518506, 'last_price_update_time': 1774688523.775429}
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CV08843') HTTP/1.1" 204 0
2026-03-28 09:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: RT64884
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT64884%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for RT64884: 0
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: YX93099
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX93099%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for YX93099: 0
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: TD31675
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: XJ00543
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ00543%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for XJ00543: 0
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: VX61752
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX61752%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for VX61752: 0
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: RB12034
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB12034%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for RB12034: 0
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: UX48429
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX48429%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for UX48429: 0
2026-03-28 09:02:03 [auto1.it] INFO: Found listing with ID: AX27463
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX27463%27 HTTP/1.1" 200 None
2026-03-28 09:02:03 [auto1.it] INFO: Scrape type for AX27463: 2
2026-03-28 09:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d11c486-3efe-59d2-9235-b8e410cc7aca with identifier: AX27463
2026-03-28 09:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d11c486-3efe-59d2-9235-b8e410cc7aca with scrape type 2
2026-03-28 09:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d11c486-3efe-59d2-9235-b8e410cc7aca with scrape type 2
2026-03-28 09:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9d11c486-3efe-59d2-9235-b8e410cc7aca, identifier: AX27463
2026-03-28 09:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9d11c486-3efe-59d2-9235-b8e410cc7aca with identifier: AX27463
2026-03-28 09:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9d11c486-3efe-59d2-9235-b8e410cc7aca with identifier: AX27463
2026-03-28 09:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9d11c486-3efe-59d2-9235-b8e410cc7aca with identifier: AX27463 to the API
2026-03-28 09:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:32:35Z',
 'fuel_type': 'diesel',
 'id': '9d11c486-3efe-59d2-9235-b8e410cc7aca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX27463',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 124375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-30',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX27463%27 HTTP/1.1" 200 None
2026-03-28 09:02:04 [auto1.it] INFO: Saving data for AX27463: {'auction_closing_time': 1774715555.0, 'created_time': 1773997441.751803, 'last_price_update_time': 1774688524.445062}
2026-03-28 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AX27463') HTTP/1.1" 204 0
2026-03-28 09:02:04 [auto1.it] INFO: Found listing with ID: EB51163
2026-03-28 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB51163%27 HTTP/1.1" 200 None
2026-03-28 09:02:04 [auto1.it] INFO: Scrape type for EB51163: 0
2026-03-28 09:02:04 [auto1.it] INFO: Found listing with ID: UH08527
2026-03-28 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH08527%27 HTTP/1.1" 200 None
2026-03-28 09:02:04 [auto1.it] INFO: Scrape type for UH08527: 0
2026-03-28 09:02:05 [scrapy.extensions.logstats] INFO: Crawled 109 pages (at 15 pages/min), scraped 104 items (at 56 items/min)
2026-03-28 09:02:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 190MiB
2026-03-28 09:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:06 [auto1.it] INFO: Channel: 24h | Page: 24 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: HR07647
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR07647%27 HTTP/1.1" 200 None
2026-03-28 09:02:06 [auto1.it] INFO: Scrape type for HR07647: 0
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: PJ46449
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: ZY55169
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY55169%27 HTTP/1.1" 200 None
2026-03-28 09:02:06 [auto1.it] INFO: Scrape type for ZY55169: 2
2026-03-28 09:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c394719c-fc6f-560a-8299-9459dbe9b72c with identifier: ZY55169
2026-03-28 09:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c394719c-fc6f-560a-8299-9459dbe9b72c with scrape type 2
2026-03-28 09:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c394719c-fc6f-560a-8299-9459dbe9b72c with scrape type 2
2026-03-28 09:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c394719c-fc6f-560a-8299-9459dbe9b72c, identifier: ZY55169
2026-03-28 09:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c394719c-fc6f-560a-8299-9459dbe9b72c with identifier: ZY55169
2026-03-28 09:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c394719c-fc6f-560a-8299-9459dbe9b72c with identifier: ZY55169
2026-03-28 09:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c394719c-fc6f-560a-8299-9459dbe9b72c with identifier: ZY55169 to the API
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:20:10Z',
 'fuel_type': 'gas',
 'id': 'c394719c-fc6f-560a-8299-9459dbe9b72c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY55169',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 140913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-06',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY55169%27 HTTP/1.1" 200 None
2026-03-28 09:02:06 [auto1.it] INFO: Saving data for ZY55169: {'auction_closing_time': 1774714810.0, 'created_time': 1772654467.113172, 'last_price_update_time': 1774688526.55211}
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZY55169') HTTP/1.1" 204 0
2026-03-28 09:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: GX95672
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: SP14530
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP14530%27 HTTP/1.1" 200 None
2026-03-28 09:02:06 [auto1.it] INFO: Scrape type for SP14530: 0
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: AA77653
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA77653%27 HTTP/1.1" 200 None
2026-03-28 09:02:06 [auto1.it] INFO: Scrape type for AA77653: 0
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: XM03029
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM03029%27 HTTP/1.1" 200 None
2026-03-28 09:02:06 [auto1.it] INFO: Scrape type for XM03029: 0
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: LK74969
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: CB30744
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB30744%27 HTTP/1.1" 200 None
2026-03-28 09:02:06 [auto1.it] INFO: Scrape type for CB30744: 0
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: RE87143
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE87143%27 HTTP/1.1" 200 None
2026-03-28 09:02:06 [auto1.it] INFO: Scrape type for RE87143: 0
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: SN57039
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN57039%27 HTTP/1.1" 200 None
2026-03-28 09:02:06 [auto1.it] INFO: Scrape type for SN57039: 0
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: KL78509
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: KU41331
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU41331%27 HTTP/1.1" 200 None
2026-03-28 09:02:06 [auto1.it] INFO: Scrape type for KU41331: 0
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: TG15136
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: JF99544
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF99544%27 HTTP/1.1" 200 None
2026-03-28 09:02:06 [auto1.it] INFO: Scrape type for JF99544: 0
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: JC73899
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: ZA39687
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: JR96571
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: CK86990
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: PL52224
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL52224%27 HTTP/1.1" 200 None
2026-03-28 09:02:06 [auto1.it] INFO: Scrape type for PL52224: 0
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: KU76175
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: FF25963
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: SR16589
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: HU73227
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: PR39180
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: LW03785
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: PZ70422
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ70422%27 HTTP/1.1" 200 None
2026-03-28 09:02:06 [auto1.it] INFO: Scrape type for PZ70422: 0
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: AL46390
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL46390%27 HTTP/1.1" 200 None
2026-03-28 09:02:06 [auto1.it] INFO: Scrape type for AL46390: 0
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: HP25104
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: BF43503
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF43503%27 HTTP/1.1" 200 None
2026-03-28 09:02:06 [auto1.it] INFO: Scrape type for BF43503: 0
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: RA46767
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: ZH71174
2026-03-28 09:02:06 [auto1.it] INFO: Found listing with ID: AP00004
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP00004%27 HTTP/1.1" 200 None
2026-03-28 09:02:06 [auto1.it] INFO: Scrape type for AP00004: 2
2026-03-28 09:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 135f101d-fe9c-5193-9d22-9cabdd2465a5 with identifier: AP00004
2026-03-28 09:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 135f101d-fe9c-5193-9d22-9cabdd2465a5 with scrape type 2
2026-03-28 09:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 135f101d-fe9c-5193-9d22-9cabdd2465a5 with scrape type 2
2026-03-28 09:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 135f101d-fe9c-5193-9d22-9cabdd2465a5, identifier: AP00004
2026-03-28 09:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 135f101d-fe9c-5193-9d22-9cabdd2465a5 with identifier: AP00004
2026-03-28 09:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 135f101d-fe9c-5193-9d22-9cabdd2465a5 with identifier: AP00004
2026-03-28 09:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 135f101d-fe9c-5193-9d22-9cabdd2465a5 with identifier: AP00004 to the API
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:41:56Z',
 'fuel_type': 'hybrid',
 'id': '135f101d-fe9c-5193-9d22-9cabdd2465a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP00004',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 79671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-17',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300de 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2021}
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP00004%27 HTTP/1.1" 200 None
2026-03-28 09:02:07 [auto1.it] INFO: Saving data for AP00004: {'auction_closing_time': 1774716116.0, 'created_time': 1773694867.590874, 'last_price_update_time': 1774688527.298678}
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AP00004') HTTP/1.1" 204 0
2026-03-28 09:02:07 [auto1.it] INFO: Found listing with ID: VJ49724
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ49724%27 HTTP/1.1" 200 None
2026-03-28 09:02:07 [auto1.it] INFO: Scrape type for VJ49724: 0
2026-03-28 09:02:07 [auto1.it] INFO: Found listing with ID: VG29105
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG29105%27 HTTP/1.1" 200 None
2026-03-28 09:02:07 [auto1.it] INFO: Scrape type for VG29105: 2
2026-03-28 09:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af8410e9-17f7-5a87-b313-e3db9b00e712 with identifier: VG29105
2026-03-28 09:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af8410e9-17f7-5a87-b313-e3db9b00e712 with scrape type 2
2026-03-28 09:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af8410e9-17f7-5a87-b313-e3db9b00e712 with scrape type 2
2026-03-28 09:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af8410e9-17f7-5a87-b313-e3db9b00e712, identifier: VG29105
2026-03-28 09:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af8410e9-17f7-5a87-b313-e3db9b00e712 with identifier: VG29105
2026-03-28 09:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af8410e9-17f7-5a87-b313-e3db9b00e712 with identifier: VG29105
2026-03-28 09:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af8410e9-17f7-5a87-b313-e3db9b00e712 with identifier: VG29105 to the API
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:07:27Z',
 'fuel_type': 'petrol',
 'id': 'af8410e9-17f7-5a87-b313-e3db9b00e712',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG29105',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 99367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-29',
 'seller_name': None,
 'title': 'Mazda 2 1.5 Skyactiv-G Mild-Hybrid Evolve',
 'transmission': 'manual',
 'trim': 'Evolve',
 'year': 2020}
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG29105%27 HTTP/1.1" 200 None
2026-03-28 09:02:07 [auto1.it] INFO: Saving data for VG29105: {'auction_closing_time': 1774714047.0, 'created_time': 1773997297.911127, 'last_price_update_time': 1774688527.846791}
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VG29105') HTTP/1.1" 204 0
2026-03-28 09:02:07 [auto1.it] INFO: Found listing with ID: CB60846
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB60846%27 HTTP/1.1" 200 None
2026-03-28 09:02:07 [auto1.it] INFO: Scrape type for CB60846: 2
2026-03-28 09:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb1cdbe2-7afe-5566-9f62-7e9650e50cfe with identifier: CB60846
2026-03-28 09:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb1cdbe2-7afe-5566-9f62-7e9650e50cfe with scrape type 2
2026-03-28 09:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb1cdbe2-7afe-5566-9f62-7e9650e50cfe with scrape type 2
2026-03-28 09:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fb1cdbe2-7afe-5566-9f62-7e9650e50cfe, identifier: CB60846
2026-03-28 09:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fb1cdbe2-7afe-5566-9f62-7e9650e50cfe with identifier: CB60846
2026-03-28 09:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fb1cdbe2-7afe-5566-9f62-7e9650e50cfe with identifier: CB60846
2026-03-28 09:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fb1cdbe2-7afe-5566-9f62-7e9650e50cfe with identifier: CB60846 to the API
2026-03-28 09:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:35:18Z',
 'fuel_type': 'petrol',
 'id': 'fb1cdbe2-7afe-5566-9f62-7e9650e50cfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB60846',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 21357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-21',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.2 TFSI Admired',
 'transmission': 'manual',
 'trim': 'Admired',
 'year': 2013}
2026-03-28 09:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB60846%27 HTTP/1.1" 200 None
2026-03-28 09:02:08 [auto1.it] INFO: Saving data for CB60846: {'auction_closing_time': 1774715718.0, 'created_time': 1774472667.189645, 'last_price_update_time': 1774688528.268412}
2026-03-28 09:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CB60846') HTTP/1.1" 204 0
2026-03-28 09:02:08 [auto1.it] INFO: Found listing with ID: ZU34198
2026-03-28 09:02:08 [auto1.it] INFO: Found listing with ID: TW04222
2026-03-28 09:02:08 [auto1.it] INFO: Found listing with ID: CB25121
2026-03-28 09:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB25121%27 HTTP/1.1" 200 None
2026-03-28 09:02:08 [auto1.it] INFO: Scrape type for CB25121: 0
2026-03-28 09:02:08 [auto1.it] INFO: Found listing with ID: DA23296
2026-03-28 09:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA23296%27 HTTP/1.1" 200 None
2026-03-28 09:02:08 [auto1.it] INFO: Scrape type for DA23296: 0
2026-03-28 09:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:09 [auto1.it] INFO: Channel: 24h | Page: 25 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:09 [auto1.it] INFO: Found listing with ID: PN87184
2026-03-28 09:02:09 [auto1.it] INFO: Found listing with ID: NV88375
2026-03-28 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV88375%27 HTTP/1.1" 200 None
2026-03-28 09:02:09 [auto1.it] INFO: Scrape type for NV88375: 0
2026-03-28 09:02:09 [auto1.it] INFO: Found listing with ID: JY18899
2026-03-28 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY18899%27 HTTP/1.1" 200 None
2026-03-28 09:02:09 [auto1.it] INFO: Scrape type for JY18899: 0
2026-03-28 09:02:09 [auto1.it] INFO: Found listing with ID: BA93594
2026-03-28 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA93594%27 HTTP/1.1" 200 None
2026-03-28 09:02:09 [auto1.it] INFO: Scrape type for BA93594: 0
2026-03-28 09:02:09 [auto1.it] INFO: Found listing with ID: YM08087
2026-03-28 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM08087%27 HTTP/1.1" 200 None
2026-03-28 09:02:09 [auto1.it] INFO: Scrape type for YM08087: 0
2026-03-28 09:02:09 [auto1.it] INFO: Found listing with ID: CM37896
2026-03-28 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM37896%27 HTTP/1.1" 200 None
2026-03-28 09:02:09 [auto1.it] INFO: Scrape type for CM37896: 0
2026-03-28 09:02:09 [auto1.it] INFO: Found listing with ID: EK96047
2026-03-28 09:02:09 [auto1.it] INFO: Found listing with ID: JD15995
2026-03-28 09:02:09 [auto1.it] INFO: Found listing with ID: LW17354
2026-03-28 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW17354%27 HTTP/1.1" 200 None
2026-03-28 09:02:09 [auto1.it] INFO: Scrape type for LW17354: 2
2026-03-28 09:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b851e6-38c5-5a31-b804-080e30042b94 with identifier: LW17354
2026-03-28 09:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b851e6-38c5-5a31-b804-080e30042b94 with scrape type 2
2026-03-28 09:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9b851e6-38c5-5a31-b804-080e30042b94 with scrape type 2
2026-03-28 09:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a9b851e6-38c5-5a31-b804-080e30042b94, identifier: LW17354
2026-03-28 09:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a9b851e6-38c5-5a31-b804-080e30042b94 with identifier: LW17354
2026-03-28 09:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a9b851e6-38c5-5a31-b804-080e30042b94 with identifier: LW17354
2026-03-28 09:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a9b851e6-38c5-5a31-b804-080e30042b94 with identifier: LW17354 to the API
2026-03-28 09:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:53:10Z',
 'fuel_type': 'petrol',
 'id': 'a9b851e6-38c5-5a31-b804-080e30042b94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW17354',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A2',
 'odometer': 171209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-25',
 'seller_name': None,
 'title': 'Audi A2 1.4',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW17354%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Saving data for LW17354: {'auction_closing_time': 1774716790.0, 'created_time': 1773268159.111165, 'last_price_update_time': 1774688530.091416}
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LW17354') HTTP/1.1" 204 0
2026-03-28 09:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: JS97160
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS97160%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Scrape type for JS97160: 0
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: TZ48601
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ48601%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Scrape type for TZ48601: 0
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: AY64399
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: SG52105
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: YV94917
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV94917%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Scrape type for YV94917: 0
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: SD31467
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD31467%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Scrape type for SD31467: 0
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: YH31345
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: AF62726
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: ZD65765
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD65765%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Scrape type for ZD65765: 0
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: CW24266
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: YD38640
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: NF26556
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: VN28128
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN28128%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Scrape type for VN28128: 0
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: PS25996
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS25996%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Scrape type for PS25996: 2
2026-03-28 09:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea0f75e4-4183-50f1-9572-94329008d05e with identifier: PS25996
2026-03-28 09:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea0f75e4-4183-50f1-9572-94329008d05e with scrape type 2
2026-03-28 09:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea0f75e4-4183-50f1-9572-94329008d05e with scrape type 2
2026-03-28 09:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ea0f75e4-4183-50f1-9572-94329008d05e, identifier: PS25996
2026-03-28 09:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ea0f75e4-4183-50f1-9572-94329008d05e with identifier: PS25996
2026-03-28 09:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ea0f75e4-4183-50f1-9572-94329008d05e with identifier: PS25996
2026-03-28 09:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ea0f75e4-4183-50f1-9572-94329008d05e with identifier: PS25996 to the API
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:20:02Z',
 'fuel_type': 'diesel',
 'id': 'ea0f75e4-4183-50f1-9572-94329008d05e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS25996',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 75329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-06',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 180 d Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2020}
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS25996%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Saving data for PS25996: {'auction_closing_time': 1774714802.0, 'created_time': 1774472760.780958, 'last_price_update_time': 1774688530.709515}
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PS25996') HTTP/1.1" 204 0
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: JL83734
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL83734%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Scrape type for JL83734: 0
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: WG31996
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: XZ26785
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ26785%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Scrape type for XZ26785: 0
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: PL66586
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: FD29696
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD29696%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Scrape type for FD29696: 0
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: TH27811
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: HT57713
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT57713%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Scrape type for HT57713: 0
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: KD83488
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD83488%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Scrape type for KD83488: 0
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: DC26275
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC26275%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Scrape type for DC26275: 0
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: VX48328
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX48328%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Scrape type for VX48328: 0
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: HU51198
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: WP70299
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: EA17133
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: AU09842
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: VS08893
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS08893%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Scrape type for VS08893: 0
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: RP80474
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RP80474%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Scrape type for RP80474: 0
2026-03-28 09:02:10 [auto1.it] INFO: Found listing with ID: AM02692
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM02692%27 HTTP/1.1" 200 None
2026-03-28 09:02:10 [auto1.it] INFO: Scrape type for AM02692: 0
2026-03-28 09:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:12 [auto1.it] INFO: Channel: 24h | Page: 26 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: LY27741
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY27741%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for LY27741: 0
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: SE55523
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: TA36833
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: BE49358
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE49358%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for BE49358: 0
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: HY06064
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: EC55479
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC55479%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for EC55479: 0
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: GZ47839
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: MN87452
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: XY19791
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: NB30939
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB30939%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for NB30939: 0
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: TA75240
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: PA17142
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: FL87170
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: FB70845
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: AU70231
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU70231%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for AU70231: 0
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: EZ99260
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: DG86254
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG86254%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for DG86254: 0
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: RG08073
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG08073%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for RG08073: 0
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: KJ53675
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ53675%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for KJ53675: 0
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: SY54017
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY54017%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for SY54017: 0
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: BT65910
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: SS15336
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS15336%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for SS15336: 0
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: GJ83032
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: XJ82802
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ82802%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for XJ82802: 0
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: JK56152
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: NZ90613
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ90613%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for NZ90613: 0
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: JH99386
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH99386%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for JH99386: 2
2026-03-28 09:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6f5c330-69da-566b-9255-e02f2bc90935 with identifier: JH99386
2026-03-28 09:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f5c330-69da-566b-9255-e02f2bc90935 with scrape type 2
2026-03-28 09:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6f5c330-69da-566b-9255-e02f2bc90935 with scrape type 2
2026-03-28 09:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c6f5c330-69da-566b-9255-e02f2bc90935, identifier: JH99386
2026-03-28 09:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c6f5c330-69da-566b-9255-e02f2bc90935 with identifier: JH99386
2026-03-28 09:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c6f5c330-69da-566b-9255-e02f2bc90935 with identifier: JH99386
2026-03-28 09:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c6f5c330-69da-566b-9255-e02f2bc90935 with identifier: JH99386 to the API
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:00:10Z',
 'fuel_type': 'gas',
 'id': 'c6f5c330-69da-566b-9255-e02f2bc90935',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH99386',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 311737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-27',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI EcoFuel Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2011}
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH99386%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Saving data for JH99386: {'auction_closing_time': 1774713610.0, 'created_time': 1773267279.179868, 'last_price_update_time': 1774688532.649042}
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JH99386') HTTP/1.1" 204 0
2026-03-28 09:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: GE08005
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE08005%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for GE08005: 0
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: LT53678
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: FU79114
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU79114%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for FU79114: 0
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: LV68988
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV68988%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for LV68988: 0
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: UN42756
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN42756%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for UN42756: 0
2026-03-28 09:02:12 [auto1.it] INFO: Found listing with ID: SZ24732
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ24732%27 HTTP/1.1" 200 None
2026-03-28 09:02:12 [auto1.it] INFO: Scrape type for SZ24732: 2
2026-03-28 09:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0077fae-884e-54ca-b93b-7dca9b3718ce with identifier: SZ24732
2026-03-28 09:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0077fae-884e-54ca-b93b-7dca9b3718ce with scrape type 2
2026-03-28 09:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0077fae-884e-54ca-b93b-7dca9b3718ce with scrape type 2
2026-03-28 09:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a0077fae-884e-54ca-b93b-7dca9b3718ce, identifier: SZ24732
2026-03-28 09:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a0077fae-884e-54ca-b93b-7dca9b3718ce with identifier: SZ24732
2026-03-28 09:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a0077fae-884e-54ca-b93b-7dca9b3718ce with identifier: SZ24732
2026-03-28 09:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a0077fae-884e-54ca-b93b-7dca9b3718ce with identifier: SZ24732 to the API
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:36:06Z',
 'fuel_type': 'diesel',
 'id': 'a0077fae-884e-54ca-b93b-7dca9b3718ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ24732',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 274597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ24732%27 HTTP/1.1" 200 None
2026-03-28 09:02:13 [auto1.it] INFO: Saving data for SZ24732: {'auction_closing_time': 1774715766.0, 'created_time': 1772785370.310989, 'last_price_update_time': 1774688533.257588}
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SZ24732') HTTP/1.1" 204 0
2026-03-28 09:02:13 [auto1.it] INFO: Found listing with ID: WT09600
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT09600%27 HTTP/1.1" 200 None
2026-03-28 09:02:13 [auto1.it] INFO: Scrape type for WT09600: 0
2026-03-28 09:02:13 [auto1.it] INFO: Found listing with ID: XN00477
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN00477%27 HTTP/1.1" 200 None
2026-03-28 09:02:13 [auto1.it] INFO: Scrape type for XN00477: 0
2026-03-28 09:02:13 [auto1.it] INFO: Found listing with ID: EP46295
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP46295%27 HTTP/1.1" 200 None
2026-03-28 09:02:13 [auto1.it] INFO: Scrape type for EP46295: 2
2026-03-28 09:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cac7adba-830f-5df9-b81d-409941369f80 with identifier: EP46295
2026-03-28 09:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cac7adba-830f-5df9-b81d-409941369f80 with scrape type 2
2026-03-28 09:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cac7adba-830f-5df9-b81d-409941369f80 with scrape type 2
2026-03-28 09:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cac7adba-830f-5df9-b81d-409941369f80, identifier: EP46295
2026-03-28 09:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cac7adba-830f-5df9-b81d-409941369f80 with identifier: EP46295
2026-03-28 09:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cac7adba-830f-5df9-b81d-409941369f80 with identifier: EP46295
2026-03-28 09:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cac7adba-830f-5df9-b81d-409941369f80 with identifier: EP46295 to the API
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:27:47Z',
 'fuel_type': 'diesel',
 'id': 'cac7adba-830f-5df9-b81d-409941369f80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP46295',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 282689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2010}
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP46295%27 HTTP/1.1" 200 None
2026-03-28 09:02:13 [auto1.it] INFO: Saving data for EP46295: {'auction_closing_time': 1774715267.0, 'created_time': 1773231201.665791, 'last_price_update_time': 1774688533.72339}
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EP46295') HTTP/1.1" 204 0
2026-03-28 09:02:13 [auto1.it] INFO: Found listing with ID: WY28975
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY28975%27 HTTP/1.1" 200 None
2026-03-28 09:02:13 [auto1.it] INFO: Scrape type for WY28975: 0
2026-03-28 09:02:13 [auto1.it] INFO: Found listing with ID: FG66384
2026-03-28 09:02:13 [auto1.it] INFO: Found listing with ID: HB99393
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB99393%27 HTTP/1.1" 200 None
2026-03-28 09:02:13 [auto1.it] INFO: Scrape type for HB99393: 2
2026-03-28 09:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec642fae-1429-5d8c-82eb-0d7fe9dc9e82 with identifier: HB99393
2026-03-28 09:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec642fae-1429-5d8c-82eb-0d7fe9dc9e82 with scrape type 2
2026-03-28 09:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec642fae-1429-5d8c-82eb-0d7fe9dc9e82 with scrape type 2
2026-03-28 09:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ec642fae-1429-5d8c-82eb-0d7fe9dc9e82, identifier: HB99393
2026-03-28 09:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ec642fae-1429-5d8c-82eb-0d7fe9dc9e82 with identifier: HB99393
2026-03-28 09:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ec642fae-1429-5d8c-82eb-0d7fe9dc9e82 with identifier: HB99393
2026-03-28 09:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ec642fae-1429-5d8c-82eb-0d7fe9dc9e82 with identifier: HB99393 to the API
2026-03-28 09:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:56:58Z',
 'fuel_type': 'hybrid',
 'id': 'ec642fae-1429-5d8c-82eb-0d7fe9dc9e82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB99393',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 70609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 eHybrid R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-03-28 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB99393%27 HTTP/1.1" 200 None
2026-03-28 09:02:14 [auto1.it] INFO: Saving data for HB99393: {'auction_closing_time': 1774717018.0, 'created_time': 1774001988.609653, 'last_price_update_time': 1774688534.179581}
2026-03-28 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HB99393') HTTP/1.1" 204 0
2026-03-28 09:02:14 [auto1.it] INFO: Found listing with ID: SG75657
2026-03-28 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG75657%27 HTTP/1.1" 200 None
2026-03-28 09:02:14 [auto1.it] INFO: Scrape type for SG75657: 0
2026-03-28 09:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:15 [auto1.it] INFO: Channel: 24h | Page: 27 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:15 [auto1.it] INFO: Found listing with ID: ZM53307
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM53307%27 HTTP/1.1" 200 None
2026-03-28 09:02:15 [auto1.it] INFO: Scrape type for ZM53307: 0
2026-03-28 09:02:15 [auto1.it] INFO: Found listing with ID: CN94330
2026-03-28 09:02:15 [auto1.it] INFO: Found listing with ID: ME96207
2026-03-28 09:02:15 [auto1.it] INFO: Found listing with ID: ET79230
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET79230%27 HTTP/1.1" 200 None
2026-03-28 09:02:15 [auto1.it] INFO: Scrape type for ET79230: 0
2026-03-28 09:02:15 [auto1.it] INFO: Found listing with ID: PL88516
2026-03-28 09:02:15 [auto1.it] INFO: Found listing with ID: AB63446
2026-03-28 09:02:15 [auto1.it] INFO: Found listing with ID: AG45482
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG45482%27 HTTP/1.1" 200 None
2026-03-28 09:02:15 [auto1.it] INFO: Scrape type for AG45482: 2
2026-03-28 09:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5038ebdd-c153-5905-b20f-05100ee7d5b3 with identifier: AG45482
2026-03-28 09:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5038ebdd-c153-5905-b20f-05100ee7d5b3 with scrape type 2
2026-03-28 09:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5038ebdd-c153-5905-b20f-05100ee7d5b3 with scrape type 2
2026-03-28 09:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5038ebdd-c153-5905-b20f-05100ee7d5b3, identifier: AG45482
2026-03-28 09:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5038ebdd-c153-5905-b20f-05100ee7d5b3 with identifier: AG45482
2026-03-28 09:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5038ebdd-c153-5905-b20f-05100ee7d5b3 with identifier: AG45482
2026-03-28 09:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5038ebdd-c153-5905-b20f-05100ee7d5b3 with identifier: AG45482 to the API
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:37:33Z',
 'fuel_type': 'diesel',
 'id': '5038ebdd-c153-5905-b20f-05100ee7d5b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG45482',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 225027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-28',
 'seller_name': None,
 'title': 'Opel Grandland X 1.5 CDTI INNOVATION',
 'transmission': 'automatic',
 'trim': 'INNOVATION',
 'year': 2020}
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG45482%27 HTTP/1.1" 200 None
2026-03-28 09:02:15 [auto1.it] INFO: Saving data for AG45482: {'auction_closing_time': 1774715853.0, 'created_time': 1774472769.140318, 'last_price_update_time': 1774688535.619274}
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AG45482') HTTP/1.1" 204 0
2026-03-28 09:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:15 [auto1.it] INFO: Found listing with ID: UT31107
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT31107%27 HTTP/1.1" 200 None
2026-03-28 09:02:15 [auto1.it] INFO: Scrape type for UT31107: 0
2026-03-28 09:02:15 [auto1.it] INFO: Found listing with ID: BE28605
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE28605%27 HTTP/1.1" 200 None
2026-03-28 09:02:15 [auto1.it] INFO: Scrape type for BE28605: 0
2026-03-28 09:02:15 [auto1.it] INFO: Found listing with ID: KU20000
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU20000%27 HTTP/1.1" 200 None
2026-03-28 09:02:15 [auto1.it] INFO: Scrape type for KU20000: 0
2026-03-28 09:02:15 [auto1.it] INFO: Found listing with ID: BR59197
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR59197%27 HTTP/1.1" 200 None
2026-03-28 09:02:15 [auto1.it] INFO: Scrape type for BR59197: 2
2026-03-28 09:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e42c3ea-c8fb-585e-8d98-a528c7b75ca7 with identifier: BR59197
2026-03-28 09:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e42c3ea-c8fb-585e-8d98-a528c7b75ca7 with scrape type 2
2026-03-28 09:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e42c3ea-c8fb-585e-8d98-a528c7b75ca7 with scrape type 2
2026-03-28 09:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8e42c3ea-c8fb-585e-8d98-a528c7b75ca7, identifier: BR59197
2026-03-28 09:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8e42c3ea-c8fb-585e-8d98-a528c7b75ca7 with identifier: BR59197
2026-03-28 09:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8e42c3ea-c8fb-585e-8d98-a528c7b75ca7 with identifier: BR59197
2026-03-28 09:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8e42c3ea-c8fb-585e-8d98-a528c7b75ca7 with identifier: BR59197 to the API
2026-03-28 09:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:40:46Z',
 'fuel_type': 'petrol',
 'id': '8e42c3ea-c8fb-585e-8d98-a528c7b75ca7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR59197',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 21510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-10',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Advantage 2WD',
 'transmission': 'manual',
 'trim': 'Advantage 2WD',
 'year': 2024}
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR59197%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Saving data for BR59197: {'auction_closing_time': 1774716046.0, 'created_time': 1773129516.552884, 'last_price_update_time': 1774688536.140758}
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BR59197') HTTP/1.1" 204 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: GL68572
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL68572%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for GL68572: 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: AH48855
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH48855%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for AH48855: 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: DD73045
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: US62865
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US62865%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for US62865: 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: VB10041
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: LS85229
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS85229%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for LS85229: 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: GN54162
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN54162%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for GN54162: 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: TM85458
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM85458%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for TM85458: 2
2026-03-28 09:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9882d99a-4877-5705-8f98-31549aa94c6a with identifier: TM85458
2026-03-28 09:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9882d99a-4877-5705-8f98-31549aa94c6a with scrape type 2
2026-03-28 09:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9882d99a-4877-5705-8f98-31549aa94c6a with scrape type 2
2026-03-28 09:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9882d99a-4877-5705-8f98-31549aa94c6a, identifier: TM85458
2026-03-28 09:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9882d99a-4877-5705-8f98-31549aa94c6a with identifier: TM85458
2026-03-28 09:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9882d99a-4877-5705-8f98-31549aa94c6a with identifier: TM85458
2026-03-28 09:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9882d99a-4877-5705-8f98-31549aa94c6a with identifier: TM85458 to the API
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:02:17Z',
 'fuel_type': 'diesel',
 'id': '9882d99a-4877-5705-8f98-31549aa94c6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM85458',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 174616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-06',
 'seller_name': None,
 'title': 'Hyundai ix35 1.7 CRDi Classic 2WD',
 'transmission': 'manual',
 'trim': 'Classic 2WD',
 'year': 2014}
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM85458%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Saving data for TM85458: {'auction_closing_time': 1774713737.0, 'created_time': 1773268458.456832, 'last_price_update_time': 1774688536.75147}
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TM85458') HTTP/1.1" 204 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: UW44918
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW44918%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for UW44918: 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: ZD06174
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: BE09297
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE09297%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for BE09297: 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: ZM37074
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: DZ91111
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: PL95293
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: LC48470
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC48470%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for LC48470: 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: RM58290
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM58290%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for RM58290: 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: CT52714
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT52714%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for CT52714: 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: AM26734
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM26734%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for AM26734: 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: XT06571
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: ZR51869
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: XL05283
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL05283%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for XL05283: 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: RC86938
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC86938%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for RC86938: 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: XB17509
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB17509%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for XB17509: 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: EV67408
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: BX32751
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX32751%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for BX32751: 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: HX97698
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX97698%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for HX97698: 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: LU41088
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: JA23612
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA23612%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for JA23612: 0
2026-03-28 09:02:16 [auto1.it] INFO: Found listing with ID: WV29949
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV29949%27 HTTP/1.1" 200 None
2026-03-28 09:02:16 [auto1.it] INFO: Scrape type for WV29949: 0
2026-03-28 09:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:21 [auto1.it] INFO: Channel: 24h | Page: 28 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: XT85260
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT85260%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for XT85260: 0
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: EA68503
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: TK21590
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK21590%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for TK21590: 0
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: LV91282
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: WC44789
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC44789%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for WC44789: 0
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: NF30981
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: UV29542
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: EE95145
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: BD71903
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD71903%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for BD71903: 0
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: AY66790
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: NF08896
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: SS87934
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: HP55152
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: JV35295
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV35295%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for JV35295: 0
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: ED24082
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: WX67440
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: GR86359
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR86359%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for GR86359: 0
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: DW12727
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW12727%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for DW12727: 0
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: SE81174
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: VZ97279
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ97279%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for VZ97279: 0
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: BN27649
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN27649%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for BN27649: 2
2026-03-28 09:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e9be139-93aa-5bae-be1a-aee6846eb3d7 with identifier: BN27649
2026-03-28 09:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e9be139-93aa-5bae-be1a-aee6846eb3d7 with scrape type 2
2026-03-28 09:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e9be139-93aa-5bae-be1a-aee6846eb3d7 with scrape type 2
2026-03-28 09:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6e9be139-93aa-5bae-be1a-aee6846eb3d7, identifier: BN27649
2026-03-28 09:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6e9be139-93aa-5bae-be1a-aee6846eb3d7 with identifier: BN27649
2026-03-28 09:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6e9be139-93aa-5bae-be1a-aee6846eb3d7 with identifier: BN27649
2026-03-28 09:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6e9be139-93aa-5bae-be1a-aee6846eb3d7 with identifier: BN27649 to the API
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:26:20Z',
 'fuel_type': 'petrol',
 'id': '6e9be139-93aa-5bae-be1a-aee6846eb3d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN27649',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 68649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-29',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2016}
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN27649%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Saving data for BN27649: {'auction_closing_time': 1774715180.0, 'created_time': 1774002223.413005, 'last_price_update_time': 1774688541.692198}
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BN27649') HTTP/1.1" 204 0
2026-03-28 09:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: JR54930
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: RZ16714
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ16714%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for RZ16714: 0
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: WL53251
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL53251%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for WL53251: 0
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: RF41966
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF41966%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for RF41966: 0
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: DV87281
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: LP60965
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: SS74594
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: GA52227
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: SE94922
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE94922%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for SE94922: 0
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: KC15841
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC15841%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for KC15841: 0
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: AL92131
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL92131%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for AL92131: 0
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: SP03533
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP03533%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for SP03533: 0
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: EP94562
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP94562%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for EP94562: 0
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: HP33672
2026-03-28 09:02:21 [auto1.it] INFO: Found listing with ID: PZ35188
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ35188%27 HTTP/1.1" 200 None
2026-03-28 09:02:21 [auto1.it] INFO: Scrape type for PZ35188: 2
2026-03-28 09:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5741bdd1-09d2-5121-954e-a60501ab4d94 with identifier: PZ35188
2026-03-28 09:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5741bdd1-09d2-5121-954e-a60501ab4d94 with scrape type 2
2026-03-28 09:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5741bdd1-09d2-5121-954e-a60501ab4d94 with scrape type 2
2026-03-28 09:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5741bdd1-09d2-5121-954e-a60501ab4d94, identifier: PZ35188
2026-03-28 09:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5741bdd1-09d2-5121-954e-a60501ab4d94 with identifier: PZ35188
2026-03-28 09:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5741bdd1-09d2-5121-954e-a60501ab4d94 with identifier: PZ35188
2026-03-28 09:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5741bdd1-09d2-5121-954e-a60501ab4d94 with identifier: PZ35188 to the API
2026-03-28 09:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:19:59Z',
 'fuel_type': 'diesel',
 'id': '5741bdd1-09d2-5121-954e-a60501ab4d94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ35188',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 110678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-23',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI AMG Sport',
 'transmission': 'manual',
 'trim': 'AMG Sport',
 'year': 2017}
2026-03-28 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ35188%27 HTTP/1.1" 200 None
2026-03-28 09:02:22 [auto1.it] INFO: Saving data for PZ35188: {'auction_closing_time': 1774714799.0, 'created_time': 1773241583.013136, 'last_price_update_time': 1774688542.364936}
2026-03-28 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ35188') HTTP/1.1" 204 0
2026-03-28 09:02:22 [auto1.it] INFO: Found listing with ID: XK43361
2026-03-28 09:02:22 [auto1.it] INFO: Found listing with ID: AF46529
2026-03-28 09:02:22 [auto1.it] INFO: Found listing with ID: DR37659
2026-03-28 09:02:22 [auto1.it] INFO: Found listing with ID: RA62003
2026-03-28 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA62003%27 HTTP/1.1" 200 None
2026-03-28 09:02:22 [auto1.it] INFO: Scrape type for RA62003: 0
2026-03-28 09:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:23 [auto1.it] INFO: Channel: 24h | Page: 29 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: PX04626
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: JJ49663
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ49663%27 HTTP/1.1" 200 None
2026-03-28 09:02:23 [auto1.it] INFO: Scrape type for JJ49663: 0
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: NC94766
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: TM14031
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM14031%27 HTTP/1.1" 200 None
2026-03-28 09:02:23 [auto1.it] INFO: Scrape type for TM14031: 0
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: TG82781
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG82781%27 HTTP/1.1" 200 None
2026-03-28 09:02:23 [auto1.it] INFO: Scrape type for TG82781: 0
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: ES51073
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: FT97220
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT97220%27 HTTP/1.1" 200 None
2026-03-28 09:02:23 [auto1.it] INFO: Scrape type for FT97220: 0
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: WU99232
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: SA50428
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: JJ80566
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: WH82404
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH82404%27 HTTP/1.1" 200 None
2026-03-28 09:02:23 [auto1.it] INFO: Scrape type for WH82404: 0
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: KC02263
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC02263%27 HTTP/1.1" 200 None
2026-03-28 09:02:23 [auto1.it] INFO: Scrape type for KC02263: 0
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: WX97705
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: GH19384
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: NR23984
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: CJ26443
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: EC13131
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: GU38190
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU38190%27 HTTP/1.1" 200 None
2026-03-28 09:02:23 [auto1.it] INFO: Scrape type for GU38190: 0
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: YH62584
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: SN06060
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: ZJ24732
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ24732%27 HTTP/1.1" 200 None
2026-03-28 09:02:23 [auto1.it] INFO: Scrape type for ZJ24732: 0
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: GR20661
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: YK56738
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: GW87429
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW87429%27 HTTP/1.1" 200 None
2026-03-28 09:02:23 [auto1.it] INFO: Scrape type for GW87429: 0
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: BH09542
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: NM70552
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM70552%27 HTTP/1.1" 200 None
2026-03-28 09:02:23 [auto1.it] INFO: Scrape type for NM70552: 0
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: HH07211
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH07211%27 HTTP/1.1" 200 None
2026-03-28 09:02:23 [auto1.it] INFO: Scrape type for HH07211: 0
2026-03-28 09:02:23 [auto1.it] INFO: Found listing with ID: SY55940
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY55940%27 HTTP/1.1" 200 None
2026-03-28 09:02:23 [auto1.it] INFO: Scrape type for SY55940: 2
2026-03-28 09:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dda7e232-c7b0-5239-b0d9-af5bb61077df with identifier: SY55940
2026-03-28 09:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dda7e232-c7b0-5239-b0d9-af5bb61077df with scrape type 2
2026-03-28 09:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dda7e232-c7b0-5239-b0d9-af5bb61077df with scrape type 2
2026-03-28 09:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dda7e232-c7b0-5239-b0d9-af5bb61077df, identifier: SY55940
2026-03-28 09:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dda7e232-c7b0-5239-b0d9-af5bb61077df with identifier: SY55940
2026-03-28 09:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dda7e232-c7b0-5239-b0d9-af5bb61077df with identifier: SY55940
2026-03-28 09:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dda7e232-c7b0-5239-b0d9-af5bb61077df with identifier: SY55940 to the API
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-28T16:59:11Z',
 'fuel_type': 'petrol',
 'id': 'dda7e232-c7b0-5239-b0d9-af5bb61077df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY55940',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 22254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-17',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Top',
 'transmission': 'manual',
 'trim': 'Top',
 'year': 2024}
2026-03-28 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY55940%27 HTTP/1.1" 200 None
2026-03-28 09:02:24 [auto1.it] INFO: Saving data for SY55940: {'auction_closing_time': 1774717151.0, 'created_time': 1773267526.33167, 'last_price_update_time': 1774688544.041856}
2026-03-28 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SY55940') HTTP/1.1" 204 0
2026-03-28 09:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:24 [auto1.it] INFO: Found listing with ID: HU85714
2026-03-28 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU85714%27 HTTP/1.1" 200 None
2026-03-28 09:02:24 [auto1.it] INFO: Scrape type for HU85714: 0
2026-03-28 09:02:24 [auto1.it] INFO: Found listing with ID: SN24706
2026-03-28 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN24706%27 HTTP/1.1" 200 None
2026-03-28 09:02:24 [auto1.it] INFO: Scrape type for SN24706: 0
2026-03-28 09:02:24 [auto1.it] INFO: Found listing with ID: ZP79936
2026-03-28 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP79936%27 HTTP/1.1" 200 None
2026-03-28 09:02:24 [auto1.it] INFO: Scrape type for ZP79936: 0
2026-03-28 09:02:24 [auto1.it] INFO: Found listing with ID: NL88933
2026-03-28 09:02:24 [auto1.it] INFO: Found listing with ID: HD78178
2026-03-28 09:02:24 [auto1.it] INFO: Found listing with ID: DE32338
2026-03-28 09:02:24 [auto1.it] INFO: Found listing with ID: AK32072
2026-03-28 09:02:24 [auto1.it] INFO: Found listing with ID: AB09853
2026-03-28 09:02:24 [auto1.it] INFO: Found listing with ID: PS40086
2026-03-28 09:02:24 [auto1.it] INFO: Found listing with ID: XJ23148
2026-03-28 09:02:24 [auto1.it] INFO: Found listing with ID: FX22483
2026-03-28 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX22483%27 HTTP/1.1" 200 None
2026-03-28 09:02:24 [auto1.it] INFO: Scrape type for FX22483: 0
2026-03-28 09:02:24 [auto1.it] INFO: Found listing with ID: BY60716
2026-03-28 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY60716%27 HTTP/1.1" 200 None
2026-03-28 09:02:24 [auto1.it] INFO: Scrape type for BY60716: 0
2026-03-28 09:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:25 [auto1.it] INFO: Channel: 24h | Page: 30 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: JR58034
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: AE43427
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE43427%27 HTTP/1.1" 200 None
2026-03-28 09:02:25 [auto1.it] INFO: Scrape type for AE43427: 0
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: RU31162
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: VS39586
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: EA47428
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA47428%27 HTTP/1.1" 200 None
2026-03-28 09:02:25 [auto1.it] INFO: Scrape type for EA47428: 0
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: WB86834
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: NL88332
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL88332%27 HTTP/1.1" 200 None
2026-03-28 09:02:25 [auto1.it] INFO: Scrape type for NL88332: 0
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: EW60341
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: HG53110
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG53110%27 HTTP/1.1" 200 None
2026-03-28 09:02:25 [auto1.it] INFO: Scrape type for HG53110: 0
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: XD73151
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: PE73293
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE73293%27 HTTP/1.1" 200 None
2026-03-28 09:02:25 [auto1.it] INFO: Scrape type for PE73293: 0
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: AN97971
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN97971%27 HTTP/1.1" 200 None
2026-03-28 09:02:25 [auto1.it] INFO: Scrape type for AN97971: 0
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: RN28798
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: XR36551
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR36551%27 HTTP/1.1" 200 None
2026-03-28 09:02:25 [auto1.it] INFO: Scrape type for XR36551: 0
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: ZX52658
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: GT17675
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: DN72005
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: UJ09788
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ09788%27 HTTP/1.1" 200 None
2026-03-28 09:02:25 [auto1.it] INFO: Scrape type for UJ09788: 0
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: RF11851
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: MG39360
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: UR73173
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: SY30215
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: XR70694
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR70694%27 HTTP/1.1" 200 None
2026-03-28 09:02:25 [auto1.it] INFO: Scrape type for XR70694: 0
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: YM70173
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM70173%27 HTTP/1.1" 200 None
2026-03-28 09:02:25 [auto1.it] INFO: Scrape type for YM70173: 0
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: VE91156
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE91156%27 HTTP/1.1" 200 None
2026-03-28 09:02:25 [auto1.it] INFO: Scrape type for VE91156: 0
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: GS51961
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS51961%27 HTTP/1.1" 200 None
2026-03-28 09:02:25 [auto1.it] INFO: Scrape type for GS51961: 0
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: JP32854
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: BR14904
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: DN82434
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: LH79871
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH79871%27 HTTP/1.1" 200 None
2026-03-28 09:02:25 [auto1.it] INFO: Scrape type for LH79871: 0
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: AA53692
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: XU52863
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU52863%27 HTTP/1.1" 200 None
2026-03-28 09:02:25 [auto1.it] INFO: Scrape type for XU52863: 0
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: XE42433
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: GZ15334
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: WJ00117
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ00117%27 HTTP/1.1" 200 None
2026-03-28 09:02:25 [auto1.it] INFO: Scrape type for WJ00117: 0
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: GM47184
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: KY15246
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: FX38353
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX38353%27 HTTP/1.1" 200 None
2026-03-28 09:02:25 [auto1.it] INFO: Scrape type for FX38353: 0
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: JM07675
2026-03-28 09:02:25 [auto1.it] INFO: Found listing with ID: NF63759
2026-03-28 09:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:27 [auto1.it] INFO: Channel: 24h | Page: 31 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: BF97905
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: YW01927
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW01927%27 HTTP/1.1" 200 None
2026-03-28 09:02:27 [auto1.it] INFO: Scrape type for YW01927: 0
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: RV18634
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV18634%27 HTTP/1.1" 200 None
2026-03-28 09:02:27 [auto1.it] INFO: Scrape type for RV18634: 0
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: RP22465
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RP22465%27 HTTP/1.1" 200 None
2026-03-28 09:02:27 [auto1.it] INFO: Scrape type for RP22465: 0
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: MD04022
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: RL85068
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: UN95232
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: GM12910
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: UM01016
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: AK10390
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK10390%27 HTTP/1.1" 200 None
2026-03-28 09:02:27 [auto1.it] INFO: Scrape type for AK10390: 0
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: FU92743
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: VM43481
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM43481%27 HTTP/1.1" 200 None
2026-03-28 09:02:27 [auto1.it] INFO: Scrape type for VM43481: 0
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: NY79703
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: ZR63557
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR63557%27 HTTP/1.1" 200 None
2026-03-28 09:02:27 [auto1.it] INFO: Scrape type for ZR63557: 0
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: YN42952
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: PD49568
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: WM56040
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: TW09366
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: PJ86967
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: LC98621
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: WT33776
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: CZ68446
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: BK05178
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: GA57810
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA57810%27 HTTP/1.1" 200 None
2026-03-28 09:02:27 [auto1.it] INFO: Scrape type for GA57810: 0
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: JV05733
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: MZ19905
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ19905%27 HTTP/1.1" 200 None
2026-03-28 09:02:27 [auto1.it] INFO: Scrape type for MZ19905: 0
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: NX71377
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX71377%27 HTTP/1.1" 200 None
2026-03-28 09:02:27 [auto1.it] INFO: Scrape type for NX71377: 0
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: EG69855
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: MB21840
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB21840%27 HTTP/1.1" 200 None
2026-03-28 09:02:27 [auto1.it] INFO: Scrape type for MB21840: 0
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: KF04407
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: NB08226
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: WJ13439
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ13439%27 HTTP/1.1" 200 None
2026-03-28 09:02:27 [auto1.it] INFO: Scrape type for WJ13439: 0
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: VF45343
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF45343%27 HTTP/1.1" 200 None
2026-03-28 09:02:27 [auto1.it] INFO: Scrape type for VF45343: 0
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: VD09142
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VD09142%27 HTTP/1.1" 200 None
2026-03-28 09:02:27 [auto1.it] INFO: Scrape type for VD09142: 0
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: GG79286
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: LE05558
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: DJ62312
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: AG53064
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG53064%27 HTTP/1.1" 200 None
2026-03-28 09:02:27 [auto1.it] INFO: Scrape type for AG53064: 0
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: DH05313
2026-03-28 09:02:27 [auto1.it] INFO: Found listing with ID: VC28315
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC28315%27 HTTP/1.1" 200 None
2026-03-28 09:02:27 [auto1.it] INFO: Scrape type for VC28315: 0
2026-03-28 09:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:28 [auto1.it] INFO: Channel: 24h | Page: 32 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:28 [auto1.it] INFO: Found listing with ID: NC89315
2026-03-28 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC89315%27 HTTP/1.1" 200 None
2026-03-28 09:02:28 [auto1.it] INFO: Scrape type for NC89315: 0
2026-03-28 09:02:28 [auto1.it] INFO: Found listing with ID: NU69507
2026-03-28 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU69507%27 HTTP/1.1" 200 None
2026-03-28 09:02:28 [auto1.it] INFO: Scrape type for NU69507: 0
2026-03-28 09:02:28 [auto1.it] INFO: Found listing with ID: AE94250
2026-03-28 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE94250%27 HTTP/1.1" 200 None
2026-03-28 09:02:28 [auto1.it] INFO: Scrape type for AE94250: 0
2026-03-28 09:02:28 [auto1.it] INFO: Found listing with ID: ZR59714
2026-03-28 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR59714%27 HTTP/1.1" 200 None
2026-03-28 09:02:28 [auto1.it] INFO: Scrape type for ZR59714: 0
2026-03-28 09:02:28 [auto1.it] INFO: Found listing with ID: WH67048
2026-03-28 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH67048%27 HTTP/1.1" 200 None
2026-03-28 09:02:28 [auto1.it] INFO: Scrape type for WH67048: 2
2026-03-28 09:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 963f8115-e378-59b4-a23c-490cd7f2e266 with identifier: WH67048
2026-03-28 09:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 963f8115-e378-59b4-a23c-490cd7f2e266 with scrape type 2
2026-03-28 09:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 963f8115-e378-59b4-a23c-490cd7f2e266 with scrape type 2
2026-03-28 09:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 963f8115-e378-59b4-a23c-490cd7f2e266, identifier: WH67048
2026-03-28 09:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 963f8115-e378-59b4-a23c-490cd7f2e266 with identifier: WH67048
2026-03-28 09:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 963f8115-e378-59b4-a23c-490cd7f2e266 with identifier: WH67048
2026-03-28 09:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 963f8115-e378-59b4-a23c-490cd7f2e266 with identifier: WH67048 to the API
2026-03-28 09:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 151,
 'expiration_date': '2026-03-28T16:28:58Z',
 'fuel_type': 'petrol',
 'id': '963f8115-e378-59b4-a23c-490cd7f2e266',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH67048',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 26337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-31',
 'seller_name': None,
 'title': 'Fiat 500X 1.3 Turbo Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2020}
2026-03-28 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH67048%27 HTTP/1.1" 200 None
2026-03-28 09:02:28 [auto1.it] INFO: Saving data for WH67048: {'auction_closing_time': 1774715338.0, 'created_time': 1773694848.545949, 'last_price_update_time': 1774688548.983221}
2026-03-28 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WH67048') HTTP/1.1" 204 0
2026-03-28 09:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:29 [auto1.it] INFO: Found listing with ID: JH32473
2026-03-28 09:02:29 [auto1.it] INFO: Found listing with ID: CV59380
2026-03-28 09:02:29 [auto1.it] INFO: Found listing with ID: RK20934
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK20934%27 HTTP/1.1" 200 None
2026-03-28 09:02:29 [auto1.it] INFO: Scrape type for RK20934: 0
2026-03-28 09:02:29 [auto1.it] INFO: Found listing with ID: NC77921
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC77921%27 HTTP/1.1" 200 None
2026-03-28 09:02:29 [auto1.it] INFO: Scrape type for NC77921: 0
2026-03-28 09:02:29 [auto1.it] INFO: Found listing with ID: YE04007
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE04007%27 HTTP/1.1" 200 None
2026-03-28 09:02:29 [auto1.it] INFO: Scrape type for YE04007: 0
2026-03-28 09:02:29 [auto1.it] INFO: Found listing with ID: NT79390
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT79390%27 HTTP/1.1" 200 None
2026-03-28 09:02:29 [auto1.it] INFO: Scrape type for NT79390: 2
2026-03-28 09:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35c8fb0c-996d-5bb8-a05e-2166efd2bd8e with identifier: NT79390
2026-03-28 09:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35c8fb0c-996d-5bb8-a05e-2166efd2bd8e with scrape type 2
2026-03-28 09:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35c8fb0c-996d-5bb8-a05e-2166efd2bd8e with scrape type 2
2026-03-28 09:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 35c8fb0c-996d-5bb8-a05e-2166efd2bd8e, identifier: NT79390
2026-03-28 09:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 35c8fb0c-996d-5bb8-a05e-2166efd2bd8e with identifier: NT79390
2026-03-28 09:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 35c8fb0c-996d-5bb8-a05e-2166efd2bd8e with identifier: NT79390
2026-03-28 09:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 35c8fb0c-996d-5bb8-a05e-2166efd2bd8e with identifier: NT79390 to the API
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-28T16:56:30Z',
 'fuel_type': 'diesel',
 'id': '35c8fb0c-996d-5bb8-a05e-2166efd2bd8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT79390',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 367522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-27',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT79390%27 HTTP/1.1" 200 None
2026-03-28 09:02:29 [auto1.it] INFO: Saving data for NT79390: {'auction_closing_time': 1774716990.0, 'created_time': 1773268649.157091, 'last_price_update_time': 1774688549.531991}
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NT79390') HTTP/1.1" 204 0
2026-03-28 09:02:29 [auto1.it] INFO: Found listing with ID: FP22884
2026-03-28 09:02:29 [auto1.it] INFO: Found listing with ID: ZV86353
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV86353%27 HTTP/1.1" 200 None
2026-03-28 09:02:29 [auto1.it] INFO: Scrape type for ZV86353: 0
2026-03-28 09:02:29 [auto1.it] INFO: Found listing with ID: LW86273
2026-03-28 09:02:29 [auto1.it] INFO: Found listing with ID: FG09627
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG09627%27 HTTP/1.1" 200 None
2026-03-28 09:02:29 [auto1.it] INFO: Scrape type for FG09627: 0
2026-03-28 09:02:29 [auto1.it] INFO: Found listing with ID: BG42211
2026-03-28 09:02:29 [auto1.it] INFO: Found listing with ID: XB60526
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB60526%27 HTTP/1.1" 200 None
2026-03-28 09:02:29 [auto1.it] INFO: Scrape type for XB60526: 0
2026-03-28 09:02:29 [auto1.it] INFO: Found listing with ID: JS97263
2026-03-28 09:02:29 [auto1.it] INFO: Found listing with ID: FX24983
2026-03-28 09:02:29 [auto1.it] INFO: Found listing with ID: VU11306
2026-03-28 09:02:29 [auto1.it] INFO: Found listing with ID: WH96118
2026-03-28 09:02:29 [auto1.it] INFO: Found listing with ID: DB15291
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB15291%27 HTTP/1.1" 200 None
2026-03-28 09:02:29 [auto1.it] INFO: Scrape type for DB15291: 2
2026-03-28 09:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b0aec10-68f7-57ec-aec5-5380b9ab10ef with identifier: DB15291
2026-03-28 09:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b0aec10-68f7-57ec-aec5-5380b9ab10ef with scrape type 2
2026-03-28 09:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b0aec10-68f7-57ec-aec5-5380b9ab10ef with scrape type 2
2026-03-28 09:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4b0aec10-68f7-57ec-aec5-5380b9ab10ef, identifier: DB15291
2026-03-28 09:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4b0aec10-68f7-57ec-aec5-5380b9ab10ef with identifier: DB15291
2026-03-28 09:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4b0aec10-68f7-57ec-aec5-5380b9ab10ef with identifier: DB15291
2026-03-28 09:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4b0aec10-68f7-57ec-aec5-5380b9ab10ef with identifier: DB15291 to the API
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:47:50Z',
 'fuel_type': 'petrol',
 'id': '4b0aec10-68f7-57ec-aec5-5380b9ab10ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB15291',
 'listing': 'auction',
 'make': 'Daihatsu',
 'model': 'Terios',
 'odometer': 168909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-16',
 'seller_name': None,
 'title': 'Daihatsu Terios 1.5 Top S 4WD',
 'transmission': 'manual',
 'trim': 'Top S 4WD',
 'year': 2008}
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB15291%27 HTTP/1.1" 200 None
2026-03-28 09:02:30 [auto1.it] INFO: Saving data for DB15291: {'auction_closing_time': 1774716470.0, 'created_time': 1773269915.680769, 'last_price_update_time': 1774688550.037404}
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DB15291') HTTP/1.1" 204 0
2026-03-28 09:02:30 [auto1.it] INFO: Found listing with ID: CG32909
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG32909%27 HTTP/1.1" 200 None
2026-03-28 09:02:30 [auto1.it] INFO: Scrape type for CG32909: 0
2026-03-28 09:02:30 [auto1.it] INFO: Found listing with ID: FE11339
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE11339%27 HTTP/1.1" 200 None
2026-03-28 09:02:30 [auto1.it] INFO: Scrape type for FE11339: 0
2026-03-28 09:02:30 [auto1.it] INFO: Found listing with ID: KY33943
2026-03-28 09:02:30 [auto1.it] INFO: Found listing with ID: RY92911
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY92911%27 HTTP/1.1" 200 None
2026-03-28 09:02:30 [auto1.it] INFO: Scrape type for RY92911: 0
2026-03-28 09:02:30 [auto1.it] INFO: Found listing with ID: CR43850
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR43850%27 HTTP/1.1" 200 None
2026-03-28 09:02:30 [auto1.it] INFO: Scrape type for CR43850: 0
2026-03-28 09:02:30 [auto1.it] INFO: Found listing with ID: YM64414
2026-03-28 09:02:30 [auto1.it] INFO: Found listing with ID: VW82283
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW82283%27 HTTP/1.1" 200 None
2026-03-28 09:02:30 [auto1.it] INFO: Scrape type for VW82283: 0
2026-03-28 09:02:30 [auto1.it] INFO: Found listing with ID: LN22753
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN22753%27 HTTP/1.1" 200 None
2026-03-28 09:02:30 [auto1.it] INFO: Scrape type for LN22753: 2
2026-03-28 09:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44163482-656d-56a9-9a8f-71cf70cc1c37 with identifier: LN22753
2026-03-28 09:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44163482-656d-56a9-9a8f-71cf70cc1c37 with scrape type 2
2026-03-28 09:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44163482-656d-56a9-9a8f-71cf70cc1c37 with scrape type 2
2026-03-28 09:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 44163482-656d-56a9-9a8f-71cf70cc1c37, identifier: LN22753
2026-03-28 09:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 44163482-656d-56a9-9a8f-71cf70cc1c37 with identifier: LN22753
2026-03-28 09:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 44163482-656d-56a9-9a8f-71cf70cc1c37 with identifier: LN22753
2026-03-28 09:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 44163482-656d-56a9-9a8f-71cf70cc1c37 with identifier: LN22753 to the API
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:23:04Z',
 'fuel_type': 'diesel',
 'id': '44163482-656d-56a9-9a8f-71cf70cc1c37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN22753',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 114802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN22753%27 HTTP/1.1" 200 None
2026-03-28 09:02:30 [auto1.it] INFO: Saving data for LN22753: {'auction_closing_time': 1774714984.0, 'created_time': 1773267313.704829, 'last_price_update_time': 1774688550.63849}
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LN22753') HTTP/1.1" 204 0
2026-03-28 09:02:30 [auto1.it] INFO: Found listing with ID: MH41109
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH41109%27 HTTP/1.1" 200 None
2026-03-28 09:02:30 [auto1.it] INFO: Scrape type for MH41109: 2
2026-03-28 09:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 843e4224-204b-5a64-88da-a6d6cafe05cb with identifier: MH41109
2026-03-28 09:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 843e4224-204b-5a64-88da-a6d6cafe05cb with scrape type 2
2026-03-28 09:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 843e4224-204b-5a64-88da-a6d6cafe05cb with scrape type 2
2026-03-28 09:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 843e4224-204b-5a64-88da-a6d6cafe05cb, identifier: MH41109
2026-03-28 09:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 843e4224-204b-5a64-88da-a6d6cafe05cb with identifier: MH41109
2026-03-28 09:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 843e4224-204b-5a64-88da-a6d6cafe05cb with identifier: MH41109
2026-03-28 09:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 843e4224-204b-5a64-88da-a6d6cafe05cb with identifier: MH41109 to the API
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:10:48Z',
 'fuel_type': 'petrol',
 'id': '843e4224-204b-5a64-88da-a6d6cafe05cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH41109',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 36505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-22',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet ICool',
 'transmission': 'manual',
 'trim': 'ICool',
 'year': 2019}
2026-03-28 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH41109%27 HTTP/1.1" 200 None
2026-03-28 09:02:31 [auto1.it] INFO: Saving data for MH41109: {'auction_closing_time': 1774714248.0, 'created_time': 1773231946.159142, 'last_price_update_time': 1774688551.40692}
2026-03-28 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MH41109') HTTP/1.1" 204 0
2026-03-28 09:02:31 [auto1.it] INFO: Found listing with ID: VH13695
2026-03-28 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH13695%27 HTTP/1.1" 200 None
2026-03-28 09:02:31 [auto1.it] INFO: Scrape type for VH13695: 2
2026-03-28 09:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e76d5f3-29f3-508a-8aec-608b44930477 with identifier: VH13695
2026-03-28 09:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e76d5f3-29f3-508a-8aec-608b44930477 with scrape type 2
2026-03-28 09:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e76d5f3-29f3-508a-8aec-608b44930477 with scrape type 2
2026-03-28 09:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7e76d5f3-29f3-508a-8aec-608b44930477, identifier: VH13695
2026-03-28 09:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7e76d5f3-29f3-508a-8aec-608b44930477 with identifier: VH13695
2026-03-28 09:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7e76d5f3-29f3-508a-8aec-608b44930477 with identifier: VH13695
2026-03-28 09:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7e76d5f3-29f3-508a-8aec-608b44930477 with identifier: VH13695 to the API
2026-03-28 09:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:10:37Z',
 'fuel_type': 'diesel',
 'id': '7e76d5f3-29f3-508a-8aec-608b44930477',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH13695',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 245592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-20',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2011}
2026-03-28 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH13695%27 HTTP/1.1" 200 None
2026-03-28 09:02:31 [auto1.it] INFO: Saving data for VH13695: {'auction_closing_time': 1774714237.0, 'created_time': 1773674171.750367, 'last_price_update_time': 1774688551.807212}
2026-03-28 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VH13695') HTTP/1.1" 204 0
2026-03-28 09:02:31 [auto1.it] INFO: Found listing with ID: UJ01358
2026-03-28 09:02:31 [auto1.it] INFO: Found listing with ID: NT98508
2026-03-28 09:02:31 [auto1.it] INFO: Found listing with ID: CW72749
2026-03-28 09:02:31 [auto1.it] INFO: Found listing with ID: SP39094
2026-03-28 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP39094%27 HTTP/1.1" 200 None
2026-03-28 09:02:31 [auto1.it] INFO: Scrape type for SP39094: 0
2026-03-28 09:02:31 [auto1.it] INFO: Found listing with ID: TZ83605
2026-03-28 09:02:31 [auto1.it] INFO: Found listing with ID: NJ78354
2026-03-28 09:02:31 [auto1.it] INFO: Found listing with ID: KU06425
2026-03-28 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU06425%27 HTTP/1.1" 200 None
2026-03-28 09:02:31 [auto1.it] INFO: Scrape type for KU06425: 0
2026-03-28 09:02:31 [auto1.it] INFO: Found listing with ID: VC06734
2026-03-28 09:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:32 [auto1.it] INFO: Channel: 24h | Page: 33 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: NF56876
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: PK52051
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: JM74615
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: TD16332
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD16332%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for TD16332: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: RF01908
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: YW19585
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: YD46190
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: XD91118
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD91118%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for XD91118: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: PW09444
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: WE18403
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: GY98380
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY98380%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for GY98380: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: BK23225
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK23225%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for BK23225: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: FS99230
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: GU51710
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU51710%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for GU51710: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: LC66242
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC66242%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for LC66242: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: CK40026
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK40026%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for CK40026: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: NH64941
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH64941%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for NH64941: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: ZW62743
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW62743%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for ZW62743: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: GF15997
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: TX43497
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX43497%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for TX43497: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: LF46608
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: EW58174
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW58174%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for EW58174: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: BJ54442
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ54442%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for BJ54442: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: WG71830
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG71830%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for WG71830: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: BN39787
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: CU47897
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: PC45346
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC45346%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for PC45346: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: PP79756
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: ET18212
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET18212%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for ET18212: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: UB44414
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB44414%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for UB44414: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: KA06591
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA06591%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for KA06591: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: CY67116
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: GN28871
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN28871%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for GN28871: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: GA27692
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA27692%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for GA27692: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: DR95248
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR95248%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for DR95248: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: BC82783
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: NR20429
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: WK48161
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK48161%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for WK48161: 0
2026-03-28 09:02:32 [auto1.it] INFO: Found listing with ID: NV90062
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV90062%27 HTTP/1.1" 200 None
2026-03-28 09:02:32 [auto1.it] INFO: Scrape type for NV90062: 2
2026-03-28 09:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea4c2311-a1ad-5a56-a277-533302f45038 with identifier: NV90062
2026-03-28 09:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea4c2311-a1ad-5a56-a277-533302f45038 with scrape type 2
2026-03-28 09:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea4c2311-a1ad-5a56-a277-533302f45038 with scrape type 2
2026-03-28 09:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ea4c2311-a1ad-5a56-a277-533302f45038, identifier: NV90062
2026-03-28 09:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ea4c2311-a1ad-5a56-a277-533302f45038 with identifier: NV90062
2026-03-28 09:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ea4c2311-a1ad-5a56-a277-533302f45038 with identifier: NV90062
2026-03-28 09:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ea4c2311-a1ad-5a56-a277-533302f45038 with identifier: NV90062 to the API
2026-03-28 09:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:52:07Z',
 'fuel_type': 'petrol',
 'id': 'ea4c2311-a1ad-5a56-a277-533302f45038',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV90062',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 126729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-27',
 'seller_name': None,
 'title': 'Renault Megane 1.3 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2019}
2026-03-28 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV90062%27 HTTP/1.1" 200 None
2026-03-28 09:02:33 [auto1.it] INFO: Saving data for NV90062: {'auction_closing_time': 1774716727.0, 'created_time': 1774472619.668748, 'last_price_update_time': 1774688553.384944}
2026-03-28 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NV90062') HTTP/1.1" 204 0
2026-03-28 09:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:33 [auto1.it] INFO: Found listing with ID: EE16681
2026-03-28 09:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:34 [auto1.it] INFO: Channel: 24h | Page: 34 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: FR49245
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR49245%27 HTTP/1.1" 200 None
2026-03-28 09:02:34 [auto1.it] INFO: Scrape type for FR49245: 0
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: RY75551
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: ZR71790
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: KF98112
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: XK39914
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: KA09698
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA09698%27 HTTP/1.1" 200 None
2026-03-28 09:02:34 [auto1.it] INFO: Scrape type for KA09698: 0
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: UD95493
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: UB69293
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB69293%27 HTTP/1.1" 200 None
2026-03-28 09:02:34 [auto1.it] INFO: Scrape type for UB69293: 0
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: DW64097
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: AR58542
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR58542%27 HTTP/1.1" 200 None
2026-03-28 09:02:34 [auto1.it] INFO: Scrape type for AR58542: 0
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: AP13803
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP13803%27 HTTP/1.1" 200 None
2026-03-28 09:02:34 [auto1.it] INFO: Scrape type for AP13803: 0
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: BA49572
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: AH31892
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH31892%27 HTTP/1.1" 200 None
2026-03-28 09:02:34 [auto1.it] INFO: Scrape type for AH31892: 0
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: JZ33949
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: HG28302
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG28302%27 HTTP/1.1" 200 None
2026-03-28 09:02:34 [auto1.it] INFO: Scrape type for HG28302: 0
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: MZ33664
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: DH47051
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: SV45287
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: YR08736
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR08736%27 HTTP/1.1" 200 None
2026-03-28 09:02:34 [auto1.it] INFO: Scrape type for YR08736: 0
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: JM31879
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: BB73520
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB73520%27 HTTP/1.1" 200 None
2026-03-28 09:02:34 [auto1.it] INFO: Scrape type for BB73520: 0
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: BX36809
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX36809%27 HTTP/1.1" 200 None
2026-03-28 09:02:34 [auto1.it] INFO: Scrape type for BX36809: 0
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: MD72836
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: CU10476
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU10476%27 HTTP/1.1" 200 None
2026-03-28 09:02:34 [auto1.it] INFO: Scrape type for CU10476: 0
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: SJ04841
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ04841%27 HTTP/1.1" 200 None
2026-03-28 09:02:34 [auto1.it] INFO: Scrape type for SJ04841: 0
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: VV36209
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: FL80694
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL80694%27 HTTP/1.1" 200 None
2026-03-28 09:02:34 [auto1.it] INFO: Scrape type for FL80694: 0
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: EM88233
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: FF42282
2026-03-28 09:02:34 [auto1.it] INFO: Found listing with ID: UH38063
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH38063%27 HTTP/1.1" 200 None
2026-03-28 09:02:34 [auto1.it] INFO: Scrape type for UH38063: 2
2026-03-28 09:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b859549d-3d52-54a9-bd81-e8a40dbadd8c with identifier: UH38063
2026-03-28 09:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b859549d-3d52-54a9-bd81-e8a40dbadd8c with scrape type 2
2026-03-28 09:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b859549d-3d52-54a9-bd81-e8a40dbadd8c with scrape type 2
2026-03-28 09:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b859549d-3d52-54a9-bd81-e8a40dbadd8c, identifier: UH38063
2026-03-28 09:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b859549d-3d52-54a9-bd81-e8a40dbadd8c with identifier: UH38063
2026-03-28 09:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b859549d-3d52-54a9-bd81-e8a40dbadd8c with identifier: UH38063
2026-03-28 09:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b859549d-3d52-54a9-bd81-e8a40dbadd8c with identifier: UH38063 to the API
2026-03-28 09:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:20:11Z',
 'fuel_type': 'diesel',
 'id': 'b859549d-3d52-54a9-bd81-e8a40dbadd8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH38063',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 52210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-29',
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 1.5 CDTI Business Elegance',
 'transmission': 'automatic',
 'trim': 'Business Elegance',
 'year': 2020}
2026-03-28 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH38063%27 HTTP/1.1" 200 None
2026-03-28 09:02:35 [auto1.it] INFO: Saving data for UH38063: {'auction_closing_time': 1774714811.0, 'created_time': 1774472700.590744, 'last_price_update_time': 1774688555.20148}
2026-03-28 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UH38063') HTTP/1.1" 204 0
2026-03-28 09:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:35 [auto1.it] INFO: Found listing with ID: BR49145
2026-03-28 09:02:35 [auto1.it] INFO: Found listing with ID: XE50216
2026-03-28 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE50216%27 HTTP/1.1" 200 None
2026-03-28 09:02:35 [auto1.it] INFO: Scrape type for XE50216: 0
2026-03-28 09:02:35 [auto1.it] INFO: Found listing with ID: VH95383
2026-03-28 09:02:35 [auto1.it] INFO: Found listing with ID: VB21815
2026-03-28 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB21815%27 HTTP/1.1" 200 None
2026-03-28 09:02:35 [auto1.it] INFO: Scrape type for VB21815: 0
2026-03-28 09:02:35 [auto1.it] INFO: Found listing with ID: WU32452
2026-03-28 09:02:35 [auto1.it] INFO: Found listing with ID: KW78911
2026-03-28 09:02:35 [auto1.it] INFO: Found listing with ID: AB01371
2026-03-28 09:02:35 [auto1.it] INFO: Found listing with ID: XF08656
2026-03-28 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF08656%27 HTTP/1.1" 200 None
2026-03-28 09:02:35 [auto1.it] INFO: Scrape type for XF08656: 0
2026-03-28 09:02:35 [auto1.it] INFO: Found listing with ID: BT51990
2026-03-28 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT51990%27 HTTP/1.1" 200 None
2026-03-28 09:02:35 [auto1.it] INFO: Scrape type for BT51990: 0
2026-03-28 09:02:35 [auto1.it] INFO: Found listing with ID: CT54414
2026-03-28 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT54414%27 HTTP/1.1" 200 None
2026-03-28 09:02:35 [auto1.it] INFO: Scrape type for CT54414: 0
2026-03-28 09:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:36 [auto1.it] INFO: Channel: 24h | Page: 35 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: BJ21664
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ21664%27 HTTP/1.1" 200 None
2026-03-28 09:02:36 [auto1.it] INFO: Scrape type for BJ21664: 0
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: ET28084
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: JS18967
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS18967%27 HTTP/1.1" 200 None
2026-03-28 09:02:36 [auto1.it] INFO: Scrape type for JS18967: 0
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: UT61687
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: KV14402
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: KV97590
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: SN54717
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN54717%27 HTTP/1.1" 200 None
2026-03-28 09:02:36 [auto1.it] INFO: Scrape type for SN54717: 0
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: PF84937
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: DT23804
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: UE59883
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE59883%27 HTTP/1.1" 200 None
2026-03-28 09:02:36 [auto1.it] INFO: Scrape type for UE59883: 0
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: KX90230
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX90230%27 HTTP/1.1" 200 None
2026-03-28 09:02:36 [auto1.it] INFO: Scrape type for KX90230: 0
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: HU53243
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU53243%27 HTTP/1.1" 200 None
2026-03-28 09:02:36 [auto1.it] INFO: Scrape type for HU53243: 0
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: ZD91383
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: PZ68086
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: AC58297
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC58297%27 HTTP/1.1" 200 None
2026-03-28 09:02:36 [auto1.it] INFO: Scrape type for AC58297: 0
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: ED83032
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED83032%27 HTTP/1.1" 200 None
2026-03-28 09:02:36 [auto1.it] INFO: Scrape type for ED83032: 0
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: ZJ46829
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ46829%27 HTTP/1.1" 200 None
2026-03-28 09:02:36 [auto1.it] INFO: Scrape type for ZJ46829: 0
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: XW11581
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: BS34699
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS34699%27 HTTP/1.1" 200 None
2026-03-28 09:02:36 [auto1.it] INFO: Scrape type for BS34699: 0
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: FA74836
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA74836%27 HTTP/1.1" 200 None
2026-03-28 09:02:36 [auto1.it] INFO: Scrape type for FA74836: 0
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: VB18666
2026-03-28 09:02:36 [auto1.it] INFO: Found listing with ID: YU90984
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU90984%27 HTTP/1.1" 200 None
2026-03-28 09:02:36 [auto1.it] INFO: Scrape type for YU90984: 2
2026-03-28 09:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d4a9d6b-d37c-58c2-87c7-a87e7078414a with identifier: YU90984
2026-03-28 09:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d4a9d6b-d37c-58c2-87c7-a87e7078414a with scrape type 2
2026-03-28 09:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d4a9d6b-d37c-58c2-87c7-a87e7078414a with scrape type 2
2026-03-28 09:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6d4a9d6b-d37c-58c2-87c7-a87e7078414a, identifier: YU90984
2026-03-28 09:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6d4a9d6b-d37c-58c2-87c7-a87e7078414a with identifier: YU90984
2026-03-28 09:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6d4a9d6b-d37c-58c2-87c7-a87e7078414a with identifier: YU90984
2026-03-28 09:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6d4a9d6b-d37c-58c2-87c7-a87e7078414a with identifier: YU90984 to the API
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:03:57Z',
 'fuel_type': 'diesel',
 'id': '6d4a9d6b-d37c-58c2-87c7-a87e7078414a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU90984',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 316326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-02',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 250 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU90984%27 HTTP/1.1" 200 None
2026-03-28 09:02:36 [auto1.it] INFO: Saving data for YU90984: {'auction_closing_time': 1774713837.0, 'created_time': 1773695002.440503, 'last_price_update_time': 1774688556.957581}
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YU90984') HTTP/1.1" 204 0
2026-03-28 09:02:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: TF40729
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: LN63295
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN63295%27 HTTP/1.1" 200 None
2026-03-28 09:02:37 [auto1.it] INFO: Scrape type for LN63295: 0
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: DA14696
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: YX40722
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX40722%27 HTTP/1.1" 200 None
2026-03-28 09:02:37 [auto1.it] INFO: Scrape type for YX40722: 0
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: WS98369
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS98369%27 HTTP/1.1" 200 None
2026-03-28 09:02:37 [auto1.it] INFO: Scrape type for WS98369: 0
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: JW15936
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: HG36581
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG36581%27 HTTP/1.1" 200 None
2026-03-28 09:02:37 [auto1.it] INFO: Scrape type for HG36581: 0
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: BF27617
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF27617%27 HTTP/1.1" 200 None
2026-03-28 09:02:37 [auto1.it] INFO: Scrape type for BF27617: 0
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: FH04610
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: WU42873
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: HW72110
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: ZF50990
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF50990%27 HTTP/1.1" 200 None
2026-03-28 09:02:37 [auto1.it] INFO: Scrape type for ZF50990: 2
2026-03-28 09:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7f929bc-852b-5d06-8d3e-d4a29cb06193 with identifier: ZF50990
2026-03-28 09:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7f929bc-852b-5d06-8d3e-d4a29cb06193 with scrape type 2
2026-03-28 09:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7f929bc-852b-5d06-8d3e-d4a29cb06193 with scrape type 2
2026-03-28 09:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c7f929bc-852b-5d06-8d3e-d4a29cb06193, identifier: ZF50990
2026-03-28 09:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c7f929bc-852b-5d06-8d3e-d4a29cb06193 with identifier: ZF50990
2026-03-28 09:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c7f929bc-852b-5d06-8d3e-d4a29cb06193 with identifier: ZF50990
2026-03-28 09:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c7f929bc-852b-5d06-8d3e-d4a29cb06193 with identifier: ZF50990 to the API
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:15:51Z',
 'fuel_type': 'petrol',
 'id': 'c7f929bc-852b-5d06-8d3e-d4a29cb06193',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF50990',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 356703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-30',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Turbo BlackLine',
 'transmission': 'manual',
 'trim': 'BlackLine',
 'year': 2011}
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF50990%27 HTTP/1.1" 200 None
2026-03-28 09:02:37 [auto1.it] INFO: Saving data for ZF50990: {'auction_closing_time': 1774714551.0, 'created_time': 1773270381.464953, 'last_price_update_time': 1774688557.563485}
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZF50990') HTTP/1.1" 204 0
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: LD57265
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: TA99011
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: KR59858
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR59858%27 HTTP/1.1" 200 None
2026-03-28 09:02:37 [auto1.it] INFO: Scrape type for KR59858: 0
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: SK65228
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK65228%27 HTTP/1.1" 200 None
2026-03-28 09:02:37 [auto1.it] INFO: Scrape type for SK65228: 0
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: VS16589
2026-03-28 09:02:37 [auto1.it] INFO: Found listing with ID: RY64752
2026-03-28 09:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:38 [auto1.it] INFO: Channel: 24h | Page: 36 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: XW75946
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: ZU45449
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: WM58215
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: ZP08653
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: MT35916
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT35916%27 HTTP/1.1" 200 None
2026-03-28 09:02:38 [auto1.it] INFO: Scrape type for MT35916: 0
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: XH06429
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: JB22661
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB22661%27 HTTP/1.1" 200 None
2026-03-28 09:02:38 [auto1.it] INFO: Scrape type for JB22661: 0
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: TW76525
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW76525%27 HTTP/1.1" 200 None
2026-03-28 09:02:38 [auto1.it] INFO: Scrape type for TW76525: 0
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: CP76510
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: TB87558
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB87558%27 HTTP/1.1" 200 None
2026-03-28 09:02:38 [auto1.it] INFO: Scrape type for TB87558: 0
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: CC19770
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: VY00315
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY00315%27 HTTP/1.1" 200 None
2026-03-28 09:02:38 [auto1.it] INFO: Scrape type for VY00315: 0
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: PD51522
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: VW75885
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW75885%27 HTTP/1.1" 200 None
2026-03-28 09:02:38 [auto1.it] INFO: Scrape type for VW75885: 0
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: PA11194
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA11194%27 HTTP/1.1" 200 None
2026-03-28 09:02:38 [auto1.it] INFO: Scrape type for PA11194: 0
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: KT64374
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT64374%27 HTTP/1.1" 200 None
2026-03-28 09:02:38 [auto1.it] INFO: Scrape type for KT64374: 0
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: HS22192
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: GU77220
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU77220%27 HTTP/1.1" 200 None
2026-03-28 09:02:38 [auto1.it] INFO: Scrape type for GU77220: 0
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: KC61332
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: VZ02173
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: GR02262
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: LJ91384
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: CY31858
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: WM29038
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM29038%27 HTTP/1.1" 200 None
2026-03-28 09:02:38 [auto1.it] INFO: Scrape type for WM29038: 0
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: XN45534
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: LR14245
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR14245%27 HTTP/1.1" 200 None
2026-03-28 09:02:38 [auto1.it] INFO: Scrape type for LR14245: 0
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: UH68033
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH68033%27 HTTP/1.1" 200 None
2026-03-28 09:02:38 [auto1.it] INFO: Scrape type for UH68033: 0
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: VN85673
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: RM92926
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM92926%27 HTTP/1.1" 200 None
2026-03-28 09:02:38 [auto1.it] INFO: Scrape type for RM92926: 0
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: NV20276
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV20276%27 HTTP/1.1" 200 None
2026-03-28 09:02:38 [auto1.it] INFO: Scrape type for NV20276: 0
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: UX25777
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: EK30542
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: ME36954
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: FY24285
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY24285%27 HTTP/1.1" 200 None
2026-03-28 09:02:38 [auto1.it] INFO: Scrape type for FY24285: 0
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: GW87454
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW87454%27 HTTP/1.1" 200 None
2026-03-28 09:02:38 [auto1.it] INFO: Scrape type for GW87454: 0
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: JS13846
2026-03-28 09:02:38 [auto1.it] INFO: Found listing with ID: NB30604
2026-03-28 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB30604%27 HTTP/1.1" 200 None
2026-03-28 09:02:39 [auto1.it] INFO: Scrape type for NB30604: 0
2026-03-28 09:02:39 [auto1.it] INFO: Found listing with ID: CS63696
2026-03-28 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS63696%27 HTTP/1.1" 200 None
2026-03-28 09:02:39 [auto1.it] INFO: Scrape type for CS63696: 0
2026-03-28 09:02:39 [auto1.it] INFO: Found listing with ID: HW76597
2026-03-28 09:02:39 [auto1.it] INFO: Found listing with ID: AB32606
2026-03-28 09:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:40 [auto1.it] INFO: Channel: 24h | Page: 37 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: TM60577
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM60577%27 HTTP/1.1" 200 None
2026-03-28 09:02:40 [auto1.it] INFO: Scrape type for TM60577: 0
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: NT36373
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: YX73536
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX73536%27 HTTP/1.1" 200 None
2026-03-28 09:02:40 [auto1.it] INFO: Scrape type for YX73536: 0
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: YH73900
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: TN90495
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: UE02945
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE02945%27 HTTP/1.1" 200 None
2026-03-28 09:02:40 [auto1.it] INFO: Scrape type for UE02945: 0
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: AX03147
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: BZ92290
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: PB66725
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: TB34384
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: MJ42614
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: RJ57897
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: GT90583
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT90583%27 HTTP/1.1" 200 None
2026-03-28 09:02:40 [auto1.it] INFO: Scrape type for GT90583: 0
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: BJ81440
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: AF34826
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: UC76692
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC76692%27 HTTP/1.1" 200 None
2026-03-28 09:02:40 [auto1.it] INFO: Scrape type for UC76692: 0
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: XX89232
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX89232%27 HTTP/1.1" 200 None
2026-03-28 09:02:40 [auto1.it] INFO: Scrape type for XX89232: 0
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: PW51230
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW51230%27 HTTP/1.1" 200 None
2026-03-28 09:02:40 [auto1.it] INFO: Scrape type for PW51230: 0
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: TU80185
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: KE18489
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: TN86545
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: DT89557
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT89557%27 HTTP/1.1" 200 None
2026-03-28 09:02:40 [auto1.it] INFO: Scrape type for DT89557: 0
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: SN05333
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN05333%27 HTTP/1.1" 200 None
2026-03-28 09:02:40 [auto1.it] INFO: Scrape type for SN05333: 0
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: NF06538
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: XD75344
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: WV36491
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV36491%27 HTTP/1.1" 200 None
2026-03-28 09:02:40 [auto1.it] INFO: Scrape type for WV36491: 0
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: HR62667
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: NG38983
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG38983%27 HTTP/1.1" 200 None
2026-03-28 09:02:40 [auto1.it] INFO: Scrape type for NG38983: 0
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: GT34435
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT34435%27 HTTP/1.1" 200 None
2026-03-28 09:02:40 [auto1.it] INFO: Scrape type for GT34435: 0
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: DM32670
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM32670%27 HTTP/1.1" 200 None
2026-03-28 09:02:40 [auto1.it] INFO: Scrape type for DM32670: 0
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: SM92282
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM92282%27 HTTP/1.1" 200 None
2026-03-28 09:02:40 [auto1.it] INFO: Scrape type for SM92282: 0
2026-03-28 09:02:40 [auto1.it] INFO: Found listing with ID: LF83969
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF83969%27 HTTP/1.1" 200 None
2026-03-28 09:02:40 [auto1.it] INFO: Scrape type for LF83969: 2
2026-03-28 09:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 067cdc9a-9930-5c1f-8f45-85c175b0edf0 with identifier: LF83969
2026-03-28 09:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 067cdc9a-9930-5c1f-8f45-85c175b0edf0 with scrape type 2
2026-03-28 09:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 067cdc9a-9930-5c1f-8f45-85c175b0edf0 with scrape type 2
2026-03-28 09:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 067cdc9a-9930-5c1f-8f45-85c175b0edf0, identifier: LF83969
2026-03-28 09:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 067cdc9a-9930-5c1f-8f45-85c175b0edf0 with identifier: LF83969
2026-03-28 09:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 067cdc9a-9930-5c1f-8f45-85c175b0edf0 with identifier: LF83969
2026-03-28 09:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 067cdc9a-9930-5c1f-8f45-85c175b0edf0 with identifier: LF83969 to the API
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:10:07Z',
 'fuel_type': 'hybrid',
 'id': '067cdc9a-9930-5c1f-8f45-85c175b0edf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF83969',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'NX-Serie',
 'odometer': 177466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-02',
 'seller_name': None,
 'title': 'Lexus NX-Serie NX 300h Executive Line',
 'transmission': 'automatic',
 'trim': 'Executive Line',
 'year': 2016}
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF83969%27 HTTP/1.1" 200 None
2026-03-28 09:02:40 [auto1.it] INFO: Saving data for LF83969: {'auction_closing_time': 1774714207.0, 'created_time': 1773663261.195062, 'last_price_update_time': 1774688560.951402}
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LF83969') HTTP/1.1" 204 0
2026-03-28 09:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:41 [auto1.it] INFO: Found listing with ID: YA27066
2026-03-28 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA27066%27 HTTP/1.1" 200 None
2026-03-28 09:02:41 [auto1.it] INFO: Scrape type for YA27066: 0
2026-03-28 09:02:41 [auto1.it] INFO: Found listing with ID: GF32219
2026-03-28 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF32219%27 HTTP/1.1" 200 None
2026-03-28 09:02:41 [auto1.it] INFO: Scrape type for GF32219: 0
2026-03-28 09:02:41 [auto1.it] INFO: Found listing with ID: WW13816
2026-03-28 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW13816%27 HTTP/1.1" 200 None
2026-03-28 09:02:41 [auto1.it] INFO: Scrape type for WW13816: 0
2026-03-28 09:02:41 [auto1.it] INFO: Found listing with ID: KW05782
2026-03-28 09:02:41 [auto1.it] INFO: Found listing with ID: FM41301
2026-03-28 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM41301%27 HTTP/1.1" 200 None
2026-03-28 09:02:41 [auto1.it] INFO: Scrape type for FM41301: 0
2026-03-28 09:02:41 [auto1.it] INFO: Found listing with ID: PV36445
2026-03-28 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV36445%27 HTTP/1.1" 200 None
2026-03-28 09:02:41 [auto1.it] INFO: Scrape type for PV36445: 0
2026-03-28 09:02:41 [auto1.it] INFO: Found listing with ID: JE16682
2026-03-28 09:02:41 [auto1.it] INFO: Found listing with ID: PY44760
2026-03-28 09:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:42 [auto1.it] INFO: Channel: 24h | Page: 38 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:42 [auto1.it] INFO: Found listing with ID: YA27479
2026-03-28 09:02:42 [auto1.it] INFO: Found listing with ID: GP83867
2026-03-28 09:02:42 [auto1.it] INFO: Found listing with ID: RK56494
2026-03-28 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK56494%27 HTTP/1.1" 200 None
2026-03-28 09:02:42 [auto1.it] INFO: Scrape type for RK56494: 0
2026-03-28 09:02:42 [auto1.it] INFO: Found listing with ID: FS14402
2026-03-28 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS14402%27 HTTP/1.1" 200 None
2026-03-28 09:02:42 [auto1.it] INFO: Scrape type for FS14402: 0
2026-03-28 09:02:42 [auto1.it] INFO: Found listing with ID: AS05452
2026-03-28 09:02:42 [auto1.it] INFO: Found listing with ID: ES04012
2026-03-28 09:02:42 [auto1.it] INFO: Found listing with ID: LZ09270
2026-03-28 09:02:42 [auto1.it] INFO: Found listing with ID: AS39534
2026-03-28 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS39534%27 HTTP/1.1" 200 None
2026-03-28 09:02:42 [auto1.it] INFO: Scrape type for AS39534: 0
2026-03-28 09:02:42 [auto1.it] INFO: Found listing with ID: DL65362
2026-03-28 09:02:42 [auto1.it] INFO: Found listing with ID: EN70026
2026-03-28 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN70026%27 HTTP/1.1" 200 None
2026-03-28 09:02:42 [auto1.it] INFO: Scrape type for EN70026: 2
2026-03-28 09:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffcd504f-337a-5500-af19-35c79de5693b with identifier: EN70026
2026-03-28 09:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffcd504f-337a-5500-af19-35c79de5693b with scrape type 2
2026-03-28 09:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffcd504f-337a-5500-af19-35c79de5693b with scrape type 2
2026-03-28 09:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ffcd504f-337a-5500-af19-35c79de5693b, identifier: EN70026
2026-03-28 09:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ffcd504f-337a-5500-af19-35c79de5693b with identifier: EN70026
2026-03-28 09:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ffcd504f-337a-5500-af19-35c79de5693b with identifier: EN70026
2026-03-28 09:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ffcd504f-337a-5500-af19-35c79de5693b with identifier: EN70026 to the API
2026-03-28 09:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:52:15Z',
 'fuel_type': 'diesel',
 'id': 'ffcd504f-337a-5500-af19-35c79de5693b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN70026',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 119924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI BlueEfficiency Premium',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Premium',
 'year': 2013}
2026-03-28 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN70026%27 HTTP/1.1" 200 None
2026-03-28 09:02:42 [auto1.it] INFO: Saving data for EN70026: {'auction_closing_time': 1774716735.0, 'created_time': 1773663180.955816, 'last_price_update_time': 1774688562.949533}
2026-03-28 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EN70026') HTTP/1.1" 204 0
2026-03-28 09:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: XT78781
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT78781%27 HTTP/1.1" 200 None
2026-03-28 09:02:43 [auto1.it] INFO: Scrape type for XT78781: 0
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: CZ95838
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: LZ34680
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: AN40699
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN40699%27 HTTP/1.1" 200 None
2026-03-28 09:02:43 [auto1.it] INFO: Scrape type for AN40699: 0
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: UC06691
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC06691%27 HTTP/1.1" 200 None
2026-03-28 09:02:43 [auto1.it] INFO: Scrape type for UC06691: 0
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: ZH38248
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH38248%27 HTTP/1.1" 200 None
2026-03-28 09:02:43 [auto1.it] INFO: Scrape type for ZH38248: 0
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: DZ90619
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: CE26038
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: NB63581
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB63581%27 HTTP/1.1" 200 None
2026-03-28 09:02:43 [auto1.it] INFO: Scrape type for NB63581: 0
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: VM26372
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: NL15395
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: BG87604
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: LZ35961
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: YT66548
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: AZ05187
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: WS24501
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS24501%27 HTTP/1.1" 200 None
2026-03-28 09:02:43 [auto1.it] INFO: Scrape type for WS24501: 0
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: NR87302
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR87302%27 HTTP/1.1" 200 None
2026-03-28 09:02:43 [auto1.it] INFO: Scrape type for NR87302: 0
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: ML34451
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML34451%27 HTTP/1.1" 200 None
2026-03-28 09:02:43 [auto1.it] INFO: Scrape type for ML34451: 0
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: ZS54460
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS54460%27 HTTP/1.1" 200 None
2026-03-28 09:02:43 [auto1.it] INFO: Scrape type for ZS54460: 0
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: KC88593
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: JH12834
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH12834%27 HTTP/1.1" 200 None
2026-03-28 09:02:43 [auto1.it] INFO: Scrape type for JH12834: 0
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: UH56050
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: VE88440
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: WS26494
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS26494%27 HTTP/1.1" 200 None
2026-03-28 09:02:43 [auto1.it] INFO: Scrape type for WS26494: 0
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: VK91535
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: BF34891
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: FJ33750
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ33750%27 HTTP/1.1" 200 None
2026-03-28 09:02:43 [auto1.it] INFO: Scrape type for FJ33750: 0
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: XN46207
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: NF47535
2026-03-28 09:02:43 [auto1.it] INFO: Found listing with ID: AW83777
2026-03-28 09:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:44 [auto1.it] INFO: Channel: 24h | Page: 39 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:44 [auto1.it] INFO: Found listing with ID: UN97193
2026-03-28 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN97193%27 HTTP/1.1" 200 None
2026-03-28 09:02:44 [auto1.it] INFO: Scrape type for UN97193: 0
2026-03-28 09:02:44 [auto1.it] INFO: Found listing with ID: MN57252
2026-03-28 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN57252%27 HTTP/1.1" 200 None
2026-03-28 09:02:44 [auto1.it] INFO: Scrape type for MN57252: 0
2026-03-28 09:02:44 [auto1.it] INFO: Found listing with ID: TZ83708
2026-03-28 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ83708%27 HTTP/1.1" 200 None
2026-03-28 09:02:44 [auto1.it] INFO: Scrape type for TZ83708: 0
2026-03-28 09:02:44 [auto1.it] INFO: Found listing with ID: KZ82470
2026-03-28 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ82470%27 HTTP/1.1" 200 None
2026-03-28 09:02:44 [auto1.it] INFO: Scrape type for KZ82470: 0
2026-03-28 09:02:44 [auto1.it] INFO: Found listing with ID: MW18742
2026-03-28 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW18742%27 HTTP/1.1" 200 None
2026-03-28 09:02:44 [auto1.it] INFO: Scrape type for MW18742: 0
2026-03-28 09:02:44 [auto1.it] INFO: Found listing with ID: FC02474
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC02474%27 HTTP/1.1" 200 None
2026-03-28 09:02:45 [auto1.it] INFO: Scrape type for FC02474: 0
2026-03-28 09:02:45 [auto1.it] INFO: Found listing with ID: JA78037
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA78037%27 HTTP/1.1" 200 None
2026-03-28 09:02:45 [auto1.it] INFO: Scrape type for JA78037: 0
2026-03-28 09:02:45 [auto1.it] INFO: Found listing with ID: BN58540
2026-03-28 09:02:45 [auto1.it] INFO: Found listing with ID: FU65166
2026-03-28 09:02:45 [auto1.it] INFO: Found listing with ID: YV43254
2026-03-28 09:02:45 [auto1.it] INFO: Found listing with ID: CA25129
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA25129%27 HTTP/1.1" 200 None
2026-03-28 09:02:45 [auto1.it] INFO: Scrape type for CA25129: 0
2026-03-28 09:02:45 [auto1.it] INFO: Found listing with ID: CE40479
2026-03-28 09:02:45 [auto1.it] INFO: Found listing with ID: WT36822
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT36822%27 HTTP/1.1" 200 None
2026-03-28 09:02:45 [auto1.it] INFO: Scrape type for WT36822: 2
2026-03-28 09:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81ef98e6-8473-55b7-a77c-638c6fc28aa3 with identifier: WT36822
2026-03-28 09:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81ef98e6-8473-55b7-a77c-638c6fc28aa3 with scrape type 2
2026-03-28 09:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81ef98e6-8473-55b7-a77c-638c6fc28aa3 with scrape type 2
2026-03-28 09:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 81ef98e6-8473-55b7-a77c-638c6fc28aa3, identifier: WT36822
2026-03-28 09:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 81ef98e6-8473-55b7-a77c-638c6fc28aa3 with identifier: WT36822
2026-03-28 09:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 81ef98e6-8473-55b7-a77c-638c6fc28aa3 with identifier: WT36822
2026-03-28 09:02:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 81ef98e6-8473-55b7-a77c-638c6fc28aa3 with identifier: WT36822 to the API
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:01:12Z',
 'fuel_type': 'diesel',
 'id': '81ef98e6-8473-55b7-a77c-638c6fc28aa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT36822',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 241563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-06',
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2007}
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT36822%27 HTTP/1.1" 200 None
2026-03-28 09:02:45 [auto1.it] INFO: Saving data for WT36822: {'auction_closing_time': 1774713672.0, 'created_time': 1774472687.872663, 'last_price_update_time': 1774688565.5359}
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WT36822') HTTP/1.1" 204 0
2026-03-28 09:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:45 [auto1.it] INFO: Found listing with ID: HN39146
2026-03-28 09:02:45 [auto1.it] INFO: Found listing with ID: DK95010
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK95010%27 HTTP/1.1" 200 None
2026-03-28 09:02:45 [auto1.it] INFO: Scrape type for DK95010: 2
2026-03-28 09:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b688dcb2-451d-5fce-858a-db28ad03b70e with identifier: DK95010
2026-03-28 09:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b688dcb2-451d-5fce-858a-db28ad03b70e with scrape type 2
2026-03-28 09:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b688dcb2-451d-5fce-858a-db28ad03b70e with scrape type 2
2026-03-28 09:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b688dcb2-451d-5fce-858a-db28ad03b70e, identifier: DK95010
2026-03-28 09:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b688dcb2-451d-5fce-858a-db28ad03b70e with identifier: DK95010
2026-03-28 09:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b688dcb2-451d-5fce-858a-db28ad03b70e with identifier: DK95010
2026-03-28 09:02:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b688dcb2-451d-5fce-858a-db28ad03b70e with identifier: DK95010 to the API
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:44Z',
 'fuel_type': 'petrol',
 'id': 'b688dcb2-451d-5fce-858a-db28ad03b70e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK95010',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 41195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-07',
 'seller_name': None,
 'title': 'Seat Tarraco 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2023}
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK95010%27 HTTP/1.1" 200 None
2026-03-28 09:02:46 [auto1.it] INFO: Saving data for DK95010: {'auction_closing_time': 1774715744.0, 'created_time': 1773237414.19945, 'last_price_update_time': 1774688566.075895}
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DK95010') HTTP/1.1" 204 0
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: ZT62923
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: MV32158
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV32158%27 HTTP/1.1" 200 None
2026-03-28 09:02:46 [auto1.it] INFO: Scrape type for MV32158: 0
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: RV46359
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV46359%27 HTTP/1.1" 200 None
2026-03-28 09:02:46 [auto1.it] INFO: Scrape type for RV46359: 0
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: VX22650
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: UV86732
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: LR88611
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: KC34999
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC34999%27 HTTP/1.1" 200 None
2026-03-28 09:02:46 [auto1.it] INFO: Scrape type for KC34999: 0
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: YG71564
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG71564%27 HTTP/1.1" 200 None
2026-03-28 09:02:46 [auto1.it] INFO: Scrape type for YG71564: 0
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: SU56229
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: FJ79920
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: LN35929
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: VS62042
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: VR29883
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: CR81411
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR81411%27 HTTP/1.1" 200 None
2026-03-28 09:02:46 [auto1.it] INFO: Scrape type for CR81411: 0
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: PS88419
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: HP97671
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP97671%27 HTTP/1.1" 200 None
2026-03-28 09:02:46 [auto1.it] INFO: Scrape type for HP97671: 0
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: NP87622
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP87622%27 HTTP/1.1" 200 None
2026-03-28 09:02:46 [auto1.it] INFO: Scrape type for NP87622: 0
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: UA26994
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: AM15207
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM15207%27 HTTP/1.1" 200 None
2026-03-28 09:02:46 [auto1.it] INFO: Scrape type for AM15207: 2
2026-03-28 09:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5937f75a-9613-52c0-b46e-47b1a2433664 with identifier: AM15207
2026-03-28 09:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5937f75a-9613-52c0-b46e-47b1a2433664 with scrape type 2
2026-03-28 09:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5937f75a-9613-52c0-b46e-47b1a2433664 with scrape type 2
2026-03-28 09:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5937f75a-9613-52c0-b46e-47b1a2433664, identifier: AM15207
2026-03-28 09:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5937f75a-9613-52c0-b46e-47b1a2433664 with identifier: AM15207
2026-03-28 09:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5937f75a-9613-52c0-b46e-47b1a2433664 with identifier: AM15207
2026-03-28 09:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5937f75a-9613-52c0-b46e-47b1a2433664 with identifier: AM15207 to the API
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:27:31Z',
 'fuel_type': 'petrol',
 'id': '5937f75a-9613-52c0-b46e-47b1a2433664',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM15207',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 24671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-26',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Monte Carlo',
 'transmission': 'manual',
 'trim': 'Monte Carlo',
 'year': 2022}
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM15207%27 HTTP/1.1" 200 None
2026-03-28 09:02:46 [auto1.it] INFO: Saving data for AM15207: {'auction_closing_time': 1774715251.0, 'created_time': 1774472750.253455, 'last_price_update_time': 1774688566.670353}
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AM15207') HTTP/1.1" 204 0
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: ZP66852
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: AJ97294
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: SW80726
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: MA64070
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA64070%27 HTTP/1.1" 200 None
2026-03-28 09:02:46 [auto1.it] INFO: Scrape type for MA64070: 0
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: EM71095
2026-03-28 09:02:46 [auto1.it] INFO: Found listing with ID: VS38043
2026-03-28 09:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:47 [auto1.it] INFO: Channel: 24h | Page: 40 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: JW99626
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW99626%27 HTTP/1.1" 200 None
2026-03-28 09:02:47 [auto1.it] INFO: Scrape type for JW99626: 0
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: MK90568
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK90568%27 HTTP/1.1" 200 None
2026-03-28 09:02:47 [auto1.it] INFO: Scrape type for MK90568: 0
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: JX77984
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX77984%27 HTTP/1.1" 200 None
2026-03-28 09:02:47 [auto1.it] INFO: Scrape type for JX77984: 0
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: PA30121
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: HJ68479
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: GK89586
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK89586%27 HTTP/1.1" 200 None
2026-03-28 09:02:47 [auto1.it] INFO: Scrape type for GK89586: 0
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: GT17174
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT17174%27 HTTP/1.1" 200 None
2026-03-28 09:02:47 [auto1.it] INFO: Scrape type for GT17174: 0
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: RE49156
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE49156%27 HTTP/1.1" 200 None
2026-03-28 09:02:47 [auto1.it] INFO: Scrape type for RE49156: 0
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: CJ22760
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: FW39632
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: JA96150
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: EG94847
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG94847%27 HTTP/1.1" 200 None
2026-03-28 09:02:47 [auto1.it] INFO: Scrape type for EG94847: 0
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: SN82896
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN82896%27 HTTP/1.1" 200 None
2026-03-28 09:02:47 [auto1.it] INFO: Scrape type for SN82896: 0
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: DC70843
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC70843%27 HTTP/1.1" 200 None
2026-03-28 09:02:47 [auto1.it] INFO: Scrape type for DC70843: 0
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: VL00110
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: ZT47825
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT47825%27 HTTP/1.1" 200 None
2026-03-28 09:02:47 [auto1.it] INFO: Scrape type for ZT47825: 0
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: PZ52639
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ52639%27 HTTP/1.1" 200 None
2026-03-28 09:02:47 [auto1.it] INFO: Scrape type for PZ52639: 0
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: HS75428
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS75428%27 HTTP/1.1" 200 None
2026-03-28 09:02:47 [auto1.it] INFO: Scrape type for HS75428: 0
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: MZ40359
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ40359%27 HTTP/1.1" 200 None
2026-03-28 09:02:47 [auto1.it] INFO: Scrape type for MZ40359: 0
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: ZM41579
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: SA83411
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA83411%27 HTTP/1.1" 200 None
2026-03-28 09:02:47 [auto1.it] INFO: Scrape type for SA83411: 0
2026-03-28 09:02:47 [auto1.it] INFO: Found listing with ID: PT34479
2026-03-28 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT34479%27 HTTP/1.1" 200 None
2026-03-28 09:02:48 [auto1.it] INFO: Scrape type for PT34479: 0
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: SE61764
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: GT94067
2026-03-28 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT94067%27 HTTP/1.1" 200 None
2026-03-28 09:02:48 [auto1.it] INFO: Scrape type for GT94067: 0
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: YR30940
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: AK38143
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: JW87652
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: MP39083
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: WA88594
2026-03-28 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA88594%27 HTTP/1.1" 200 None
2026-03-28 09:02:48 [auto1.it] INFO: Scrape type for WA88594: 0
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: AB27161
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: NN45257
2026-03-28 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN45257%27 HTTP/1.1" 200 None
2026-03-28 09:02:48 [auto1.it] INFO: Scrape type for NN45257: 0
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: JV66530
2026-03-28 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV66530%27 HTTP/1.1" 200 None
2026-03-28 09:02:48 [auto1.it] INFO: Scrape type for JV66530: 0
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: JV92399
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: FP63529
2026-03-28 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP63529%27 HTTP/1.1" 200 None
2026-03-28 09:02:48 [auto1.it] INFO: Scrape type for FP63529: 0
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: GD26025
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: DG54117
2026-03-28 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG54117%27 HTTP/1.1" 200 None
2026-03-28 09:02:48 [auto1.it] INFO: Scrape type for DG54117: 0
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: LC35627
2026-03-28 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC35627%27 HTTP/1.1" 200 None
2026-03-28 09:02:48 [auto1.it] INFO: Scrape type for LC35627: 0
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: GE96866
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: YT54925
2026-03-28 09:02:48 [auto1.it] INFO: Found listing with ID: RN34673
2026-03-28 09:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:50 [auto1.it] INFO: Channel: 24h | Page: 41 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:50 [auto1.it] INFO: Found listing with ID: MR41650
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR41650%27 HTTP/1.1" 200 None
2026-03-28 09:02:50 [auto1.it] INFO: Scrape type for MR41650: 0
2026-03-28 09:02:50 [auto1.it] INFO: Found listing with ID: VF40015
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF40015%27 HTTP/1.1" 200 None
2026-03-28 09:02:50 [auto1.it] INFO: Scrape type for VF40015: 0
2026-03-28 09:02:50 [auto1.it] INFO: Found listing with ID: WB49525
2026-03-28 09:02:50 [auto1.it] INFO: Found listing with ID: CG39914
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG39914%27 HTTP/1.1" 200 None
2026-03-28 09:02:50 [auto1.it] INFO: Scrape type for CG39914: 0
2026-03-28 09:02:50 [auto1.it] INFO: Found listing with ID: KD78044
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD78044%27 HTTP/1.1" 200 None
2026-03-28 09:02:50 [auto1.it] INFO: Scrape type for KD78044: 0
2026-03-28 09:02:50 [auto1.it] INFO: Found listing with ID: PH76883
2026-03-28 09:02:50 [auto1.it] INFO: Found listing with ID: PL46674
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL46674%27 HTTP/1.1" 200 None
2026-03-28 09:02:50 [auto1.it] INFO: Scrape type for PL46674: 2
2026-03-28 09:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cad90656-b865-50bf-8cd5-222bccd0b9ba with identifier: PL46674
2026-03-28 09:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cad90656-b865-50bf-8cd5-222bccd0b9ba with scrape type 2
2026-03-28 09:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cad90656-b865-50bf-8cd5-222bccd0b9ba with scrape type 2
2026-03-28 09:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cad90656-b865-50bf-8cd5-222bccd0b9ba, identifier: PL46674
2026-03-28 09:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cad90656-b865-50bf-8cd5-222bccd0b9ba with identifier: PL46674
2026-03-28 09:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cad90656-b865-50bf-8cd5-222bccd0b9ba with identifier: PL46674
2026-03-28 09:02:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cad90656-b865-50bf-8cd5-222bccd0b9ba with identifier: PL46674 to the API
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:43:37Z',
 'fuel_type': 'diesel',
 'id': 'cad90656-b865-50bf-8cd5-222bccd0b9ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL46674',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 283069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-16',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.9 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2007}
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL46674%27 HTTP/1.1" 200 None
2026-03-28 09:02:50 [auto1.it] INFO: Saving data for PL46674: {'auction_closing_time': 1774716217.0, 'created_time': 1773130294.104403, 'last_price_update_time': 1774688570.723409}
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PL46674') HTTP/1.1" 204 0
2026-03-28 09:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:50 [auto1.it] INFO: Found listing with ID: SJ27084
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ27084%27 HTTP/1.1" 200 None
2026-03-28 09:02:50 [auto1.it] INFO: Scrape type for SJ27084: 0
2026-03-28 09:02:50 [auto1.it] INFO: Found listing with ID: XT06455
2026-03-28 09:02:50 [auto1.it] INFO: Found listing with ID: YR22180
2026-03-28 09:02:50 [auto1.it] INFO: Found listing with ID: DU27082
2026-03-28 09:02:50 [auto1.it] INFO: Found listing with ID: AH76679
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH76679%27 HTTP/1.1" 200 None
2026-03-28 09:02:50 [auto1.it] INFO: Scrape type for AH76679: 0
2026-03-28 09:02:50 [auto1.it] INFO: Found listing with ID: ZS91075
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS91075%27 HTTP/1.1" 200 None
2026-03-28 09:02:50 [auto1.it] INFO: Scrape type for ZS91075: 0
2026-03-28 09:02:50 [auto1.it] INFO: Found listing with ID: GJ69248
2026-03-28 09:02:50 [auto1.it] INFO: Found listing with ID: RH51266
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH51266%27 HTTP/1.1" 200 None
2026-03-28 09:02:50 [auto1.it] INFO: Scrape type for RH51266: 0
2026-03-28 09:02:50 [auto1.it] INFO: Found listing with ID: HH67812
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH67812%27 HTTP/1.1" 200 None
2026-03-28 09:02:50 [auto1.it] INFO: Scrape type for HH67812: 2
2026-03-28 09:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2a02932-88f0-5567-8bf5-6055d2538b3e with identifier: HH67812
2026-03-28 09:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2a02932-88f0-5567-8bf5-6055d2538b3e with scrape type 2
2026-03-28 09:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2a02932-88f0-5567-8bf5-6055d2538b3e with scrape type 2
2026-03-28 09:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b2a02932-88f0-5567-8bf5-6055d2538b3e, identifier: HH67812
2026-03-28 09:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b2a02932-88f0-5567-8bf5-6055d2538b3e with identifier: HH67812
2026-03-28 09:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b2a02932-88f0-5567-8bf5-6055d2538b3e with identifier: HH67812
2026-03-28 09:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b2a02932-88f0-5567-8bf5-6055d2538b3e with identifier: HH67812 to the API
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:09:10Z',
 'fuel_type': 'petrol',
 'id': 'b2a02932-88f0-5567-8bf5-6055d2538b3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH67812',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 92992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-19',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH67812%27 HTTP/1.1" 200 None
2026-03-28 09:02:51 [auto1.it] INFO: Saving data for HH67812: {'auction_closing_time': 1774714150.0, 'created_time': 1773694855.54008, 'last_price_update_time': 1774688571.317014}
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HH67812') HTTP/1.1" 204 0
2026-03-28 09:02:51 [auto1.it] INFO: Found listing with ID: FF98619
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF98619%27 HTTP/1.1" 200 None
2026-03-28 09:02:51 [auto1.it] INFO: Scrape type for FF98619: 0
2026-03-28 09:02:51 [auto1.it] INFO: Found listing with ID: PD61246
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD61246%27 HTTP/1.1" 200 None
2026-03-28 09:02:51 [auto1.it] INFO: Scrape type for PD61246: 0
2026-03-28 09:02:51 [auto1.it] INFO: Found listing with ID: AN46141
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN46141%27 HTTP/1.1" 200 None
2026-03-28 09:02:51 [auto1.it] INFO: Scrape type for AN46141: 0
2026-03-28 09:02:51 [auto1.it] INFO: Found listing with ID: VY12867
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY12867%27 HTTP/1.1" 200 None
2026-03-28 09:02:51 [auto1.it] INFO: Scrape type for VY12867: 0
2026-03-28 09:02:51 [auto1.it] INFO: Found listing with ID: NP19925
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP19925%27 HTTP/1.1" 200 None
2026-03-28 09:02:51 [auto1.it] INFO: Scrape type for NP19925: 0
2026-03-28 09:02:51 [auto1.it] INFO: Found listing with ID: GP32849
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GP32849%27 HTTP/1.1" 200 None
2026-03-28 09:02:51 [auto1.it] INFO: Scrape type for GP32849: 0
2026-03-28 09:02:51 [auto1.it] INFO: Found listing with ID: RG23044
2026-03-28 09:02:51 [auto1.it] INFO: Found listing with ID: PE03343
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE03343%27 HTTP/1.1" 200 None
2026-03-28 09:02:51 [auto1.it] INFO: Scrape type for PE03343: 0
2026-03-28 09:02:51 [auto1.it] INFO: Found listing with ID: NC40954
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC40954%27 HTTP/1.1" 200 None
2026-03-28 09:02:51 [auto1.it] INFO: Scrape type for NC40954: 0
2026-03-28 09:02:51 [auto1.it] INFO: Found listing with ID: JS86571
2026-03-28 09:02:51 [auto1.it] INFO: Found listing with ID: SW25122
2026-03-28 09:02:51 [auto1.it] INFO: Found listing with ID: ZH41426
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH41426%27 HTTP/1.1" 200 None
2026-03-28 09:02:51 [auto1.it] INFO: Scrape type for ZH41426: 2
2026-03-28 09:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cefffba7-7042-5caf-be7a-e4eed14f13be with identifier: ZH41426
2026-03-28 09:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cefffba7-7042-5caf-be7a-e4eed14f13be with scrape type 2
2026-03-28 09:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cefffba7-7042-5caf-be7a-e4eed14f13be with scrape type 2
2026-03-28 09:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cefffba7-7042-5caf-be7a-e4eed14f13be, identifier: ZH41426
2026-03-28 09:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cefffba7-7042-5caf-be7a-e4eed14f13be with identifier: ZH41426
2026-03-28 09:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cefffba7-7042-5caf-be7a-e4eed14f13be with identifier: ZH41426
2026-03-28 09:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cefffba7-7042-5caf-be7a-e4eed14f13be with identifier: ZH41426 to the API
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:20:32Z',
 'fuel_type': 'diesel',
 'id': 'cefffba7-7042-5caf-be7a-e4eed14f13be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH41426',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 153156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Energy 2WD',
 'transmission': 'automatic',
 'trim': 'Energy 2WD',
 'year': 2019}
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH41426%27 HTTP/1.1" 200 None
2026-03-28 09:02:51 [auto1.it] INFO: Saving data for ZH41426: {'auction_closing_time': 1774714832.0, 'created_time': 1773241798.02805, 'last_price_update_time': 1774688571.944778}
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZH41426') HTTP/1.1" 204 0
2026-03-28 09:02:52 [auto1.it] INFO: Found listing with ID: EL59293
2026-03-28 09:02:52 [auto1.it] INFO: Found listing with ID: WR52243
2026-03-28 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR52243%27 HTTP/1.1" 200 None
2026-03-28 09:02:52 [auto1.it] INFO: Scrape type for WR52243: 0
2026-03-28 09:02:52 [auto1.it] INFO: Found listing with ID: RX05887
2026-03-28 09:02:52 [auto1.it] INFO: Found listing with ID: NF99780
2026-03-28 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF99780%27 HTTP/1.1" 200 None
2026-03-28 09:02:52 [auto1.it] INFO: Scrape type for NF99780: 0
2026-03-28 09:02:52 [auto1.it] INFO: Found listing with ID: UY31632
2026-03-28 09:02:52 [auto1.it] INFO: Found listing with ID: DV60834
2026-03-28 09:02:52 [auto1.it] INFO: Found listing with ID: ZC00549
2026-03-28 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC00549%27 HTTP/1.1" 200 None
2026-03-28 09:02:52 [auto1.it] INFO: Scrape type for ZC00549: 0
2026-03-28 09:02:52 [auto1.it] INFO: Found listing with ID: TB04620
2026-03-28 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB04620%27 HTTP/1.1" 200 None
2026-03-28 09:02:52 [auto1.it] INFO: Scrape type for TB04620: 0
2026-03-28 09:02:52 [auto1.it] INFO: Found listing with ID: FN63794
2026-03-28 09:02:52 [auto1.it] INFO: Found listing with ID: NJ73400
2026-03-28 09:02:52 [auto1.it] INFO: Found listing with ID: TH32608
2026-03-28 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH32608%27 HTTP/1.1" 200 None
2026-03-28 09:02:52 [auto1.it] INFO: Scrape type for TH32608: 0
2026-03-28 09:02:52 [auto1.it] INFO: Found listing with ID: ZB01532
2026-03-28 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB01532%27 HTTP/1.1" 200 None
2026-03-28 09:02:52 [auto1.it] INFO: Scrape type for ZB01532: 0
2026-03-28 09:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:53 [auto1.it] INFO: Channel: 24h | Page: 42 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: LY23963
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY23963%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for LY23963: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: AG78775
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: SY65620
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: WK43890
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK43890%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for WK43890: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: WL49427
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: ZN97405
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN97405%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for ZN97405: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: ET23172
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: PM46324
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM46324%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for PM46324: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: VG33831
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: MX95744
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX95744%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for MX95744: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: NA15959
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA15959%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for NA15959: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: UZ16276
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ16276%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for UZ16276: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: PX43587
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: AL00602
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL00602%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for AL00602: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: UY92824
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: WK45429
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK45429%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for WK45429: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: VV53069
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV53069%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for VV53069: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: PR60258
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR60258%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for PR60258: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: SM48224
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: CR59099
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: GL14484
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: WX74031
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX74031%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for WX74031: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: EU31713
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU31713%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for EU31713: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: PC08204
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC08204%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for PC08204: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: ZR26877
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR26877%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for ZR26877: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: TE47770
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: YG22381
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG22381%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for YG22381: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: DD82932
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: DM50235
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: MB79295
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: CV31826
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: FN50437
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN50437%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for FN50437: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: TT40811
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT40811%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for TT40811: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: FJ28833
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: SE98453
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE98453%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for SE98453: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: FL86177
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL86177%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for FL86177: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: MY86461
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY86461%27 HTTP/1.1" 200 None
2026-03-28 09:02:53 [auto1.it] INFO: Scrape type for MY86461: 0
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: LK58538
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: FW75708
2026-03-28 09:02:53 [auto1.it] INFO: Found listing with ID: GD10861
2026-03-28 09:02:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:54 [auto1.it] INFO: Channel: 24h | Page: 43 | totalHits: 3432 | hits on page: 40
2026-03-28 09:02:54 [auto1.it] INFO: Found listing with ID: AK03087
2026-03-28 09:02:54 [auto1.it] INFO: Found listing with ID: YR57836
2026-03-28 09:02:54 [auto1.it] INFO: Found listing with ID: PG69146
2026-03-28 09:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG69146%27 HTTP/1.1" 200 None
2026-03-28 09:02:54 [auto1.it] INFO: Scrape type for PG69146: 0
2026-03-28 09:02:54 [auto1.it] INFO: Found listing with ID: VY17663
2026-03-28 09:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY17663%27 HTTP/1.1" 200 None
2026-03-28 09:02:54 [auto1.it] INFO: Scrape type for VY17663: 2
2026-03-28 09:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d88df7ae-ca90-52d5-9c05-95352756cb25 with identifier: VY17663
2026-03-28 09:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d88df7ae-ca90-52d5-9c05-95352756cb25 with scrape type 2
2026-03-28 09:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d88df7ae-ca90-52d5-9c05-95352756cb25 with scrape type 2
2026-03-28 09:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d88df7ae-ca90-52d5-9c05-95352756cb25, identifier: VY17663
2026-03-28 09:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d88df7ae-ca90-52d5-9c05-95352756cb25 with identifier: VY17663
2026-03-28 09:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d88df7ae-ca90-52d5-9c05-95352756cb25 with identifier: VY17663
2026-03-28 09:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d88df7ae-ca90-52d5-9c05-95352756cb25 with identifier: VY17663 to the API
2026-03-28 09:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:28:23Z',
 'fuel_type': 'diesel',
 'id': 'd88df7ae-ca90-52d5-9c05-95352756cb25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY17663',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 242360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI GTD',
 'transmission': 'manual',
 'trim': 'GTD',
 'year': 2011}
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY17663%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Saving data for VY17663: {'auction_closing_time': 1774715303.0, 'created_time': 1772780969.212896, 'last_price_update_time': 1774688575.09457}
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VY17663') HTTP/1.1" 204 0
2026-03-28 09:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: PW49149
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: SN43721
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN43721%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for SN43721: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: DB80555
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB80555%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for DB80555: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: KL59990
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: YG69242
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG69242%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for YG69242: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: UU42512
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU42512%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for UU42512: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: ZY88816
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: KY93059
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY93059%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for KY93059: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: MS58907
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS58907%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for MS58907: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: BP59545
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP59545%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for BP59545: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: HR68731
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR68731%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for HR68731: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: ZL23627
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: GZ48200
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: ZK34576
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK34576%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for ZK34576: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: TA76256
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: BA18808
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA18808%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for BA18808: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: HX42058
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: CM62235
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: AL31593
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: FZ80781
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: EZ33304
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ33304%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for EZ33304: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: BG88110
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: NH73732
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: WT52400
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT52400%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for WT52400: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: PP13796
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: PE82748
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE82748%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for PE82748: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: RD42515
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: RB40748
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB40748%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for RB40748: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: WK11111
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: NR02013
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: DP25317
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP25317%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for DP25317: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: RB41794
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB41794%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for RB41794: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: PV17909
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: FR96632
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR96632%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for FR96632: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: ZK68739
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK68739%27 HTTP/1.1" 200 None
2026-03-28 09:02:55 [auto1.it] INFO: Scrape type for ZK68739: 0
2026-03-28 09:02:55 [auto1.it] INFO: Found listing with ID: JV47316
2026-03-28 09:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:02:56 [auto1.it] INFO: Channel: 24h | Page: 44 | totalHits: 3433 | hits on page: 40
2026-03-28 09:02:56 [auto1.it] INFO: Found listing with ID: JV47316
2026-03-28 09:02:56 [auto1.it] INFO: Found listing with ID: VU35787
2026-03-28 09:02:56 [auto1.it] INFO: Found listing with ID: CZ70189
2026-03-28 09:02:56 [auto1.it] INFO: Found listing with ID: MD89845
2026-03-28 09:02:56 [auto1.it] INFO: Found listing with ID: JY72806
2026-03-28 09:02:56 [auto1.it] INFO: Found listing with ID: WS96553
2026-03-28 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS96553%27 HTTP/1.1" 200 None
2026-03-28 09:02:56 [auto1.it] INFO: Scrape type for WS96553: 0
2026-03-28 09:02:56 [auto1.it] INFO: Found listing with ID: FE23339
2026-03-28 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE23339%27 HTTP/1.1" 200 None
2026-03-28 09:02:56 [auto1.it] INFO: Scrape type for FE23339: 0
2026-03-28 09:02:56 [auto1.it] INFO: Found listing with ID: PC30910
2026-03-28 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC30910%27 HTTP/1.1" 200 None
2026-03-28 09:02:56 [auto1.it] INFO: Scrape type for PC30910: 0
2026-03-28 09:02:56 [auto1.it] INFO: Found listing with ID: EG37801
2026-03-28 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG37801%27 HTTP/1.1" 200 None
2026-03-28 09:02:56 [auto1.it] INFO: Scrape type for EG37801: 0
2026-03-28 09:02:56 [auto1.it] INFO: Found listing with ID: CS73145
2026-03-28 09:02:56 [auto1.it] INFO: Found listing with ID: MB91559
2026-03-28 09:02:56 [auto1.it] INFO: Found listing with ID: JE32624
2026-03-28 09:02:56 [auto1.it] INFO: Found listing with ID: SX13991
2026-03-28 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX13991%27 HTTP/1.1" 200 None
2026-03-28 09:02:56 [auto1.it] INFO: Scrape type for SX13991: 0
2026-03-28 09:02:56 [auto1.it] INFO: Found listing with ID: JD24635
2026-03-28 09:02:56 [auto1.it] INFO: Found listing with ID: NK12319
2026-03-28 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK12319%27 HTTP/1.1" 200 None
2026-03-28 09:02:56 [auto1.it] INFO: Scrape type for NK12319: 2
2026-03-28 09:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ede521e0-04fe-59ba-ac32-d9058db689ff with identifier: NK12319
2026-03-28 09:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ede521e0-04fe-59ba-ac32-d9058db689ff with scrape type 2
2026-03-28 09:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ede521e0-04fe-59ba-ac32-d9058db689ff with scrape type 2
2026-03-28 09:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ede521e0-04fe-59ba-ac32-d9058db689ff, identifier: NK12319
2026-03-28 09:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ede521e0-04fe-59ba-ac32-d9058db689ff with identifier: NK12319
2026-03-28 09:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ede521e0-04fe-59ba-ac32-d9058db689ff with identifier: NK12319
2026-03-28 09:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ede521e0-04fe-59ba-ac32-d9058db689ff with identifier: NK12319 to the API
2026-03-28 09:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:47:32Z',
 'fuel_type': 'diesel',
 'id': 'ede521e0-04fe-59ba-ac32-d9058db689ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK12319',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 83186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-21',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-28 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK12319%27 HTTP/1.1" 200 None
2026-03-28 09:02:56 [auto1.it] INFO: Saving data for NK12319: {'auction_closing_time': 1774716452.0, 'created_time': 1774472744.037882, 'last_price_update_time': 1774688576.988295}
2026-03-28 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NK12319') HTTP/1.1" 204 0
2026-03-28 09:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: EV42289
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV42289%27 HTTP/1.1" 200 None
2026-03-28 09:02:57 [auto1.it] INFO: Scrape type for EV42289: 0
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: FH21751
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: LL47627
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL47627%27 HTTP/1.1" 200 None
2026-03-28 09:02:57 [auto1.it] INFO: Scrape type for LL47627: 0
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: AK61800
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: FU99331
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: ZJ09783
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: GF05972
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: KU92785
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: FD98463
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: UM22430
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM22430%27 HTTP/1.1" 200 None
2026-03-28 09:02:57 [auto1.it] INFO: Scrape type for UM22430: 0
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: DT48563
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT48563%27 HTTP/1.1" 200 None
2026-03-28 09:02:57 [auto1.it] INFO: Scrape type for DT48563: 2
2026-03-28 09:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e780784-d3d9-5ce5-96a4-a924737223e1 with identifier: DT48563
2026-03-28 09:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e780784-d3d9-5ce5-96a4-a924737223e1 with scrape type 2
2026-03-28 09:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e780784-d3d9-5ce5-96a4-a924737223e1 with scrape type 2
2026-03-28 09:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1e780784-d3d9-5ce5-96a4-a924737223e1, identifier: DT48563
2026-03-28 09:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1e780784-d3d9-5ce5-96a4-a924737223e1 with identifier: DT48563
2026-03-28 09:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1e780784-d3d9-5ce5-96a4-a924737223e1 with identifier: DT48563
2026-03-28 09:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1e780784-d3d9-5ce5-96a4-a924737223e1 with identifier: DT48563 to the API
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:48:39Z',
 'fuel_type': 'petrol',
 'id': '1e780784-d3d9-5ce5-96a4-a924737223e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT48563',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Alfa 147',
 'odometer': 138274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-21',
 'seller_name': None,
 'title': 'Alfa Romeo Alfa 147 1.6 TS Distinctive',
 'transmission': 'manual',
 'trim': 'TS Distinctive',
 'year': 2007}
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT48563%27 HTTP/1.1" 200 None
2026-03-28 09:02:57 [auto1.it] INFO: Saving data for DT48563: {'auction_closing_time': 1774716519.0, 'created_time': 1773137898.864781, 'last_price_update_time': 1774688577.797674}
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DT48563') HTTP/1.1" 204 0
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: LN31957
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN31957%27 HTTP/1.1" 200 None
2026-03-28 09:02:57 [auto1.it] INFO: Scrape type for LN31957: 0
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: XD93142
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: XJ13084
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: WX11793
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: JF99545
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: ST52943
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: SV47237
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: JS59612
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS59612%27 HTTP/1.1" 200 None
2026-03-28 09:02:57 [auto1.it] INFO: Scrape type for JS59612: 0
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: JC86695
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC86695%27 HTTP/1.1" 200 None
2026-03-28 09:02:57 [auto1.it] INFO: Scrape type for JC86695: 0
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: HU75847
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU75847%27 HTTP/1.1" 200 None
2026-03-28 09:02:57 [auto1.it] INFO: Scrape type for HU75847: 0
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: SS52204
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: NF28136
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF28136%27 HTTP/1.1" 200 None
2026-03-28 09:02:57 [auto1.it] INFO: Scrape type for NF28136: 0
2026-03-28 09:02:57 [auto1.it] INFO: Found listing with ID: AX14141
2026-03-28 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX14141%27 HTTP/1.1" 200 None
2026-03-28 09:02:58 [auto1.it] INFO: Scrape type for AX14141: 0
2026-03-28 09:02:58 [auto1.it] INFO: Found listing with ID: AM53032
2026-03-28 09:03:05 [scrapy.extensions.logstats] INFO: Crawled 130 pages (at 21 pages/min), scraped 141 items (at 37 items/min)
2026-03-28 09:03:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 190MiB
2026-03-28 09:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:14 [auto1.it] INFO: Channel: 24h | Page: 45 | totalHits: 3433 | hits on page: 40
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: MY48140
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: MK51639
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: TP30919
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: AA66716
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: PZ55071
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: HX67406
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: LT18779
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: KZ33139
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: EC20535
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC20535%27 HTTP/1.1" 200 None
2026-03-28 09:03:14 [auto1.it] INFO: Scrape type for EC20535: 0
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: PG53512
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: ZB38211
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB38211%27 HTTP/1.1" 200 None
2026-03-28 09:03:14 [auto1.it] INFO: Scrape type for ZB38211: 0
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: GX99306
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX99306%27 HTTP/1.1" 200 None
2026-03-28 09:03:14 [auto1.it] INFO: Scrape type for GX99306: 0
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: DX18897
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: DA44533
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: YW84907
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: TZ66413
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: HE47711
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: WD11743
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: AE90071
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: YJ19643
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ19643%27 HTTP/1.1" 200 None
2026-03-28 09:03:14 [auto1.it] INFO: Scrape type for YJ19643: 0
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: TH56934
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: AH91466
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH91466%27 HTTP/1.1" 200 None
2026-03-28 09:03:14 [auto1.it] INFO: Scrape type for AH91466: 0
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: NE50995
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE50995%27 HTTP/1.1" 200 None
2026-03-28 09:03:14 [auto1.it] INFO: Scrape type for NE50995: 0
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: AU71506
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: NX21307
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX21307%27 HTTP/1.1" 200 None
2026-03-28 09:03:14 [auto1.it] INFO: Scrape type for NX21307: 0
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: KW35256
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: DL15591
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL15591%27 HTTP/1.1" 200 None
2026-03-28 09:03:14 [auto1.it] INFO: Scrape type for DL15591: 0
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: SF57726
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF57726%27 HTTP/1.1" 200 None
2026-03-28 09:03:14 [auto1.it] INFO: Scrape type for SF57726: 0
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: MU47199
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU47199%27 HTTP/1.1" 200 None
2026-03-28 09:03:14 [auto1.it] INFO: Scrape type for MU47199: 0
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: YZ06179
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: TU42208
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: KJ92535
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ92535%27 HTTP/1.1" 200 None
2026-03-28 09:03:14 [auto1.it] INFO: Scrape type for KJ92535: 0
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: KV45254
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: FU36287
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU36287%27 HTTP/1.1" 200 None
2026-03-28 09:03:14 [auto1.it] INFO: Scrape type for FU36287: 0
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: WL38186
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: HW99269
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: WS00889
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: RK73921
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: HC70741
2026-03-28 09:03:14 [auto1.it] INFO: Found listing with ID: YY30219
2026-03-28 09:03:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:15 [auto1.it] INFO: Channel: 24h | Page: 46 | totalHits: 3433 | hits on page: 40
2026-03-28 09:03:15 [auto1.it] INFO: Found listing with ID: TD76554
2026-03-28 09:03:15 [auto1.it] INFO: Found listing with ID: VM87489
2026-03-28 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM87489%27 HTTP/1.1" 200 None
2026-03-28 09:03:15 [auto1.it] INFO: Scrape type for VM87489: 0
2026-03-28 09:03:15 [auto1.it] INFO: Found listing with ID: AC54661
2026-03-28 09:03:15 [auto1.it] INFO: Found listing with ID: PP18921
2026-03-28 09:03:15 [auto1.it] INFO: Found listing with ID: PV19108
2026-03-28 09:03:15 [auto1.it] INFO: Found listing with ID: FF63562
2026-03-28 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF63562%27 HTTP/1.1" 200 None
2026-03-28 09:03:15 [auto1.it] INFO: Scrape type for FF63562: 0
2026-03-28 09:03:15 [auto1.it] INFO: Found listing with ID: AV53481
2026-03-28 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV53481%27 HTTP/1.1" 200 None
2026-03-28 09:03:15 [auto1.it] INFO: Scrape type for AV53481: 0
2026-03-28 09:03:15 [auto1.it] INFO: Found listing with ID: CB62098
2026-03-28 09:03:15 [auto1.it] INFO: Found listing with ID: KS79524
2026-03-28 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS79524%27 HTTP/1.1" 200 None
2026-03-28 09:03:15 [auto1.it] INFO: Scrape type for KS79524: 0
2026-03-28 09:03:15 [auto1.it] INFO: Found listing with ID: HM03162
2026-03-28 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM03162%27 HTTP/1.1" 200 None
2026-03-28 09:03:15 [auto1.it] INFO: Scrape type for HM03162: 0
2026-03-28 09:03:15 [auto1.it] INFO: Found listing with ID: FT78551
2026-03-28 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT78551%27 HTTP/1.1" 200 None
2026-03-28 09:03:15 [auto1.it] INFO: Scrape type for FT78551: 0
2026-03-28 09:03:15 [auto1.it] INFO: Found listing with ID: SD84714
2026-03-28 09:03:15 [auto1.it] INFO: Found listing with ID: KE13415
2026-03-28 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE13415%27 HTTP/1.1" 200 None
2026-03-28 09:03:15 [auto1.it] INFO: Scrape type for KE13415: 0
2026-03-28 09:03:15 [auto1.it] INFO: Found listing with ID: TZ72536
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ72536%27 HTTP/1.1" 200 None
2026-03-28 09:03:16 [auto1.it] INFO: Scrape type for TZ72536: 0
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: SV52525
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV52525%27 HTTP/1.1" 200 None
2026-03-28 09:03:16 [auto1.it] INFO: Scrape type for SV52525: 0
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: UH63202
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH63202%27 HTTP/1.1" 200 None
2026-03-28 09:03:16 [auto1.it] INFO: Scrape type for UH63202: 0
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: YA96146
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA96146%27 HTTP/1.1" 200 None
2026-03-28 09:03:16 [auto1.it] INFO: Scrape type for YA96146: 0
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: SH06277
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: UR19142
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: WK82863
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK82863%27 HTTP/1.1" 200 None
2026-03-28 09:03:16 [auto1.it] INFO: Scrape type for WK82863: 0
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: XJ75320
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ75320%27 HTTP/1.1" 200 None
2026-03-28 09:03:16 [auto1.it] INFO: Scrape type for XJ75320: 0
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: JU95085
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU95085%27 HTTP/1.1" 200 None
2026-03-28 09:03:16 [auto1.it] INFO: Scrape type for JU95085: 0
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: NJ20872
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ20872%27 HTTP/1.1" 200 None
2026-03-28 09:03:16 [auto1.it] INFO: Scrape type for NJ20872: 0
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: VE89845
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: RJ89863
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ89863%27 HTTP/1.1" 200 None
2026-03-28 09:03:16 [auto1.it] INFO: Scrape type for RJ89863: 0
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: VN35608
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN35608%27 HTTP/1.1" 200 None
2026-03-28 09:03:16 [auto1.it] INFO: Scrape type for VN35608: 0
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: US42109
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US42109%27 HTTP/1.1" 200 None
2026-03-28 09:03:16 [auto1.it] INFO: Scrape type for US42109: 0
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: JL30882
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL30882%27 HTTP/1.1" 200 None
2026-03-28 09:03:16 [auto1.it] INFO: Scrape type for JL30882: 0
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: AP78180
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP78180%27 HTTP/1.1" 200 None
2026-03-28 09:03:16 [auto1.it] INFO: Scrape type for AP78180: 0
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: DC69304
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC69304%27 HTTP/1.1" 200 None
2026-03-28 09:03:16 [auto1.it] INFO: Scrape type for DC69304: 0
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: JE58875
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: GC49019
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC49019%27 HTTP/1.1" 200 None
2026-03-28 09:03:16 [auto1.it] INFO: Scrape type for GC49019: 0
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: ZJ87043
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: BZ19379
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: MG94028
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: NG57771
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: LT57228
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: CF86558
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: JN49587
2026-03-28 09:03:16 [auto1.it] INFO: Found listing with ID: PG13965
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG13965%27 HTTP/1.1" 200 None
2026-03-28 09:03:16 [auto1.it] INFO: Scrape type for PG13965: 2
2026-03-28 09:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9e221e0-5eca-5b2a-b9fe-6ae51463a323 with identifier: PG13965
2026-03-28 09:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9e221e0-5eca-5b2a-b9fe-6ae51463a323 with scrape type 2
2026-03-28 09:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9e221e0-5eca-5b2a-b9fe-6ae51463a323 with scrape type 2
2026-03-28 09:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c9e221e0-5eca-5b2a-b9fe-6ae51463a323, identifier: PG13965
2026-03-28 09:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c9e221e0-5eca-5b2a-b9fe-6ae51463a323 with identifier: PG13965
2026-03-28 09:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c9e221e0-5eca-5b2a-b9fe-6ae51463a323 with identifier: PG13965
2026-03-28 09:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c9e221e0-5eca-5b2a-b9fe-6ae51463a323 with identifier: PG13965 to the API
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:49:29Z',
 'fuel_type': 'diesel',
 'id': 'c9e221e0-5eca-5b2a-b9fe-6ae51463a323',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG13965',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 216576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-28',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Elective',
 'transmission': 'manual',
 'trim': 'Elective',
 'year': 2012}
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG13965%27 HTTP/1.1" 200 None
2026-03-28 09:03:16 [auto1.it] INFO: Saving data for PG13965: {'auction_closing_time': 1774716569.0, 'created_time': 1773270025.616795, 'last_price_update_time': 1774688596.760526}
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PG13965') HTTP/1.1" 204 0
2026-03-28 09:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:17 [auto1.it] INFO: Channel: 24h | Page: 47 | totalHits: 3433 | hits on page: 40
2026-03-28 09:03:17 [auto1.it] INFO: Found listing with ID: NL47700
2026-03-28 09:03:17 [auto1.it] INFO: Found listing with ID: JU28739
2026-03-28 09:03:17 [auto1.it] INFO: Found listing with ID: ZC80598
2026-03-28 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC80598%27 HTTP/1.1" 200 None
2026-03-28 09:03:17 [auto1.it] INFO: Scrape type for ZC80598: 0
2026-03-28 09:03:17 [auto1.it] INFO: Found listing with ID: YW38439
2026-03-28 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW38439%27 HTTP/1.1" 200 None
2026-03-28 09:03:17 [auto1.it] INFO: Scrape type for YW38439: 0
2026-03-28 09:03:17 [auto1.it] INFO: Found listing with ID: ZT67877
2026-03-28 09:03:17 [auto1.it] INFO: Found listing with ID: HT64034
2026-03-28 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT64034%27 HTTP/1.1" 200 None
2026-03-28 09:03:17 [auto1.it] INFO: Scrape type for HT64034: 0
2026-03-28 09:03:17 [auto1.it] INFO: Found listing with ID: RV54155
2026-03-28 09:03:17 [auto1.it] INFO: Found listing with ID: FH96840
2026-03-28 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH96840%27 HTTP/1.1" 200 None
2026-03-28 09:03:17 [auto1.it] INFO: Scrape type for FH96840: 0
2026-03-28 09:03:17 [auto1.it] INFO: Found listing with ID: EF61328
2026-03-28 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF61328%27 HTTP/1.1" 200 None
2026-03-28 09:03:17 [auto1.it] INFO: Scrape type for EF61328: 0
2026-03-28 09:03:17 [auto1.it] INFO: Found listing with ID: JK09197
2026-03-28 09:03:17 [auto1.it] INFO: Found listing with ID: YE07599
2026-03-28 09:03:17 [auto1.it] INFO: Found listing with ID: WH56731
2026-03-28 09:03:17 [auto1.it] INFO: Found listing with ID: ST27095
2026-03-28 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST27095%27 HTTP/1.1" 200 None
2026-03-28 09:03:17 [auto1.it] INFO: Scrape type for ST27095: 0
2026-03-28 09:03:17 [auto1.it] INFO: Found listing with ID: LA78712
2026-03-28 09:03:17 [auto1.it] INFO: Found listing with ID: FA49150
2026-03-28 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA49150%27 HTTP/1.1" 200 None
2026-03-28 09:03:18 [auto1.it] INFO: Scrape type for FA49150: 0
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: BG04687
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: TJ80617
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ80617%27 HTTP/1.1" 200 None
2026-03-28 09:03:18 [auto1.it] INFO: Scrape type for TJ80617: 0
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: MG40784
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG40784%27 HTTP/1.1" 200 None
2026-03-28 09:03:18 [auto1.it] INFO: Scrape type for MG40784: 0
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: SN49105
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: SK14741
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK14741%27 HTTP/1.1" 200 None
2026-03-28 09:03:18 [auto1.it] INFO: Scrape type for SK14741: 0
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: VB21565
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB21565%27 HTTP/1.1" 200 None
2026-03-28 09:03:18 [auto1.it] INFO: Scrape type for VB21565: 0
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: LC83851
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: HL58093
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL58093%27 HTTP/1.1" 200 None
2026-03-28 09:03:18 [auto1.it] INFO: Scrape type for HL58093: 0
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: KC12001
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC12001%27 HTTP/1.1" 200 None
2026-03-28 09:03:18 [auto1.it] INFO: Scrape type for KC12001: 0
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: BF03826
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: CT12062
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: WH54468
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH54468%27 HTTP/1.1" 200 None
2026-03-28 09:03:18 [auto1.it] INFO: Scrape type for WH54468: 0
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: LK23524
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: WS49358
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS49358%27 HTTP/1.1" 200 None
2026-03-28 09:03:18 [auto1.it] INFO: Scrape type for WS49358: 0
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: ED17590
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED17590%27 HTTP/1.1" 200 None
2026-03-28 09:03:18 [auto1.it] INFO: Scrape type for ED17590: 0
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: FB83790
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: FP39081
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP39081%27 HTTP/1.1" 200 None
2026-03-28 09:03:18 [auto1.it] INFO: Scrape type for FP39081: 0
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: KC49805
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: DU03202
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: HK89247
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: CW79165
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW79165%27 HTTP/1.1" 200 None
2026-03-28 09:03:18 [auto1.it] INFO: Scrape type for CW79165: 0
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: JE99705
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE99705%27 HTTP/1.1" 200 None
2026-03-28 09:03:18 [auto1.it] INFO: Scrape type for JE99705: 0
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: LU55329
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU55329%27 HTTP/1.1" 200 None
2026-03-28 09:03:18 [auto1.it] INFO: Scrape type for LU55329: 0
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: YD85432
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD85432%27 HTTP/1.1" 200 None
2026-03-28 09:03:18 [auto1.it] INFO: Scrape type for YD85432: 0
2026-03-28 09:03:18 [auto1.it] INFO: Found listing with ID: GJ95983
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ95983%27 HTTP/1.1" 200 None
2026-03-28 09:03:18 [auto1.it] INFO: Scrape type for GJ95983: 0
2026-03-28 09:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:22 [auto1.it] INFO: Channel: 24h | Page: 48 | totalHits: 3433 | hits on page: 40
2026-03-28 09:03:22 [auto1.it] INFO: Found listing with ID: SP63067
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP63067%27 HTTP/1.1" 200 None
2026-03-28 09:03:22 [auto1.it] INFO: Scrape type for SP63067: 0
2026-03-28 09:03:22 [auto1.it] INFO: Found listing with ID: KJ50164
2026-03-28 09:03:22 [auto1.it] INFO: Found listing with ID: VU48365
2026-03-28 09:03:22 [auto1.it] INFO: Found listing with ID: RS99601
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS99601%27 HTTP/1.1" 200 None
2026-03-28 09:03:22 [auto1.it] INFO: Scrape type for RS99601: 0
2026-03-28 09:03:22 [auto1.it] INFO: Found listing with ID: HS43445
2026-03-28 09:03:22 [auto1.it] INFO: Found listing with ID: KL91026
2026-03-28 09:03:22 [auto1.it] INFO: Found listing with ID: KP30696
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP30696%27 HTTP/1.1" 200 None
2026-03-28 09:03:22 [auto1.it] INFO: Scrape type for KP30696: 0
2026-03-28 09:03:22 [auto1.it] INFO: Found listing with ID: LL54959
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL54959%27 HTTP/1.1" 200 None
2026-03-28 09:03:22 [auto1.it] INFO: Scrape type for LL54959: 0
2026-03-28 09:03:22 [auto1.it] INFO: Found listing with ID: MX03417
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX03417%27 HTTP/1.1" 200 None
2026-03-28 09:03:22 [auto1.it] INFO: Scrape type for MX03417: 0
2026-03-28 09:03:22 [auto1.it] INFO: Found listing with ID: HY79670
2026-03-28 09:03:22 [auto1.it] INFO: Found listing with ID: BC39052
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC39052%27 HTTP/1.1" 200 None
2026-03-28 09:03:22 [auto1.it] INFO: Scrape type for BC39052: 0
2026-03-28 09:03:22 [auto1.it] INFO: Found listing with ID: TR00137
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR00137%27 HTTP/1.1" 200 None
2026-03-28 09:03:22 [auto1.it] INFO: Scrape type for TR00137: 0
2026-03-28 09:03:22 [auto1.it] INFO: Found listing with ID: WU76177
2026-03-28 09:03:22 [auto1.it] INFO: Found listing with ID: DF56056
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF56056%27 HTTP/1.1" 200 None
2026-03-28 09:03:22 [auto1.it] INFO: Scrape type for DF56056: 0
2026-03-28 09:03:22 [auto1.it] INFO: Found listing with ID: YV46524
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV46524%27 HTTP/1.1" 200 None
2026-03-28 09:03:22 [auto1.it] INFO: Scrape type for YV46524: 0
2026-03-28 09:03:22 [auto1.it] INFO: Found listing with ID: GJ72408
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ72408%27 HTTP/1.1" 200 None
2026-03-28 09:03:22 [auto1.it] INFO: Scrape type for GJ72408: 0
2026-03-28 09:03:22 [auto1.it] INFO: Found listing with ID: ZR61375
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR61375%27 HTTP/1.1" 200 None
2026-03-28 09:03:22 [auto1.it] INFO: Scrape type for ZR61375: 2
2026-03-28 09:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23bfa484-ac20-57f3-8d1c-668aa7213add with identifier: ZR61375
2026-03-28 09:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23bfa484-ac20-57f3-8d1c-668aa7213add with scrape type 2
2026-03-28 09:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23bfa484-ac20-57f3-8d1c-668aa7213add with scrape type 2
2026-03-28 09:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 23bfa484-ac20-57f3-8d1c-668aa7213add, identifier: ZR61375
2026-03-28 09:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 23bfa484-ac20-57f3-8d1c-668aa7213add with identifier: ZR61375
2026-03-28 09:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 23bfa484-ac20-57f3-8d1c-668aa7213add with identifier: ZR61375
2026-03-28 09:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 23bfa484-ac20-57f3-8d1c-668aa7213add with identifier: ZR61375 to the API
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:18:03Z',
 'fuel_type': 'diesel',
 'id': '23bfa484-ac20-57f3-8d1c-668aa7213add',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR61375',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 80026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-24',
 'seller_name': None,
 'title': 'Fiat 500L 1.3 M-Jet Cross',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2017}
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR61375%27 HTTP/1.1" 200 None
2026-03-28 09:03:22 [auto1.it] INFO: Saving data for ZR61375: {'auction_closing_time': 1774714683.0, 'created_time': 1774472818.712591, 'last_price_update_time': 1774688602.943483}
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZR61375') HTTP/1.1" 204 0
2026-03-28 09:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: GT16147
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: EL74502
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL74502%27 HTTP/1.1" 200 None
2026-03-28 09:03:23 [auto1.it] INFO: Scrape type for EL74502: 0
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: ZB49687
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: HH94865
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: PT71441
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: TT80777
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT80777%27 HTTP/1.1" 200 None
2026-03-28 09:03:23 [auto1.it] INFO: Scrape type for TT80777: 0
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: XX06910
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: ZN78264
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: HS52325
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: HL91811
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL91811%27 HTTP/1.1" 200 None
2026-03-28 09:03:23 [auto1.it] INFO: Scrape type for HL91811: 0
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: FS39333
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: NT76067
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT76067%27 HTTP/1.1" 200 None
2026-03-28 09:03:23 [auto1.it] INFO: Scrape type for NT76067: 0
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: EN82101
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN82101%27 HTTP/1.1" 200 None
2026-03-28 09:03:23 [auto1.it] INFO: Scrape type for EN82101: 0
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: TU90316
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU90316%27 HTTP/1.1" 200 None
2026-03-28 09:03:23 [auto1.it] INFO: Scrape type for TU90316: 2
2026-03-28 09:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47c26806-e8f8-50aa-80bd-9d78435787a7 with identifier: TU90316
2026-03-28 09:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47c26806-e8f8-50aa-80bd-9d78435787a7 with scrape type 2
2026-03-28 09:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47c26806-e8f8-50aa-80bd-9d78435787a7 with scrape type 2
2026-03-28 09:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 47c26806-e8f8-50aa-80bd-9d78435787a7, identifier: TU90316
2026-03-28 09:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 47c26806-e8f8-50aa-80bd-9d78435787a7 with identifier: TU90316
2026-03-28 09:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 47c26806-e8f8-50aa-80bd-9d78435787a7 with identifier: TU90316
2026-03-28 09:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 47c26806-e8f8-50aa-80bd-9d78435787a7 with identifier: TU90316 to the API
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:03:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:13:24Z',
 'fuel_type': 'diesel',
 'id': '47c26806-e8f8-50aa-80bd-9d78435787a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU90316',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 166400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-24',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2016}
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU90316%27 HTTP/1.1" 200 None
2026-03-28 09:03:23 [auto1.it] INFO: Saving data for TU90316: {'auction_closing_time': 1774714404.0, 'created_time': 1774472583.275457, 'last_price_update_time': 1774688603.554749}
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TU90316') HTTP/1.1" 204 0
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: CF98226
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF98226%27 HTTP/1.1" 200 None
2026-03-28 09:03:23 [auto1.it] INFO: Scrape type for CF98226: 0
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: PZ28359
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ28359%27 HTTP/1.1" 200 None
2026-03-28 09:03:23 [auto1.it] INFO: Scrape type for PZ28359: 0
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: TY75037
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: HY43750
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY43750%27 HTTP/1.1" 200 None
2026-03-28 09:03:23 [auto1.it] INFO: Scrape type for HY43750: 0
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: JV69341
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV69341%27 HTTP/1.1" 200 None
2026-03-28 09:03:23 [auto1.it] INFO: Scrape type for JV69341: 0
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: HZ77474
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ77474%27 HTTP/1.1" 200 None
2026-03-28 09:03:23 [auto1.it] INFO: Scrape type for HZ77474: 0
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: TN35413
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: KD77242
2026-03-28 09:03:23 [auto1.it] INFO: Found listing with ID: UD21419
2026-03-28 09:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:24 [auto1.it] INFO: Channel: 24h | Page: 49 | totalHits: 3433 | hits on page: 40
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: MD54154
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: DS64702
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS64702%27 HTTP/1.1" 200 None
2026-03-28 09:03:24 [auto1.it] INFO: Scrape type for DS64702: 0
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: RU70753
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: FB74710
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: FB96198
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB96198%27 HTTP/1.1" 200 None
2026-03-28 09:03:24 [auto1.it] INFO: Scrape type for FB96198: 0
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: NN66692
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: YS70370
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: YJ87795
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ87795%27 HTTP/1.1" 200 None
2026-03-28 09:03:24 [auto1.it] INFO: Scrape type for YJ87795: 0
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: MR40406
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: WA35829
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: HF95426
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: FB12726
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB12726%27 HTTP/1.1" 200 None
2026-03-28 09:03:24 [auto1.it] INFO: Scrape type for FB12726: 0
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: YT69462
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: UU91583
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: XU63603
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: EK49781
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK49781%27 HTTP/1.1" 200 None
2026-03-28 09:03:24 [auto1.it] INFO: Scrape type for EK49781: 0
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: MT13401
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: YT05499
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT05499%27 HTTP/1.1" 200 None
2026-03-28 09:03:24 [auto1.it] INFO: Scrape type for YT05499: 0
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: ZR58855
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: VV47439
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV47439%27 HTTP/1.1" 200 None
2026-03-28 09:03:24 [auto1.it] INFO: Scrape type for VV47439: 0
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: NF80846
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: SJ84275
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ84275%27 HTTP/1.1" 200 None
2026-03-28 09:03:24 [auto1.it] INFO: Scrape type for SJ84275: 0
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: HY53959
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY53959%27 HTTP/1.1" 200 None
2026-03-28 09:03:24 [auto1.it] INFO: Scrape type for HY53959: 0
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: ME40395
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: WB22440
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: ZU26854
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU26854%27 HTTP/1.1" 200 None
2026-03-28 09:03:24 [auto1.it] INFO: Scrape type for ZU26854: 0
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: JJ73686
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ73686%27 HTTP/1.1" 200 None
2026-03-28 09:03:24 [auto1.it] INFO: Scrape type for JJ73686: 0
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: ZZ72466
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ72466%27 HTTP/1.1" 200 None
2026-03-28 09:03:24 [auto1.it] INFO: Scrape type for ZZ72466: 0
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: PZ93737
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: EU94181
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: MP71804
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP71804%27 HTTP/1.1" 200 None
2026-03-28 09:03:24 [auto1.it] INFO: Scrape type for MP71804: 0
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: VM11321
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: SC36800
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: JR97776
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: TD68261
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD68261%27 HTTP/1.1" 200 None
2026-03-28 09:03:24 [auto1.it] INFO: Scrape type for TD68261: 0
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: BX49691
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: RZ83260
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: XW05686
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: XW18282
2026-03-28 09:03:24 [auto1.it] INFO: Found listing with ID: TZ10866
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ10866%27 HTTP/1.1" 200 None
2026-03-28 09:03:24 [auto1.it] INFO: Scrape type for TZ10866: 0
2026-03-28 09:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:26 [auto1.it] INFO: Channel: 24h | Page: 50 | totalHits: 3433 | hits on page: 40
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: KZ85828
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: BN48518
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN48518%27 HTTP/1.1" 200 None
2026-03-28 09:03:26 [auto1.it] INFO: Scrape type for BN48518: 0
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: UV86108
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: RM97748
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: BG14963
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: KF47739
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: KD47428
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: MN95731
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: BV54558
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: ZD60941
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD60941%27 HTTP/1.1" 200 None
2026-03-28 09:03:26 [auto1.it] INFO: Scrape type for ZD60941: 2
2026-03-28 09:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf2aa9ce-bcfe-5aec-b455-5ef29631c1c8 with identifier: ZD60941
2026-03-28 09:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf2aa9ce-bcfe-5aec-b455-5ef29631c1c8 with scrape type 2
2026-03-28 09:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf2aa9ce-bcfe-5aec-b455-5ef29631c1c8 with scrape type 2
2026-03-28 09:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cf2aa9ce-bcfe-5aec-b455-5ef29631c1c8, identifier: ZD60941
2026-03-28 09:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cf2aa9ce-bcfe-5aec-b455-5ef29631c1c8 with identifier: ZD60941
2026-03-28 09:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cf2aa9ce-bcfe-5aec-b455-5ef29631c1c8 with identifier: ZD60941
2026-03-28 09:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cf2aa9ce-bcfe-5aec-b455-5ef29631c1c8 with identifier: ZD60941 to the API
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:30:16Z',
 'fuel_type': 'petrol',
 'id': 'cf2aa9ce-bcfe-5aec-b455-5ef29631c1c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD60941',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 84941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-27',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2020}
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD60941%27 HTTP/1.1" 200 None
2026-03-28 09:03:26 [auto1.it] INFO: Saving data for ZD60941: {'auction_closing_time': 1774715416.0, 'created_time': 1772784521.915332, 'last_price_update_time': 1774688606.747276}
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZD60941') HTTP/1.1" 204 0
2026-03-28 09:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: ZF37954
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF37954%27 HTTP/1.1" 200 None
2026-03-28 09:03:26 [auto1.it] INFO: Scrape type for ZF37954: 0
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: BL12911
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL12911%27 HTTP/1.1" 200 None
2026-03-28 09:03:26 [auto1.it] INFO: Scrape type for BL12911: 0
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: NE73775
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE73775%27 HTTP/1.1" 200 None
2026-03-28 09:03:26 [auto1.it] INFO: Scrape type for NE73775: 0
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: BJ73113
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ73113%27 HTTP/1.1" 200 None
2026-03-28 09:03:26 [auto1.it] INFO: Scrape type for BJ73113: 0
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: UG81579
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: ZD82029
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: NE01926
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: PM63773
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM63773%27 HTTP/1.1" 200 None
2026-03-28 09:03:26 [auto1.it] INFO: Scrape type for PM63773: 0
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: YS46999
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS46999%27 HTTP/1.1" 200 None
2026-03-28 09:03:26 [auto1.it] INFO: Scrape type for YS46999: 0
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: NH03785
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH03785%27 HTTP/1.1" 200 None
2026-03-28 09:03:26 [auto1.it] INFO: Scrape type for NH03785: 0
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: DF59331
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: PB31965
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: BU54586
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: YA22905
2026-03-28 09:03:26 [auto1.it] INFO: Found listing with ID: LT75746
2026-03-28 09:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT75746%27 HTTP/1.1" 200 None
2026-03-28 09:03:27 [auto1.it] INFO: Scrape type for LT75746: 0
2026-03-28 09:03:27 [auto1.it] INFO: Found listing with ID: XC67854
2026-03-28 09:03:27 [auto1.it] INFO: Found listing with ID: HT94696
2026-03-28 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT94696%27 HTTP/1.1" 200 None
2026-03-28 09:03:27 [auto1.it] INFO: Scrape type for HT94696: 0
2026-03-28 09:03:27 [auto1.it] INFO: Found listing with ID: LV20949
2026-03-28 09:03:27 [auto1.it] INFO: Found listing with ID: JM05776
2026-03-28 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM05776%27 HTTP/1.1" 200 None
2026-03-28 09:03:27 [auto1.it] INFO: Scrape type for JM05776: 0
2026-03-28 09:03:27 [auto1.it] INFO: Found listing with ID: RB00475
2026-03-28 09:03:27 [auto1.it] INFO: Found listing with ID: BL94999
2026-03-28 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL94999%27 HTTP/1.1" 200 None
2026-03-28 09:03:27 [auto1.it] INFO: Scrape type for BL94999: 0
2026-03-28 09:03:27 [auto1.it] INFO: Found listing with ID: NL09316
2026-03-28 09:03:27 [auto1.it] INFO: Found listing with ID: TK94629
2026-03-28 09:03:27 [auto1.it] INFO: Found listing with ID: TD66065
2026-03-28 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD66065%27 HTTP/1.1" 200 None
2026-03-28 09:03:27 [auto1.it] INFO: Scrape type for TD66065: 0
2026-03-28 09:03:27 [auto1.it] INFO: Found listing with ID: KZ84746
2026-03-28 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ84746%27 HTTP/1.1" 200 None
2026-03-28 09:03:27 [auto1.it] INFO: Scrape type for KZ84746: 0
2026-03-28 09:03:27 [auto1.it] INFO: Found listing with ID: KU78765
2026-03-28 09:03:27 [auto1.it] INFO: Found listing with ID: SC05628
2026-03-28 09:03:27 [auto1.it] INFO: Found listing with ID: AS40947
2026-03-28 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS40947%27 HTTP/1.1" 200 None
2026-03-28 09:03:27 [auto1.it] INFO: Scrape type for AS40947: 0
2026-03-28 09:03:27 [auto1.it] INFO: Found listing with ID: JK70304
2026-03-28 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK70304%27 HTTP/1.1" 200 None
2026-03-28 09:03:27 [auto1.it] INFO: Scrape type for JK70304: 0
2026-03-28 09:03:27 [auto1.it] INFO: Found listing with ID: ZJ10623
2026-03-28 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ10623%27 HTTP/1.1" 200 None
2026-03-28 09:03:27 [auto1.it] INFO: Scrape type for ZJ10623: 0
2026-03-28 09:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:28 [auto1.it] INFO: Channel: 24h | Page: 51 | totalHits: 3433 | hits on page: 40
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: AY88271
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY88271%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for AY88271: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: FA14531
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA14531%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for FA14531: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: VX65874
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: LY05485
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: UT39332
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT39332%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for UT39332: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: RN93859
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: YB60466
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB60466%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for YB60466: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: YV65594
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: MB50671
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: HB16965
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB16965%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for HB16965: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: LN12916
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: CT16450
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: NT40514
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT40514%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for NT40514: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: XL03216
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL03216%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for XL03216: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: YM68683
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: RS48404
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS48404%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for RS48404: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: FN49181
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN49181%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for FN49181: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: LA93311
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA93311%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for LA93311: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: CL54955
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL54955%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for CL54955: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: KY00124
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: MW20525
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: FM16184
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM16184%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for FM16184: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: BY67467
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY67467%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for BY67467: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: ST73163
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: DV99228
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV99228%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for DV99228: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: UZ46554
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ46554%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for UZ46554: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: KM32276
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM32276%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for KM32276: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: KF21230
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: KJ44926
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: KE56728
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: JN46164
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN46164%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for JN46164: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: NG42330
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG42330%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for NG42330: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: DJ11873
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ11873%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for DJ11873: 0
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: UH02752
2026-03-28 09:03:28 [auto1.it] INFO: Found listing with ID: TA27022
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA27022%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Scrape type for TA27022: 2
2026-03-28 09:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f8ce014-bc9d-5b86-a860-39d510ef77ed with identifier: TA27022
2026-03-28 09:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f8ce014-bc9d-5b86-a860-39d510ef77ed with scrape type 2
2026-03-28 09:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f8ce014-bc9d-5b86-a860-39d510ef77ed with scrape type 2
2026-03-28 09:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9f8ce014-bc9d-5b86-a860-39d510ef77ed, identifier: TA27022
2026-03-28 09:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9f8ce014-bc9d-5b86-a860-39d510ef77ed with identifier: TA27022
2026-03-28 09:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9f8ce014-bc9d-5b86-a860-39d510ef77ed with identifier: TA27022
2026-03-28 09:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9f8ce014-bc9d-5b86-a860-39d510ef77ed with identifier: TA27022 to the API
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:13Z',
 'fuel_type': 'diesel',
 'id': '9f8ce014-bc9d-5b86-a860-39d510ef77ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA27022',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 70469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 Blue-HDi Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2017}
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA27022%27 HTTP/1.1" 200 None
2026-03-28 09:03:28 [auto1.it] INFO: Saving data for TA27022: {'auction_closing_time': 1774716973.0, 'created_time': 1773270348.231162, 'last_price_update_time': 1774688608.965888}
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TA27022') HTTP/1.1" 204 0
2026-03-28 09:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:29 [auto1.it] INFO: Found listing with ID: EE25529
2026-03-28 09:03:29 [auto1.it] INFO: Found listing with ID: AK59444
2026-03-28 09:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK59444%27 HTTP/1.1" 200 None
2026-03-28 09:03:29 [auto1.it] INFO: Scrape type for AK59444: 0
2026-03-28 09:03:29 [auto1.it] INFO: Found listing with ID: MR66716
2026-03-28 09:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR66716%27 HTTP/1.1" 200 None
2026-03-28 09:03:29 [auto1.it] INFO: Scrape type for MR66716: 0
2026-03-28 09:03:29 [auto1.it] INFO: Found listing with ID: PA42280
2026-03-28 09:03:29 [auto1.it] INFO: Found listing with ID: GW20648
2026-03-28 09:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW20648%27 HTTP/1.1" 200 None
2026-03-28 09:03:29 [auto1.it] INFO: Scrape type for GW20648: 0
2026-03-28 09:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:30 [auto1.it] INFO: Channel: 24h | Page: 52 | totalHits: 3433 | hits on page: 40
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: JR22558
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: NZ11107
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: WN42286
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: KM60643
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM60643%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for KM60643: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: LA47308
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: WG64225
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG64225%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for WG64225: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: HD23157
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD23157%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for HD23157: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: FM38716
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM38716%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for FM38716: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: LG11183
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG11183%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for LG11183: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: FT05147
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT05147%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for FT05147: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: LC01017
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: MV39692
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV39692%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for MV39692: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: DA96064
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: NJ11800
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ11800%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for NJ11800: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: CD95874
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD95874%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for CD95874: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: DT73051
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: PK63277
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK63277%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for PK63277: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: FK85417
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: TF37027
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: UU36082
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: NS61318
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS61318%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for NS61318: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: WA05631
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: MK47318
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK47318%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for MK47318: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: SR34135
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: PC99456
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: PF34434
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF34434%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for PF34434: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: UY73261
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY73261%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for UY73261: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: DM22709
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: FC30574
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC30574%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for FC30574: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: ND56106
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: JC04494
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC04494%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for JC04494: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: LC40122
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC40122%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for LC40122: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: SU89902
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: VD81489
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: AY85424
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: MF53034
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MF53034%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for MF53034: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: AU72091
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU72091%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for AU72091: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: EZ36845
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: FR71474
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR71474%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for FR71474: 0
2026-03-28 09:03:30 [auto1.it] INFO: Found listing with ID: NR76329
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR76329%27 HTTP/1.1" 200 None
2026-03-28 09:03:30 [auto1.it] INFO: Scrape type for NR76329: 0
2026-03-28 09:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:31 [auto1.it] INFO: Channel: 24h | Page: 53 | totalHits: 3433 | hits on page: 40
2026-03-28 09:03:31 [auto1.it] INFO: Found listing with ID: EV83401
2026-03-28 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV83401%27 HTTP/1.1" 200 None
2026-03-28 09:03:31 [auto1.it] INFO: Scrape type for EV83401: 0
2026-03-28 09:03:31 [auto1.it] INFO: Found listing with ID: DJ42894
2026-03-28 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ42894%27 HTTP/1.1" 200 None
2026-03-28 09:03:31 [auto1.it] INFO: Scrape type for DJ42894: 0
2026-03-28 09:03:31 [auto1.it] INFO: Found listing with ID: TM24531
2026-03-28 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM24531%27 HTTP/1.1" 200 None
2026-03-28 09:03:31 [auto1.it] INFO: Scrape type for TM24531: 0
2026-03-28 09:03:31 [auto1.it] INFO: Found listing with ID: CW41374
2026-03-28 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW41374%27 HTTP/1.1" 200 None
2026-03-28 09:03:31 [auto1.it] INFO: Scrape type for CW41374: 0
2026-03-28 09:03:31 [auto1.it] INFO: Found listing with ID: UW33297
2026-03-28 09:03:31 [auto1.it] INFO: Found listing with ID: DR27432
2026-03-28 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR27432%27 HTTP/1.1" 200 None
2026-03-28 09:03:31 [auto1.it] INFO: Scrape type for DR27432: 0
2026-03-28 09:03:31 [auto1.it] INFO: Found listing with ID: JJ70536
2026-03-28 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ70536%27 HTTP/1.1" 200 None
2026-03-28 09:03:31 [auto1.it] INFO: Scrape type for JJ70536: 0
2026-03-28 09:03:31 [auto1.it] INFO: Found listing with ID: WC74031
2026-03-28 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC74031%27 HTTP/1.1" 200 None
2026-03-28 09:03:31 [auto1.it] INFO: Scrape type for WC74031: 0
2026-03-28 09:03:31 [auto1.it] INFO: Found listing with ID: FH60242
2026-03-28 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH60242%27 HTTP/1.1" 200 None
2026-03-28 09:03:31 [auto1.it] INFO: Scrape type for FH60242: 0
2026-03-28 09:03:31 [auto1.it] INFO: Found listing with ID: HJ29626
2026-03-28 09:03:31 [auto1.it] INFO: Found listing with ID: ZN12664
2026-03-28 09:03:31 [auto1.it] INFO: Found listing with ID: TW11966
2026-03-28 09:03:31 [auto1.it] INFO: Found listing with ID: FL85946
2026-03-28 09:03:31 [auto1.it] INFO: Found listing with ID: VJ53947
2026-03-28 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ53947%27 HTTP/1.1" 200 None
2026-03-28 09:03:32 [auto1.it] INFO: Scrape type for VJ53947: 0
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: DA24771
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA24771%27 HTTP/1.1" 200 None
2026-03-28 09:03:32 [auto1.it] INFO: Scrape type for DA24771: 0
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: RW18979
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: YF61167
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: GJ41533
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ41533%27 HTTP/1.1" 200 None
2026-03-28 09:03:32 [auto1.it] INFO: Scrape type for GJ41533: 0
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: PK33563
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK33563%27 HTTP/1.1" 200 None
2026-03-28 09:03:32 [auto1.it] INFO: Scrape type for PK33563: 0
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: WG29768
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG29768%27 HTTP/1.1" 200 None
2026-03-28 09:03:32 [auto1.it] INFO: Scrape type for WG29768: 0
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: EA21058
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: VX99971
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: BP79618
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP79618%27 HTTP/1.1" 200 None
2026-03-28 09:03:32 [auto1.it] INFO: Scrape type for BP79618: 0
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: WG71791
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: ZY63215
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: EH99264
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH99264%27 HTTP/1.1" 200 None
2026-03-28 09:03:32 [auto1.it] INFO: Scrape type for EH99264: 0
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: LB86726
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB86726%27 HTTP/1.1" 200 None
2026-03-28 09:03:32 [auto1.it] INFO: Scrape type for LB86726: 0
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: XN70596
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN70596%27 HTTP/1.1" 200 None
2026-03-28 09:03:32 [auto1.it] INFO: Scrape type for XN70596: 0
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: PZ92590
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: CM44345
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM44345%27 HTTP/1.1" 200 None
2026-03-28 09:03:32 [auto1.it] INFO: Scrape type for CM44345: 0
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: YW27369
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: SH22668
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: PU31383
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU31383%27 HTTP/1.1" 200 None
2026-03-28 09:03:32 [auto1.it] INFO: Scrape type for PU31383: 0
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: SM10455
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM10455%27 HTTP/1.1" 200 None
2026-03-28 09:03:32 [auto1.it] INFO: Scrape type for SM10455: 0
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: ZY20684
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY20684%27 HTTP/1.1" 200 None
2026-03-28 09:03:32 [auto1.it] INFO: Scrape type for ZY20684: 0
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: XY06195
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY06195%27 HTTP/1.1" 200 None
2026-03-28 09:03:32 [auto1.it] INFO: Scrape type for XY06195: 0
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: VR30636
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: CK65162
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK65162%27 HTTP/1.1" 200 None
2026-03-28 09:03:32 [auto1.it] INFO: Scrape type for CK65162: 0
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: AP21705
2026-03-28 09:03:32 [auto1.it] INFO: Found listing with ID: VH38350
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH38350%27 HTTP/1.1" 200 None
2026-03-28 09:03:32 [auto1.it] INFO: Scrape type for VH38350: 0
2026-03-28 09:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:33 [auto1.it] INFO: Channel: 24h | Page: 54 | totalHits: 3433 | hits on page: 40
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: XC86223
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: XU45966
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU45966%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for XU45966: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: NY71286
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: RD78006
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD78006%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for RD78006: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: CF61926
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: SL28261
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: XZ72452
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: CT62115
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: NA19420
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA19420%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for NA19420: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: UH10100
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH10100%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for UH10100: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: DW12777
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW12777%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for DW12777: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: PW61851
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: LK86303
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK86303%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for LK86303: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: YU91907
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU91907%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for YU91907: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: FR09226
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: TZ10573
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ10573%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for TZ10573: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: DP88225
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP88225%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for DP88225: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: LL55379
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: EP71722
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: RS77350
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: DN48840
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN48840%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for DN48840: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: SG58934
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG58934%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for SG58934: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: FK20941
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK20941%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for FK20941: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: XN27965
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN27965%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for XN27965: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: JZ39412
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ39412%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for JZ39412: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: XM00417
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM00417%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for XM00417: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: DT20429
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT20429%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for DT20429: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: WY52867
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY52867%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for WY52867: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: RK63045
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: AN53744
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN53744%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for AN53744: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: ZL03111
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL03111%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for ZL03111: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: CR51689
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR51689%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for CR51689: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: GJ25112
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ25112%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for GJ25112: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: LP93747
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP93747%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for LP93747: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: PE19282
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE19282%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for PE19282: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: CL45076
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL45076%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for CL45076: 0
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: PG35916
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: ZU55509
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: EC84941
2026-03-28 09:03:33 [auto1.it] INFO: Found listing with ID: ZN80284
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN80284%27 HTTP/1.1" 200 None
2026-03-28 09:03:33 [auto1.it] INFO: Scrape type for ZN80284: 0
2026-03-28 09:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:34 [auto1.it] INFO: Channel: 24h | Page: 55 | totalHits: 3434 | hits on page: 40
2026-03-28 09:03:34 [auto1.it] INFO: Found listing with ID: ZN80284
2026-03-28 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN80284%27 HTTP/1.1" 200 None
2026-03-28 09:03:34 [auto1.it] INFO: Scrape type for ZN80284: 0
2026-03-28 09:03:34 [auto1.it] INFO: Found listing with ID: ZL81271
2026-03-28 09:03:34 [auto1.it] INFO: Found listing with ID: RV64842
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV64842%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for RV64842: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: XW64768
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW64768%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for XW64768: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: GY24745
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: WG32639
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: KA78119
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: KT00361
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: DB99572
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: ZS75876
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: XR19887
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: UW96033
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW96033%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for UW96033: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: UN43339
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: DM22162
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM22162%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for DM22162: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: VF71012
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF71012%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for VF71012: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: DT03603
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: AN46326
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN46326%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for AN46326: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: ZT86767
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT86767%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for ZT86767: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: DB04877
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB04877%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for DB04877: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: CE88274
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: GY86444
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY86444%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for GY86444: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: LB78723
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB78723%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for LB78723: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: KB64117
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB64117%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for KB64117: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: HB85992
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB85992%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for HB85992: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: WP02751
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP02751%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for WP02751: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: KB32662
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: CM16503
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM16503%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for CM16503: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: CV26562
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: LV27017
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV27017%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for LV27017: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: PW98934
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: PZ48613
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: MR45258
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR45258%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for MR45258: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: WG08894
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: HF76476
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: TY18364
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: NK56802
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK56802%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for NK56802: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: NV82845
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV82845%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for NV82845: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: PM77932
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: NC51724
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC51724%27 HTTP/1.1" 200 None
2026-03-28 09:03:35 [auto1.it] INFO: Scrape type for NC51724: 0
2026-03-28 09:03:35 [auto1.it] INFO: Found listing with ID: GZ60590
2026-03-28 09:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:36 [auto1.it] INFO: Channel: 24h | Page: 56 | totalHits: 3434 | hits on page: 40
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: UA61069
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA61069%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for UA61069: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: PB72674
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: GS07587
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: VJ15717
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ15717%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for VJ15717: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: FA85590
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: DW71358
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW71358%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for DW71358: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: VC28082
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC28082%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for VC28082: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: MA80694
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA80694%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for MA80694: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: JP88345
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP88345%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for JP88345: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: HM97674
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: UF13738
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: RP10798
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: NK13523
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK13523%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for NK13523: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: BH85641
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH85641%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for BH85641: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: DF73154
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: JH70368
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: RF82114
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: YS98054
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS98054%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for YS98054: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: TD98171
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD98171%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for TD98171: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: RG82226
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: HS01763
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: HS85648
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS85648%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for HS85648: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: UC01773
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC01773%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for UC01773: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: ZV58496
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: ZE54964
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: TG01095
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG01095%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for TG01095: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: BL33415
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL33415%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for BL33415: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: FG93356
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG93356%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for FG93356: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: LD09745
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD09745%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for LD09745: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: FZ53517
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: ED44758
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED44758%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for ED44758: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: FM26794
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM26794%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for FM26794: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: MA29879
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA29879%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for MA29879: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: RP11137
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: YU18545
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU18545%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for YU18545: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: BT34353
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: MV84060
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV84060%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for MV84060: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: XH21917
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH21917%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for XH21917: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: CV60051
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV60051%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for CV60051: 0
2026-03-28 09:03:36 [auto1.it] INFO: Found listing with ID: BN63914
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN63914%27 HTTP/1.1" 200 None
2026-03-28 09:03:36 [auto1.it] INFO: Scrape type for BN63914: 0
2026-03-28 09:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:37 [auto1.it] INFO: Channel: 24h | Page: 57 | totalHits: 3435 | hits on page: 40
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: BN63914
2026-03-28 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN63914%27 HTTP/1.1" 200 None
2026-03-28 09:03:37 [auto1.it] INFO: Scrape type for BN63914: 0
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: RM66243
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: XF07692
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: FC82856
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: LH93951
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: YL53737
2026-03-28 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL53737%27 HTTP/1.1" 200 None
2026-03-28 09:03:37 [auto1.it] INFO: Scrape type for YL53737: 0
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: BW34835
2026-03-28 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW34835%27 HTTP/1.1" 200 None
2026-03-28 09:03:37 [auto1.it] INFO: Scrape type for BW34835: 0
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: NC75436
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: ZZ37301
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: ED49512
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: PP30320
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: GU13900
2026-03-28 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU13900%27 HTTP/1.1" 200 None
2026-03-28 09:03:37 [auto1.it] INFO: Scrape type for GU13900: 0
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: LX88559
2026-03-28 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX88559%27 HTTP/1.1" 200 None
2026-03-28 09:03:37 [auto1.it] INFO: Scrape type for LX88559: 0
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: DR08334
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: JL50472
2026-03-28 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL50472%27 HTTP/1.1" 200 None
2026-03-28 09:03:37 [auto1.it] INFO: Scrape type for JL50472: 0
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: PA95874
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: KW91343
2026-03-28 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW91343%27 HTTP/1.1" 200 None
2026-03-28 09:03:37 [auto1.it] INFO: Scrape type for KW91343: 0
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: MG56824
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: ZC61191
2026-03-28 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC61191%27 HTTP/1.1" 200 None
2026-03-28 09:03:37 [auto1.it] INFO: Scrape type for ZC61191: 0
2026-03-28 09:03:37 [auto1.it] INFO: Found listing with ID: BE98345
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE98345%27 HTTP/1.1" 200 None
2026-03-28 09:03:38 [auto1.it] INFO: Scrape type for BE98345: 0
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: KF16617
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: CF46707
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF46707%27 HTTP/1.1" 200 None
2026-03-28 09:03:38 [auto1.it] INFO: Scrape type for CF46707: 0
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: PW55510
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW55510%27 HTTP/1.1" 200 None
2026-03-28 09:03:38 [auto1.it] INFO: Scrape type for PW55510: 0
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: HH63511
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: XB83607
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB83607%27 HTTP/1.1" 200 None
2026-03-28 09:03:38 [auto1.it] INFO: Scrape type for XB83607: 0
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: TX19342
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX19342%27 HTTP/1.1" 200 None
2026-03-28 09:03:38 [auto1.it] INFO: Scrape type for TX19342: 0
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: FG48164
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: WD01397
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD01397%27 HTTP/1.1" 200 None
2026-03-28 09:03:38 [auto1.it] INFO: Scrape type for WD01397: 0
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: MZ58050
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ58050%27 HTTP/1.1" 200 None
2026-03-28 09:03:38 [auto1.it] INFO: Scrape type for MZ58050: 0
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: PT91804
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: WA90639
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: WT06044
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT06044%27 HTTP/1.1" 200 None
2026-03-28 09:03:38 [auto1.it] INFO: Scrape type for WT06044: 0
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: RW29335
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: LL12083
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: RV05928
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: TH12767
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: PM18246
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: WD56351
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: JT98079
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT98079%27 HTTP/1.1" 200 None
2026-03-28 09:03:38 [auto1.it] INFO: Scrape type for JT98079: 0
2026-03-28 09:03:38 [auto1.it] INFO: Found listing with ID: CC30639
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC30639%27 HTTP/1.1" 200 None
2026-03-28 09:03:38 [auto1.it] INFO: Scrape type for CC30639: 0
2026-03-28 09:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:39 [auto1.it] INFO: Channel: 24h | Page: 58 | totalHits: 3435 | hits on page: 40
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: HX11977
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: DP76328
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP76328%27 HTTP/1.1" 200 None
2026-03-28 09:03:39 [auto1.it] INFO: Scrape type for DP76328: 0
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: AW58556
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: PV15987
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: CL12006
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: JF71307
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: DZ84756
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: MS56995
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: GL66582
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: CY86412
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY86412%27 HTTP/1.1" 200 None
2026-03-28 09:03:39 [auto1.it] INFO: Scrape type for CY86412: 0
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: UF72432
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF72432%27 HTTP/1.1" 200 None
2026-03-28 09:03:39 [auto1.it] INFO: Scrape type for UF72432: 0
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: MY33245
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: AJ60776
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: TY10894
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY10894%27 HTTP/1.1" 200 None
2026-03-28 09:03:39 [auto1.it] INFO: Scrape type for TY10894: 0
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: XE78357
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: JK74619
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK74619%27 HTTP/1.1" 200 None
2026-03-28 09:03:39 [auto1.it] INFO: Scrape type for JK74619: 0
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: MP43347
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: PW94321
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW94321%27 HTTP/1.1" 200 None
2026-03-28 09:03:39 [auto1.it] INFO: Scrape type for PW94321: 0
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: TW74539
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: VA19442
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA19442%27 HTTP/1.1" 200 None
2026-03-28 09:03:39 [auto1.it] INFO: Scrape type for VA19442: 0
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: TE58119
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: JE47359
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE47359%27 HTTP/1.1" 200 None
2026-03-28 09:03:39 [auto1.it] INFO: Scrape type for JE47359: 0
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: UN82812
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: AG84200
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG84200%27 HTTP/1.1" 200 None
2026-03-28 09:03:39 [auto1.it] INFO: Scrape type for AG84200: 0
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: NY32354
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY32354%27 HTTP/1.1" 200 None
2026-03-28 09:03:39 [auto1.it] INFO: Scrape type for NY32354: 0
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: SJ01004
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ01004%27 HTTP/1.1" 200 None
2026-03-28 09:03:39 [auto1.it] INFO: Scrape type for SJ01004: 0
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: LT40503
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: WM11657
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: UE69721
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: RU03062
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU03062%27 HTTP/1.1" 200 None
2026-03-28 09:03:39 [auto1.it] INFO: Scrape type for RU03062: 0
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: JM45525
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: LK41226
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: PY67809
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY67809%27 HTTP/1.1" 200 None
2026-03-28 09:03:39 [auto1.it] INFO: Scrape type for PY67809: 0
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: AR75288
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: CC38262
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: ZJ87985
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ87985%27 HTTP/1.1" 200 None
2026-03-28 09:03:39 [auto1.it] INFO: Scrape type for ZJ87985: 0
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: MK10556
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK10556%27 HTTP/1.1" 200 None
2026-03-28 09:03:39 [auto1.it] INFO: Scrape type for MK10556: 0
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: YD65738
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: TK22539
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK22539%27 HTTP/1.1" 200 None
2026-03-28 09:03:39 [auto1.it] INFO: Scrape type for TK22539: 0
2026-03-28 09:03:39 [auto1.it] INFO: Found listing with ID: GM28799
2026-03-28 09:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:40 [auto1.it] INFO: Channel: 24h | Page: 59 | totalHits: 3435 | hits on page: 40
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: WL47610
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL47610%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for WL47610: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: NP40750
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: AA65111
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA65111%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for AA65111: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: RG08940
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG08940%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for RG08940: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: FL08980
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL08980%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for FL08980: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: DU09881
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU09881%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for DU09881: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: FL90232
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: DD75867
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD75867%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for DD75867: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: SK41395
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK41395%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for SK41395: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: TU59296
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: PR98561
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: AY33190
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY33190%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for AY33190: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: CN85628
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN85628%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for CN85628: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: AA13192
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: BX20882
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: SD99760
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD99760%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for SD99760: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: UZ55357
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ55357%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for UZ55357: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: CD59978
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD59978%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for CD59978: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: TY61219
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY61219%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for TY61219: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: UT42979
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: EZ12960
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ12960%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for EZ12960: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: HY18936
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY18936%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for HY18936: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: CV95594
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: LG34418
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG34418%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for LG34418: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: AY77506
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: KH49254
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: RM05411
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM05411%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for RM05411: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: PW10693
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: DC13549
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC13549%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for DC13549: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: WX66376
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX66376%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for WX66376: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: SY39981
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY39981%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for SY39981: 0
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: MD08971
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: ZW42216
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: BX71767
2026-03-28 09:03:40 [auto1.it] INFO: Found listing with ID: GP73012
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GP73012%27 HTTP/1.1" 200 None
2026-03-28 09:03:40 [auto1.it] INFO: Scrape type for GP73012: 0
2026-03-28 09:03:41 [auto1.it] INFO: Found listing with ID: XG67662
2026-03-28 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XG67662%27 HTTP/1.1" 200 None
2026-03-28 09:03:41 [auto1.it] INFO: Scrape type for XG67662: 0
2026-03-28 09:03:41 [auto1.it] INFO: Found listing with ID: EJ77874
2026-03-28 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ77874%27 HTTP/1.1" 200 None
2026-03-28 09:03:41 [auto1.it] INFO: Scrape type for EJ77874: 0
2026-03-28 09:03:41 [auto1.it] INFO: Found listing with ID: VX04337
2026-03-28 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX04337%27 HTTP/1.1" 200 None
2026-03-28 09:03:41 [auto1.it] INFO: Scrape type for VX04337: 0
2026-03-28 09:03:41 [auto1.it] INFO: Found listing with ID: BK28378
2026-03-28 09:03:41 [auto1.it] INFO: Found listing with ID: JC85025
2026-03-28 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC85025%27 HTTP/1.1" 200 None
2026-03-28 09:03:41 [auto1.it] INFO: Scrape type for JC85025: 0
2026-03-28 09:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:42 [auto1.it] INFO: Channel: 24h | Page: 60 | totalHits: 3435 | hits on page: 40
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: YD48620
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD48620%27 HTTP/1.1" 200 None
2026-03-28 09:03:42 [auto1.it] INFO: Scrape type for YD48620: 0
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: WZ23561
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ23561%27 HTTP/1.1" 200 None
2026-03-28 09:03:42 [auto1.it] INFO: Scrape type for WZ23561: 0
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: CA31078
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: DX25254
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: RN28631
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN28631%27 HTTP/1.1" 200 None
2026-03-28 09:03:42 [auto1.it] INFO: Scrape type for RN28631: 0
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: KD79727
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: GV78603
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: JD36680
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: HB10468
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: RA38886
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA38886%27 HTTP/1.1" 200 None
2026-03-28 09:03:42 [auto1.it] INFO: Scrape type for RA38886: 0
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: EH45262
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: SK02509
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: RJ33574
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ33574%27 HTTP/1.1" 200 None
2026-03-28 09:03:42 [auto1.it] INFO: Scrape type for RJ33574: 0
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: YX30570
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX30570%27 HTTP/1.1" 200 None
2026-03-28 09:03:42 [auto1.it] INFO: Scrape type for YX30570: 0
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: WP88184
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: ZG90138
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG90138%27 HTTP/1.1" 200 None
2026-03-28 09:03:42 [auto1.it] INFO: Scrape type for ZG90138: 0
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: TM53494
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM53494%27 HTTP/1.1" 200 None
2026-03-28 09:03:42 [auto1.it] INFO: Scrape type for TM53494: 0
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: BZ06099
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: KB16454
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB16454%27 HTTP/1.1" 200 None
2026-03-28 09:03:42 [auto1.it] INFO: Scrape type for KB16454: 0
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: FE09970
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: XW11641
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: PK37829
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK37829%27 HTTP/1.1" 200 None
2026-03-28 09:03:42 [auto1.it] INFO: Scrape type for PK37829: 0
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: LA07616
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: VJ93406
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: SG11242
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: DM40972
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM40972%27 HTTP/1.1" 200 None
2026-03-28 09:03:42 [auto1.it] INFO: Scrape type for DM40972: 0
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: ZX94133
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: VE23835
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: NW58325
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW58325%27 HTTP/1.1" 200 None
2026-03-28 09:03:42 [auto1.it] INFO: Scrape type for NW58325: 0
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: MN82158
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN82158%27 HTTP/1.1" 200 None
2026-03-28 09:03:42 [auto1.it] INFO: Scrape type for MN82158: 0
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: ZC19416
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: DL31507
2026-03-28 09:03:42 [auto1.it] INFO: Found listing with ID: KT77401
2026-03-28 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT77401%27 HTTP/1.1" 200 None
2026-03-28 09:03:43 [auto1.it] INFO: Scrape type for KT77401: 0
2026-03-28 09:03:43 [auto1.it] INFO: Found listing with ID: XX72612
2026-03-28 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX72612%27 HTTP/1.1" 200 None
2026-03-28 09:03:43 [auto1.it] INFO: Scrape type for XX72612: 0
2026-03-28 09:03:43 [auto1.it] INFO: Found listing with ID: HE91199
2026-03-28 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE91199%27 HTTP/1.1" 200 None
2026-03-28 09:03:43 [auto1.it] INFO: Scrape type for HE91199: 0
2026-03-28 09:03:43 [auto1.it] INFO: Found listing with ID: CW11593
2026-03-28 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW11593%27 HTTP/1.1" 200 None
2026-03-28 09:03:43 [auto1.it] INFO: Scrape type for CW11593: 0
2026-03-28 09:03:43 [auto1.it] INFO: Found listing with ID: DW16027
2026-03-28 09:03:43 [auto1.it] INFO: Found listing with ID: NC12493
2026-03-28 09:03:43 [auto1.it] INFO: Found listing with ID: GD15248
2026-03-28 09:03:43 [auto1.it] INFO: Found listing with ID: TH28502
2026-03-28 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH28502%27 HTTP/1.1" 200 None
2026-03-28 09:03:43 [auto1.it] INFO: Scrape type for TH28502: 0
2026-03-28 09:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:44 [auto1.it] INFO: Channel: 24h | Page: 61 | totalHits: 3435 | hits on page: 40
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: RJ37840
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: EC99785
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: ZZ86621
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: VT42510
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: LN57194
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: PZ63395
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: LG36476
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG36476%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for LG36476: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: DV58522
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: YH05705
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH05705%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for YH05705: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: GH85070
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: MN32437
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN32437%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for MN32437: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: UV23225
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV23225%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for UV23225: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: SE74727
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE74727%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for SE74727: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: AY40178
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: JD45338
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD45338%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for JD45338: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: MT71865
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT71865%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for MT71865: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: FN81856
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN81856%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for FN81856: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: PH50557
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH50557%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for PH50557: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: GZ99467
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: GN89134
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN89134%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for GN89134: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: FT00845
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT00845%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for FT00845: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: ZU32516
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: HK76451
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: VG48139
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: CY33103
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY33103%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for CY33103: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: WH17825
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: JT23346
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: RF43689
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: FK45797
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: GW83806
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: PH45617
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH45617%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for PH45617: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: XT40512
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT40512%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for XT40512: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: CM50151
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM50151%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for CM50151: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: KL55117
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL55117%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for KL55117: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: KD38461
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: XU37749
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU37749%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for XU37749: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: WV44347
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV44347%27 HTTP/1.1" 200 None
2026-03-28 09:03:44 [auto1.it] INFO: Scrape type for WV44347: 0
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: YG18020
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: HW85888
2026-03-28 09:03:44 [auto1.it] INFO: Found listing with ID: HA44632
2026-03-28 09:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:45 [auto1.it] INFO: Channel: 24h | Page: 62 | totalHits: 3435 | hits on page: 40
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: KT79218
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT79218%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for KT79218: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: KD49699
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD49699%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for KD49699: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: ZE21394
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: NB15044
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB15044%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for NB15044: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: YA54300
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: NX73202
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX73202%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for NX73202: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: BG55667
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: SA71650
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA71650%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for SA71650: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: TN53037
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN53037%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for TN53037: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: TG42626
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: LL94615
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: YD47870
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: RS41050
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: ET57280
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: BW44627
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW44627%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for BW44627: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: JX68223
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX68223%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for JX68223: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: ZW92714
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW92714%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for ZW92714: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: UP17064
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP17064%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for UP17064: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: NN80859
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN80859%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for NN80859: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: UB21320
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB21320%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for UB21320: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: NJ83998
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ83998%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for NJ83998: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: MN68461
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN68461%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for MN68461: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: CH31271
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH31271%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for CH31271: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: XX37698
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX37698%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for XX37698: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: FX50490
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX50490%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for FX50490: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: RN44276
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: ST06974
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: TJ46359
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ46359%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for TJ46359: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: FA93618
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: KS43685
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: GX83807
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX83807%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for GX83807: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: YG30728
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG30728%27 HTTP/1.1" 200 None
2026-03-28 09:03:45 [auto1.it] INFO: Scrape type for YG30728: 0
2026-03-28 09:03:45 [auto1.it] INFO: Found listing with ID: GF63115
2026-03-28 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF63115%27 HTTP/1.1" 200 None
2026-03-28 09:03:46 [auto1.it] INFO: Scrape type for GF63115: 0
2026-03-28 09:03:46 [auto1.it] INFO: Found listing with ID: JB43722
2026-03-28 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB43722%27 HTTP/1.1" 200 None
2026-03-28 09:03:46 [auto1.it] INFO: Scrape type for JB43722: 0
2026-03-28 09:03:46 [auto1.it] INFO: Found listing with ID: PP68116
2026-03-28 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP68116%27 HTTP/1.1" 200 None
2026-03-28 09:03:46 [auto1.it] INFO: Scrape type for PP68116: 0
2026-03-28 09:03:46 [auto1.it] INFO: Found listing with ID: SE79185
2026-03-28 09:03:46 [auto1.it] INFO: Found listing with ID: TT81235
2026-03-28 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT81235%27 HTTP/1.1" 200 None
2026-03-28 09:03:46 [auto1.it] INFO: Scrape type for TT81235: 0
2026-03-28 09:03:46 [auto1.it] INFO: Found listing with ID: CK25903
2026-03-28 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK25903%27 HTTP/1.1" 200 None
2026-03-28 09:03:46 [auto1.it] INFO: Scrape type for CK25903: 0
2026-03-28 09:03:46 [auto1.it] INFO: Found listing with ID: JF07503
2026-03-28 09:03:46 [auto1.it] INFO: Found listing with ID: RV62579
2026-03-28 09:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:47 [auto1.it] INFO: Channel: 24h | Page: 63 | totalHits: 3435 | hits on page: 40
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: RL62360
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL62360%27 HTTP/1.1" 200 None
2026-03-28 09:03:47 [auto1.it] INFO: Scrape type for RL62360: 0
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: FD53627
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: DL97052
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL97052%27 HTTP/1.1" 200 None
2026-03-28 09:03:47 [auto1.it] INFO: Scrape type for DL97052: 0
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: VT42722
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: AG54549
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: EP88995
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP88995%27 HTTP/1.1" 200 None
2026-03-28 09:03:47 [auto1.it] INFO: Scrape type for EP88995: 0
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: WK88793
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK88793%27 HTTP/1.1" 200 None
2026-03-28 09:03:47 [auto1.it] INFO: Scrape type for WK88793: 0
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: FR03346
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: UY39151
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: SP41813
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: VM78443
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: DV39460
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV39460%27 HTTP/1.1" 200 None
2026-03-28 09:03:47 [auto1.it] INFO: Scrape type for DV39460: 0
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: KE11189
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE11189%27 HTTP/1.1" 200 None
2026-03-28 09:03:47 [auto1.it] INFO: Scrape type for KE11189: 0
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: EY33952
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY33952%27 HTTP/1.1" 200 None
2026-03-28 09:03:47 [auto1.it] INFO: Scrape type for EY33952: 0
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: DU17366
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU17366%27 HTTP/1.1" 200 None
2026-03-28 09:03:47 [auto1.it] INFO: Scrape type for DU17366: 0
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: YB63473
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: SJ00829
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ00829%27 HTTP/1.1" 200 None
2026-03-28 09:03:47 [auto1.it] INFO: Scrape type for SJ00829: 0
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: FY46493
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: GN74108
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: GF01079
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: XV16730
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: PV94920
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV94920%27 HTTP/1.1" 200 None
2026-03-28 09:03:47 [auto1.it] INFO: Scrape type for PV94920: 0
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: ZJ21397
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ21397%27 HTTP/1.1" 200 None
2026-03-28 09:03:47 [auto1.it] INFO: Scrape type for ZJ21397: 0
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: CH52447
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: UA89499
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: WU80477
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: YK06699
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: DK87302
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: RF27989
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: TV99764
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: SG31590
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG31590%27 HTTP/1.1" 200 None
2026-03-28 09:03:47 [auto1.it] INFO: Scrape type for SG31590: 0
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: EA08863
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA08863%27 HTTP/1.1" 200 None
2026-03-28 09:03:47 [auto1.it] INFO: Scrape type for EA08863: 0
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: HD82423
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: NW60366
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: UC47461
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC47461%27 HTTP/1.1" 200 None
2026-03-28 09:03:47 [auto1.it] INFO: Scrape type for UC47461: 0
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: NP37024
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP37024%27 HTTP/1.1" 200 None
2026-03-28 09:03:47 [auto1.it] INFO: Scrape type for NP37024: 0
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: WV72590
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV72590%27 HTTP/1.1" 200 None
2026-03-28 09:03:47 [auto1.it] INFO: Scrape type for WV72590: 0
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: DB68692
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB68692%27 HTTP/1.1" 200 None
2026-03-28 09:03:47 [auto1.it] INFO: Scrape type for DB68692: 0
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: FP20263
2026-03-28 09:03:47 [auto1.it] INFO: Found listing with ID: WM78801
2026-03-28 09:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:48 [auto1.it] INFO: Channel: 24h | Page: 64 | totalHits: 3435 | hits on page: 40
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: BR67394
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: KP12391
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP12391%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for KP12391: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: JU67462
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU67462%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for JU67462: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: WE55630
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: VB70261
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB70261%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for VB70261: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: UX28393
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX28393%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for UX28393: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: JY35916
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: KZ49625
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: BA15195
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: FN78187
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: CT25036
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT25036%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for CT25036: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: CV79259
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV79259%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for CV79259: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: WH70643
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH70643%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for WH70643: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: BE00528
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE00528%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for BE00528: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: AD01687
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD01687%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for AD01687: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: YT67370
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT67370%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for YT67370: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: HX75119
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX75119%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for HX75119: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: RU27646
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: CW11036
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW11036%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for CW11036: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: WS86957
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS86957%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for WS86957: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: DN99534
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: FN89798
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: JL83365
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL83365%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for JL83365: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: WH55866
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: AE85133
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE85133%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for AE85133: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: DN08813
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN08813%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for DN08813: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: GP15834
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GP15834%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for GP15834: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: YH14903
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: BJ71456
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ71456%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for BJ71456: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: HC78855
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: GM03670
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: WY72750
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY72750%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for WY72750: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: ZF40554
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF40554%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for ZF40554: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: XY26314
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY26314%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for XY26314: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: PD07113
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: NP01679
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP01679%27 HTTP/1.1" 200 None
2026-03-28 09:03:48 [auto1.it] INFO: Scrape type for NP01679: 0
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: PN01400
2026-03-28 09:03:48 [auto1.it] INFO: Found listing with ID: HM54008
2026-03-28 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM54008%27 HTTP/1.1" 200 None
2026-03-28 09:03:49 [auto1.it] INFO: Scrape type for HM54008: 0
2026-03-28 09:03:49 [auto1.it] INFO: Found listing with ID: SP76824
2026-03-28 09:03:49 [auto1.it] INFO: Found listing with ID: KM59258
2026-03-28 09:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:50 [auto1.it] INFO: Channel: 24h | Page: 65 | totalHits: 3435 | hits on page: 40
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: EK35642
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK35642%27 HTTP/1.1" 200 None
2026-03-28 09:03:50 [auto1.it] INFO: Scrape type for EK35642: 0
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: TS59592
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS59592%27 HTTP/1.1" 200 None
2026-03-28 09:03:50 [auto1.it] INFO: Scrape type for TS59592: 0
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: GL53946
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: TL14575
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL14575%27 HTTP/1.1" 200 None
2026-03-28 09:03:50 [auto1.it] INFO: Scrape type for TL14575: 0
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: DC79490
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: KH25019
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH25019%27 HTTP/1.1" 200 None
2026-03-28 09:03:50 [auto1.it] INFO: Scrape type for KH25019: 0
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: ES64600
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: FL80724
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: KL25988
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL25988%27 HTTP/1.1" 200 None
2026-03-28 09:03:50 [auto1.it] INFO: Scrape type for KL25988: 0
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: WF71586
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF71586%27 HTTP/1.1" 200 None
2026-03-28 09:03:50 [auto1.it] INFO: Scrape type for WF71586: 0
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: ZV13161
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: WX88611
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: DX82404
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: SC24442
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: JT68367
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT68367%27 HTTP/1.1" 200 None
2026-03-28 09:03:50 [auto1.it] INFO: Scrape type for JT68367: 0
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: HZ95408
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: KT12037
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT12037%27 HTTP/1.1" 200 None
2026-03-28 09:03:50 [auto1.it] INFO: Scrape type for KT12037: 0
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: TV86323
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: JJ76443
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: YW35893
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: LU63066
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU63066%27 HTTP/1.1" 200 None
2026-03-28 09:03:50 [auto1.it] INFO: Scrape type for LU63066: 0
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: JG85699
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: HU57000
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: HG91847
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: TM20698
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: UP03227
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP03227%27 HTTP/1.1" 200 None
2026-03-28 09:03:50 [auto1.it] INFO: Scrape type for UP03227: 0
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: KA22424
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA22424%27 HTTP/1.1" 200 None
2026-03-28 09:03:50 [auto1.it] INFO: Scrape type for KA22424: 0
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: JW95602
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW95602%27 HTTP/1.1" 200 None
2026-03-28 09:03:50 [auto1.it] INFO: Scrape type for JW95602: 0
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: FG41149
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: HA39708
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: FH51436
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: EH34312
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH34312%27 HTTP/1.1" 200 None
2026-03-28 09:03:50 [auto1.it] INFO: Scrape type for EH34312: 0
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: AR14989
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: YC82026
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: XD81326
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: JN59652
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN59652%27 HTTP/1.1" 200 None
2026-03-28 09:03:50 [auto1.it] INFO: Scrape type for JN59652: 0
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: TJ64738
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ64738%27 HTTP/1.1" 200 None
2026-03-28 09:03:50 [auto1.it] INFO: Scrape type for TJ64738: 0
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: JK90392
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: JZ41811
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ41811%27 HTTP/1.1" 200 None
2026-03-28 09:03:50 [auto1.it] INFO: Scrape type for JZ41811: 0
2026-03-28 09:03:50 [auto1.it] INFO: Found listing with ID: AR28136
2026-03-28 09:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:51 [auto1.it] INFO: Channel: 24h | Page: 66 | totalHits: 3435 | hits on page: 40
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: UA91591
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA91591%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for UA91591: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: FF45161
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF45161%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for FF45161: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: RZ15516
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ15516%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for RZ15516: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: GN36205
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN36205%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for GN36205: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: LH69939
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: LM72883
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: KB99828
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB99828%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for KB99828: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: PA21374
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: LV04843
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV04843%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for LV04843: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: KP29994
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP29994%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for KP29994: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: BV21704
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV21704%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for BV21704: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: ZC10752
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC10752%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for ZC10752: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: BR63865
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR63865%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for BR63865: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: DB81041
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: BM64259
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM64259%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for BM64259: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: AJ89778
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ89778%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for AJ89778: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: LX11958
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: CH57446
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: AR03634
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: GB22303
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: PT53216
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT53216%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for PT53216: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: XX29767
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX29767%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for XX29767: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: SV71044
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: EP62214
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: WW47132
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW47132%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for WW47132: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: BR31613
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: SG91000
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: SV61491
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV61491%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for SV61491: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: VF92770
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: AD83412
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: RF93024
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: PW70389
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: YD99116
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: HF24893
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: WP29588
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP29588%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for WP29588: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: VE26782
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: WL14524
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: PA28005
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA28005%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for PA28005: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: DN97608
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN97608%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for DN97608: 0
2026-03-28 09:03:51 [auto1.it] INFO: Found listing with ID: JU37769
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU37769%27 HTTP/1.1" 200 None
2026-03-28 09:03:51 [auto1.it] INFO: Scrape type for JU37769: 0
2026-03-28 09:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:52 [auto1.it] INFO: Channel: 24h | Page: 67 | totalHits: 3435 | hits on page: 40
2026-03-28 09:03:52 [auto1.it] INFO: Found listing with ID: EC29909
2026-03-28 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC29909%27 HTTP/1.1" 200 None
2026-03-28 09:03:52 [auto1.it] INFO: Scrape type for EC29909: 0
2026-03-28 09:03:52 [auto1.it] INFO: Found listing with ID: AU78491
2026-03-28 09:03:52 [auto1.it] INFO: Found listing with ID: HZ92978
2026-03-28 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ92978%27 HTTP/1.1" 200 None
2026-03-28 09:03:52 [auto1.it] INFO: Scrape type for HZ92978: 0
2026-03-28 09:03:52 [auto1.it] INFO: Found listing with ID: HZ65981
2026-03-28 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ65981%27 HTTP/1.1" 200 None
2026-03-28 09:03:52 [auto1.it] INFO: Scrape type for HZ65981: 0
2026-03-28 09:03:52 [auto1.it] INFO: Found listing with ID: RT39388
2026-03-28 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT39388%27 HTTP/1.1" 200 None
2026-03-28 09:03:52 [auto1.it] INFO: Scrape type for RT39388: 0
2026-03-28 09:03:52 [auto1.it] INFO: Found listing with ID: SR58570
2026-03-28 09:03:52 [auto1.it] INFO: Found listing with ID: GJ43112
2026-03-28 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ43112%27 HTTP/1.1" 200 None
2026-03-28 09:03:52 [auto1.it] INFO: Scrape type for GJ43112: 0
2026-03-28 09:03:52 [auto1.it] INFO: Found listing with ID: PT96186
2026-03-28 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT96186%27 HTTP/1.1" 200 None
2026-03-28 09:03:52 [auto1.it] INFO: Scrape type for PT96186: 0
2026-03-28 09:03:52 [auto1.it] INFO: Found listing with ID: ZS94509
2026-03-28 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS94509%27 HTTP/1.1" 200 None
2026-03-28 09:03:53 [auto1.it] INFO: Scrape type for ZS94509: 0
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: XF95831
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF95831%27 HTTP/1.1" 200 None
2026-03-28 09:03:53 [auto1.it] INFO: Scrape type for XF95831: 0
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: HW38972
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: TX96321
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX96321%27 HTTP/1.1" 200 None
2026-03-28 09:03:53 [auto1.it] INFO: Scrape type for TX96321: 0
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: YD44226
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: RX07844
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: YS49191
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS49191%27 HTTP/1.1" 200 None
2026-03-28 09:03:53 [auto1.it] INFO: Scrape type for YS49191: 0
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: EF98667
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF98667%27 HTTP/1.1" 200 None
2026-03-28 09:03:53 [auto1.it] INFO: Scrape type for EF98667: 0
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: AR12639
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR12639%27 HTTP/1.1" 200 None
2026-03-28 09:03:53 [auto1.it] INFO: Scrape type for AR12639: 0
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: XC85106
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: GX81106
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: WM75200
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM75200%27 HTTP/1.1" 200 None
2026-03-28 09:03:53 [auto1.it] INFO: Scrape type for WM75200: 0
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: WE98269
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE98269%27 HTTP/1.1" 200 None
2026-03-28 09:03:53 [auto1.it] INFO: Scrape type for WE98269: 0
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: NH13553
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: CU15371
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: BN52557
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: EA61163
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA61163%27 HTTP/1.1" 200 None
2026-03-28 09:03:53 [auto1.it] INFO: Scrape type for EA61163: 0
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: PU90509
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU90509%27 HTTP/1.1" 200 None
2026-03-28 09:03:53 [auto1.it] INFO: Scrape type for PU90509: 0
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: RB23819
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB23819%27 HTTP/1.1" 200 None
2026-03-28 09:03:53 [auto1.it] INFO: Scrape type for RB23819: 0
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: HT95885
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: EA76192
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: HK62879
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: UW31013
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW31013%27 HTTP/1.1" 200 None
2026-03-28 09:03:53 [auto1.it] INFO: Scrape type for UW31013: 0
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: MV48834
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV48834%27 HTTP/1.1" 200 None
2026-03-28 09:03:53 [auto1.it] INFO: Scrape type for MV48834: 0
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: LE49462
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE49462%27 HTTP/1.1" 200 None
2026-03-28 09:03:53 [auto1.it] INFO: Scrape type for LE49462: 0
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: TK35909
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK35909%27 HTTP/1.1" 200 None
2026-03-28 09:03:53 [auto1.it] INFO: Scrape type for TK35909: 0
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: CA37263
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: VY80184
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: CB33793
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: XV63353
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: VS63057
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS63057%27 HTTP/1.1" 200 None
2026-03-28 09:03:53 [auto1.it] INFO: Scrape type for VS63057: 0
2026-03-28 09:03:53 [auto1.it] INFO: Found listing with ID: KB12646
2026-03-28 09:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:54 [auto1.it] INFO: Channel: 24h | Page: 68 | totalHits: 3435 | hits on page: 40
2026-03-28 09:03:54 [auto1.it] INFO: Found listing with ID: PX76093
2026-03-28 09:03:54 [auto1.it] INFO: Found listing with ID: VF62325
2026-03-28 09:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF62325%27 HTTP/1.1" 200 None
2026-03-28 09:03:54 [auto1.it] INFO: Scrape type for VF62325: 0
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: RA11036
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA11036%27 HTTP/1.1" 200 None
2026-03-28 09:03:55 [auto1.it] INFO: Scrape type for RA11036: 0
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: YY46039
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: XX32057
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX32057%27 HTTP/1.1" 200 None
2026-03-28 09:03:55 [auto1.it] INFO: Scrape type for XX32057: 0
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: YL89014
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL89014%27 HTTP/1.1" 200 None
2026-03-28 09:03:55 [auto1.it] INFO: Scrape type for YL89014: 0
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: HM08879
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: FP35914
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: GC53002
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: YB89619
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB89619%27 HTTP/1.1" 200 None
2026-03-28 09:03:55 [auto1.it] INFO: Scrape type for YB89619: 0
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: FV19054
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: CU49337
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: DK62006
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: SR32433
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR32433%27 HTTP/1.1" 200 None
2026-03-28 09:03:55 [auto1.it] INFO: Scrape type for SR32433: 0
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: BA09093
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: BR57787
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR57787%27 HTTP/1.1" 200 None
2026-03-28 09:03:55 [auto1.it] INFO: Scrape type for BR57787: 0
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: TY97368
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: GV26258
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: VY84485
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: ZX85690
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX85690%27 HTTP/1.1" 200 None
2026-03-28 09:03:55 [auto1.it] INFO: Scrape type for ZX85690: 0
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: TE87413
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: SY54924
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY54924%27 HTTP/1.1" 200 None
2026-03-28 09:03:55 [auto1.it] INFO: Scrape type for SY54924: 0
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: UD61425
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: UF75242
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF75242%27 HTTP/1.1" 200 None
2026-03-28 09:03:55 [auto1.it] INFO: Scrape type for UF75242: 0
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: MG67619
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: VZ32715
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: AF86061
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: UK70353
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: GV49335
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: UU51056
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU51056%27 HTTP/1.1" 200 None
2026-03-28 09:03:55 [auto1.it] INFO: Scrape type for UU51056: 0
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: WK74495
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK74495%27 HTTP/1.1" 200 None
2026-03-28 09:03:55 [auto1.it] INFO: Scrape type for WK74495: 0
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: HP26181
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP26181%27 HTTP/1.1" 200 None
2026-03-28 09:03:55 [auto1.it] INFO: Scrape type for HP26181: 0
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: FR70206
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: UX09906
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: EZ75087
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ75087%27 HTTP/1.1" 200 None
2026-03-28 09:03:55 [auto1.it] INFO: Scrape type for EZ75087: 0
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: YZ06369
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ06369%27 HTTP/1.1" 200 None
2026-03-28 09:03:55 [auto1.it] INFO: Scrape type for YZ06369: 0
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: MJ31103
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ31103%27 HTTP/1.1" 200 None
2026-03-28 09:03:55 [auto1.it] INFO: Scrape type for MJ31103: 0
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: HJ18951
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: YM27608
2026-03-28 09:03:55 [auto1.it] INFO: Found listing with ID: ZF27085
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF27085%27 HTTP/1.1" 200 None
2026-03-28 09:03:55 [auto1.it] INFO: Scrape type for ZF27085: 0
2026-03-28 09:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:03:56 [auto1.it] INFO: Channel: 24h | Page: 69 | totalHits: 3435 | hits on page: 40
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: RF78298
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: VD83585
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VD83585%27 HTTP/1.1" 200 None
2026-03-28 09:03:56 [auto1.it] INFO: Scrape type for VD83585: 0
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: XW70858
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: RV11940
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV11940%27 HTTP/1.1" 200 None
2026-03-28 09:03:56 [auto1.it] INFO: Scrape type for RV11940: 0
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: PN28374
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: KE46739
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE46739%27 HTTP/1.1" 200 None
2026-03-28 09:03:56 [auto1.it] INFO: Scrape type for KE46739: 0
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: JE85806
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE85806%27 HTTP/1.1" 200 None
2026-03-28 09:03:56 [auto1.it] INFO: Scrape type for JE85806: 0
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: LS28867
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: TZ47815
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ47815%27 HTTP/1.1" 200 None
2026-03-28 09:03:56 [auto1.it] INFO: Scrape type for TZ47815: 0
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: RL97939
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL97939%27 HTTP/1.1" 200 None
2026-03-28 09:03:56 [auto1.it] INFO: Scrape type for RL97939: 0
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: SC91639
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: RM66107
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: KH81346
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: HY77897
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY77897%27 HTTP/1.1" 200 None
2026-03-28 09:03:56 [auto1.it] INFO: Scrape type for HY77897: 0
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: AZ70503
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: YS71318
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: NR25924
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: ND31908
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: ER28485
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: RP23530
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RP23530%27 HTTP/1.1" 200 None
2026-03-28 09:03:56 [auto1.it] INFO: Scrape type for RP23530: 0
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: HU57894
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: SN99997
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN99997%27 HTTP/1.1" 200 None
2026-03-28 09:03:56 [auto1.it] INFO: Scrape type for SN99997: 0
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: BE36594
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE36594%27 HTTP/1.1" 200 None
2026-03-28 09:03:56 [auto1.it] INFO: Scrape type for BE36594: 0
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: UR23669
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: LR45419
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR45419%27 HTTP/1.1" 200 None
2026-03-28 09:03:56 [auto1.it] INFO: Scrape type for LR45419: 0
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: XX72461
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX72461%27 HTTP/1.1" 200 None
2026-03-28 09:03:56 [auto1.it] INFO: Scrape type for XX72461: 0
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: RE68635
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE68635%27 HTTP/1.1" 200 None
2026-03-28 09:03:56 [auto1.it] INFO: Scrape type for RE68635: 0
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: JT08977
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT08977%27 HTTP/1.1" 200 None
2026-03-28 09:03:56 [auto1.it] INFO: Scrape type for JT08977: 0
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: HC78741
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC78741%27 HTTP/1.1" 200 None
2026-03-28 09:03:56 [auto1.it] INFO: Scrape type for HC78741: 0
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: XC90090
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: JK13765
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: UD57618
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: FH81414
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: GT75186
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: ZY33580
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: FX08227
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: EC01464
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: CZ44875
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: ZN99189
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN99189%27 HTTP/1.1" 200 None
2026-03-28 09:03:56 [auto1.it] INFO: Scrape type for ZN99189: 0
2026-03-28 09:03:56 [auto1.it] INFO: Found listing with ID: NG22695
2026-03-28 09:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:04:00 [auto1.it] INFO: Channel: 24h | Page: 70 | totalHits: 3435 | hits on page: 40
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: LZ33850
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ33850%27 HTTP/1.1" 200 None
2026-03-28 09:04:00 [auto1.it] INFO: Scrape type for LZ33850: 0
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: UZ86540
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ86540%27 HTTP/1.1" 200 None
2026-03-28 09:04:00 [auto1.it] INFO: Scrape type for UZ86540: 0
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: MU30420
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: EJ86461
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: WA22264
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA22264%27 HTTP/1.1" 200 None
2026-03-28 09:04:00 [auto1.it] INFO: Scrape type for WA22264: 0
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: ZL89240
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL89240%27 HTTP/1.1" 200 None
2026-03-28 09:04:00 [auto1.it] INFO: Scrape type for ZL89240: 0
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: SZ00349
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: LN67507
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN67507%27 HTTP/1.1" 200 None
2026-03-28 09:04:00 [auto1.it] INFO: Scrape type for LN67507: 0
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: KR37794
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: NF87616
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: GC68104
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: AE34833
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE34833%27 HTTP/1.1" 200 None
2026-03-28 09:04:00 [auto1.it] INFO: Scrape type for AE34833: 0
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: HS60673
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS60673%27 HTTP/1.1" 200 None
2026-03-28 09:04:00 [auto1.it] INFO: Scrape type for HS60673: 0
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: BT26363
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: RT50500
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: JM39933
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM39933%27 HTTP/1.1" 200 None
2026-03-28 09:04:00 [auto1.it] INFO: Scrape type for JM39933: 0
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: ZL56801
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: UU49973
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: CR75802
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: XM40674
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM40674%27 HTTP/1.1" 200 None
2026-03-28 09:04:00 [auto1.it] INFO: Scrape type for XM40674: 0
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: GY05881
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY05881%27 HTTP/1.1" 200 None
2026-03-28 09:04:00 [auto1.it] INFO: Scrape type for GY05881: 0
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: BS72965
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS72965%27 HTTP/1.1" 200 None
2026-03-28 09:04:00 [auto1.it] INFO: Scrape type for BS72965: 0
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: HR54236
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: UD54750
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: AK67199
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: WL39771
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: KW57065
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: MW60739
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: LM66726
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM66726%27 HTTP/1.1" 200 None
2026-03-28 09:04:00 [auto1.it] INFO: Scrape type for LM66726: 0
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: GT76958
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: VA29565
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: TC64761
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC64761%27 HTTP/1.1" 200 None
2026-03-28 09:04:00 [auto1.it] INFO: Scrape type for TC64761: 0
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: YH58285
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH58285%27 HTTP/1.1" 200 None
2026-03-28 09:04:00 [auto1.it] INFO: Scrape type for YH58285: 0
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: FM13591
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM13591%27 HTTP/1.1" 200 None
2026-03-28 09:04:00 [auto1.it] INFO: Scrape type for FM13591: 0
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: BJ23148
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: YJ83729
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: FJ55026
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ55026%27 HTTP/1.1" 200 None
2026-03-28 09:04:00 [auto1.it] INFO: Scrape type for FJ55026: 0
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: RV64880
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: PS94410
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS94410%27 HTTP/1.1" 200 None
2026-03-28 09:04:00 [auto1.it] INFO: Scrape type for PS94410: 0
2026-03-28 09:04:00 [auto1.it] INFO: Found listing with ID: PW94940
2026-03-28 09:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:04:01 [auto1.it] INFO: Channel: 24h | Page: 71 | totalHits: 3435 | hits on page: 40
2026-03-28 09:04:01 [auto1.it] INFO: Found listing with ID: PK39445
2026-03-28 09:04:01 [auto1.it] INFO: Found listing with ID: HC25835
2026-03-28 09:04:01 [auto1.it] INFO: Found listing with ID: DC04279
2026-03-28 09:04:01 [auto1.it] INFO: Found listing with ID: BH96807
2026-03-28 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH96807%27 HTTP/1.1" 200 None
2026-03-28 09:04:01 [auto1.it] INFO: Scrape type for BH96807: 0
2026-03-28 09:04:01 [auto1.it] INFO: Found listing with ID: WP65731
2026-03-28 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP65731%27 HTTP/1.1" 200 None
2026-03-28 09:04:01 [auto1.it] INFO: Scrape type for WP65731: 0
2026-03-28 09:04:01 [auto1.it] INFO: Found listing with ID: EH79430
2026-03-28 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH79430%27 HTTP/1.1" 200 None
2026-03-28 09:04:01 [auto1.it] INFO: Scrape type for EH79430: 0
2026-03-28 09:04:01 [auto1.it] INFO: Found listing with ID: YB05417
2026-03-28 09:04:01 [auto1.it] INFO: Found listing with ID: XB62766
2026-03-28 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB62766%27 HTTP/1.1" 200 None
2026-03-28 09:04:01 [auto1.it] INFO: Scrape type for XB62766: 0
2026-03-28 09:04:01 [auto1.it] INFO: Found listing with ID: CN31542
2026-03-28 09:04:01 [auto1.it] INFO: Found listing with ID: DY75013
2026-03-28 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY75013%27 HTTP/1.1" 200 None
2026-03-28 09:04:01 [auto1.it] INFO: Scrape type for DY75013: 0
2026-03-28 09:04:01 [auto1.it] INFO: Found listing with ID: UC13059
2026-03-28 09:04:01 [auto1.it] INFO: Found listing with ID: RU19351
2026-03-28 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU19351%27 HTTP/1.1" 200 None
2026-03-28 09:04:02 [auto1.it] INFO: Scrape type for RU19351: 0
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: JX57169
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: AE05588
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE05588%27 HTTP/1.1" 200 None
2026-03-28 09:04:02 [auto1.it] INFO: Scrape type for AE05588: 0
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: ZJ55913
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ55913%27 HTTP/1.1" 200 None
2026-03-28 09:04:02 [auto1.it] INFO: Scrape type for ZJ55913: 0
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: AT75049
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT75049%27 HTTP/1.1" 200 None
2026-03-28 09:04:02 [auto1.it] INFO: Scrape type for AT75049: 0
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: SE76395
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE76395%27 HTTP/1.1" 200 None
2026-03-28 09:04:02 [auto1.it] INFO: Scrape type for SE76395: 0
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: MB12953
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: GU93940
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: LW86872
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: LE96160
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: FU73160
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: UF29900
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF29900%27 HTTP/1.1" 200 None
2026-03-28 09:04:02 [auto1.it] INFO: Scrape type for UF29900: 0
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: GM73700
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM73700%27 HTTP/1.1" 200 None
2026-03-28 09:04:02 [auto1.it] INFO: Scrape type for GM73700: 0
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: JP63485
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP63485%27 HTTP/1.1" 200 None
2026-03-28 09:04:02 [auto1.it] INFO: Scrape type for JP63485: 0
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: AB86109
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB86109%27 HTTP/1.1" 200 None
2026-03-28 09:04:02 [auto1.it] INFO: Scrape type for AB86109: 0
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: VT00900
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT00900%27 HTTP/1.1" 200 None
2026-03-28 09:04:02 [auto1.it] INFO: Scrape type for VT00900: 0
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: BW24813
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: GL62022
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: PV85970
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: LC62662
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: EV28185
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: HR15000
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR15000%27 HTTP/1.1" 200 None
2026-03-28 09:04:02 [auto1.it] INFO: Scrape type for HR15000: 0
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: FA16942
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: ET15005
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: LM08573
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM08573%27 HTTP/1.1" 200 None
2026-03-28 09:04:02 [auto1.it] INFO: Scrape type for LM08573: 0
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: MH63316
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: FN23706
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN23706%27 HTTP/1.1" 200 None
2026-03-28 09:04:02 [auto1.it] INFO: Scrape type for FN23706: 0
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: ZR50624
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR50624%27 HTTP/1.1" 200 None
2026-03-28 09:04:02 [auto1.it] INFO: Scrape type for ZR50624: 0
2026-03-28 09:04:02 [auto1.it] INFO: Found listing with ID: NP16593
2026-03-28 09:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:04:03 [auto1.it] INFO: Channel: 24h | Page: 72 | totalHits: 3435 | hits on page: 40
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: CB44170
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: DV62458
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV62458%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for DV62458: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: BJ52580
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ52580%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for BJ52580: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: BN67984
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN67984%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for BN67984: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: RJ45303
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ45303%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for RJ45303: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: CV62006
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV62006%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for CV62006: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: BV13892
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: VG64666
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: XC82626
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: WV75327
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV75327%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for WV75327: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: JC13198
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC13198%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for JC13198: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: VS87113
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS87113%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for VS87113: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: YD67684
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: VX54252
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX54252%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for VX54252: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: UA46628
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA46628%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for UA46628: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: KG92568
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: YJ41537
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ41537%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for YJ41537: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: GW20586
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW20586%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for GW20586: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: AL26239
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: AK60352
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: CH30071
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: MW84295
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW84295%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for MW84295: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: PW65105
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW65105%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for PW65105: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: CN99073
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: ES11783
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: RF56449
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: NR19227
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: LE11885
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: LC05888
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: TL13450
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL13450%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for TL13450: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: HY91699
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: ZY78533
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: WH00709
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH00709%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for WH00709: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: YM07828
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM07828%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for YM07828: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: BD99197
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: CF35894
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF35894%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for CF35894: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: UM78803
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: LW40364
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: CW25523
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW25523%27 HTTP/1.1" 200 None
2026-03-28 09:04:03 [auto1.it] INFO: Scrape type for CW25523: 0
2026-03-28 09:04:03 [auto1.it] INFO: Found listing with ID: AK92313
2026-03-28 09:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:04:04 [auto1.it] INFO: Channel: 24h | Page: 73 | totalHits: 3435 | hits on page: 40
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: FZ95983
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ95983%27 HTTP/1.1" 200 None
2026-03-28 09:04:04 [auto1.it] INFO: Scrape type for FZ95983: 0
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: LB07538
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB07538%27 HTTP/1.1" 200 None
2026-03-28 09:04:04 [auto1.it] INFO: Scrape type for LB07538: 0
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: XT45099
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT45099%27 HTTP/1.1" 200 None
2026-03-28 09:04:04 [auto1.it] INFO: Scrape type for XT45099: 0
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: SK74491
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: KN82468
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: MU83341
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU83341%27 HTTP/1.1" 200 None
2026-03-28 09:04:04 [auto1.it] INFO: Scrape type for MU83341: 0
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: PM68240
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM68240%27 HTTP/1.1" 200 None
2026-03-28 09:04:04 [auto1.it] INFO: Scrape type for PM68240: 0
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: HR92713
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR92713%27 HTTP/1.1" 200 None
2026-03-28 09:04:04 [auto1.it] INFO: Scrape type for HR92713: 0
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: JF75950
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: BF69187
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF69187%27 HTTP/1.1" 200 None
2026-03-28 09:04:04 [auto1.it] INFO: Scrape type for BF69187: 0
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: BL65453
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL65453%27 HTTP/1.1" 200 None
2026-03-28 09:04:04 [auto1.it] INFO: Scrape type for BL65453: 0
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: PG89190
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: TW94655
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW94655%27 HTTP/1.1" 200 None
2026-03-28 09:04:04 [auto1.it] INFO: Scrape type for TW94655: 0
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: DX46579
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX46579%27 HTTP/1.1" 200 None
2026-03-28 09:04:04 [auto1.it] INFO: Scrape type for DX46579: 0
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: RS22306
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: VD33216
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VD33216%27 HTTP/1.1" 200 None
2026-03-28 09:04:04 [auto1.it] INFO: Scrape type for VD33216: 0
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: EX06757
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX06757%27 HTTP/1.1" 200 None
2026-03-28 09:04:04 [auto1.it] INFO: Scrape type for EX06757: 0
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: JT03140
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: ZZ64526
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: WZ44056
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ44056%27 HTTP/1.1" 200 None
2026-03-28 09:04:04 [auto1.it] INFO: Scrape type for WZ44056: 0
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: AC09989
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: EH65874
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: UA98317
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: XE71259
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: KX33846
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: NE12117
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: JH33133
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: UZ05025
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: MY92785
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY92785%27 HTTP/1.1" 200 None
2026-03-28 09:04:04 [auto1.it] INFO: Scrape type for MY92785: 0
2026-03-28 09:04:04 [auto1.it] INFO: Found listing with ID: UJ60071
2026-03-28 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ60071%27 HTTP/1.1" 200 None
2026-03-28 09:04:05 [auto1.it] INFO: Scrape type for UJ60071: 0
2026-03-28 09:04:05 [auto1.it] INFO: Found listing with ID: HP12790
2026-03-28 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP12790%27 HTTP/1.1" 200 None
2026-03-28 09:04:05 [auto1.it] INFO: Scrape type for HP12790: 0
2026-03-28 09:04:05 [auto1.it] INFO: Found listing with ID: RL61545
2026-03-28 09:04:05 [auto1.it] INFO: Found listing with ID: TA87203
2026-03-28 09:04:05 [auto1.it] INFO: Found listing with ID: VV94396
2026-03-28 09:04:05 [auto1.it] INFO: Found listing with ID: EY67229
2026-03-28 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY67229%27 HTTP/1.1" 200 None
2026-03-28 09:04:05 [auto1.it] INFO: Scrape type for EY67229: 0
2026-03-28 09:04:05 [auto1.it] INFO: Found listing with ID: BV29552
2026-03-28 09:04:05 [auto1.it] INFO: Found listing with ID: EG00977
2026-03-28 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG00977%27 HTTP/1.1" 200 None
2026-03-28 09:04:05 [auto1.it] INFO: Scrape type for EG00977: 0
2026-03-28 09:04:05 [auto1.it] INFO: Found listing with ID: UE31204
2026-03-28 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE31204%27 HTTP/1.1" 200 None
2026-03-28 09:04:05 [auto1.it] INFO: Scrape type for UE31204: 0
2026-03-28 09:04:05 [auto1.it] INFO: Found listing with ID: WW68303
2026-03-28 09:04:05 [auto1.it] INFO: Found listing with ID: UZ72139
2026-03-28 09:04:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:05 [scrapy.extensions.logstats] INFO: Crawled 159 pages (at 29 pages/min), scraped 146 items (at 5 items/min)
2026-03-28 09:04:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 190MiB
2026-03-28 09:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:04:06 [auto1.it] INFO: Channel: 24h | Page: 74 | totalHits: 3435 | hits on page: 40
2026-03-28 09:04:06 [auto1.it] INFO: Found listing with ID: XP38873
2026-03-28 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP38873%27 HTTP/1.1" 200 None
2026-03-28 09:04:06 [auto1.it] INFO: Scrape type for XP38873: 0
2026-03-28 09:04:06 [auto1.it] INFO: Found listing with ID: PH70338
2026-03-28 09:04:06 [auto1.it] INFO: Found listing with ID: RM50913
2026-03-28 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM50913%27 HTTP/1.1" 200 None
2026-03-28 09:04:06 [auto1.it] INFO: Scrape type for RM50913: 0
2026-03-28 09:04:06 [auto1.it] INFO: Found listing with ID: SM29752
2026-03-28 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM29752%27 HTTP/1.1" 200 None
2026-03-28 09:04:06 [auto1.it] INFO: Scrape type for SM29752: 0
2026-03-28 09:04:06 [auto1.it] INFO: Found listing with ID: PT89621
2026-03-28 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT89621%27 HTTP/1.1" 200 None
2026-03-28 09:04:06 [auto1.it] INFO: Scrape type for PT89621: 2
2026-03-28 09:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee8d118e-88e8-5457-a931-3ab63a06a8a5 with identifier: PT89621
2026-03-28 09:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee8d118e-88e8-5457-a931-3ab63a06a8a5 with scrape type 2
2026-03-28 09:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee8d118e-88e8-5457-a931-3ab63a06a8a5 with scrape type 2
2026-03-28 09:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ee8d118e-88e8-5457-a931-3ab63a06a8a5, identifier: PT89621
2026-03-28 09:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ee8d118e-88e8-5457-a931-3ab63a06a8a5 with identifier: PT89621
2026-03-28 09:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ee8d118e-88e8-5457-a931-3ab63a06a8a5 with identifier: PT89621
2026-03-28 09:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ee8d118e-88e8-5457-a931-3ab63a06a8a5 with identifier: PT89621 to the API
2026-03-28 09:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:11:07Z',
 'fuel_type': 'diesel',
 'id': 'ee8d118e-88e8-5457-a931-3ab63a06a8a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT89621',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 285123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-31',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT89621%27 HTTP/1.1" 200 None
2026-03-28 09:04:07 [auto1.it] INFO: Saving data for PT89621: {'auction_closing_time': 1774714267.0, 'created_time': 1774602026.713476, 'last_price_update_time': 1774688647.001531}
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PT89621') HTTP/1.1" 204 0
2026-03-28 09:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:07 [auto1.it] INFO: Found listing with ID: LG18660
2026-03-28 09:04:07 [auto1.it] INFO: Found listing with ID: UA37690
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA37690%27 HTTP/1.1" 200 None
2026-03-28 09:04:07 [auto1.it] INFO: Scrape type for UA37690: 0
2026-03-28 09:04:07 [auto1.it] INFO: Found listing with ID: DD38287
2026-03-28 09:04:07 [auto1.it] INFO: Found listing with ID: AN07116
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN07116%27 HTTP/1.1" 200 None
2026-03-28 09:04:07 [auto1.it] INFO: Scrape type for AN07116: 0
2026-03-28 09:04:07 [auto1.it] INFO: Found listing with ID: FS34329
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS34329%27 HTTP/1.1" 200 None
2026-03-28 09:04:07 [auto1.it] INFO: Scrape type for FS34329: 2
2026-03-28 09:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09aa3dbc-1766-5363-b59a-d90adc077779 with identifier: FS34329
2026-03-28 09:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09aa3dbc-1766-5363-b59a-d90adc077779 with scrape type 2
2026-03-28 09:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09aa3dbc-1766-5363-b59a-d90adc077779 with scrape type 2
2026-03-28 09:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 09aa3dbc-1766-5363-b59a-d90adc077779, identifier: FS34329
2026-03-28 09:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 09aa3dbc-1766-5363-b59a-d90adc077779 with identifier: FS34329
2026-03-28 09:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 09aa3dbc-1766-5363-b59a-d90adc077779 with identifier: FS34329
2026-03-28 09:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 09aa3dbc-1766-5363-b59a-d90adc077779 with identifier: FS34329 to the API
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:13:02Z',
 'fuel_type': 'diesel',
 'id': '09aa3dbc-1766-5363-b59a-d90adc077779',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS34329',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 213040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-10',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS34329%27 HTTP/1.1" 200 None
2026-03-28 09:04:07 [auto1.it] INFO: Saving data for FS34329: {'auction_closing_time': 1774714382.0, 'created_time': 1774602032.954954, 'last_price_update_time': 1774688647.536007}
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FS34329') HTTP/1.1" 204 0
2026-03-28 09:04:07 [auto1.it] INFO: Found listing with ID: ZU37783
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU37783%27 HTTP/1.1" 200 None
2026-03-28 09:04:07 [auto1.it] INFO: Scrape type for ZU37783: 0
2026-03-28 09:04:07 [auto1.it] INFO: Found listing with ID: MA77848
2026-03-28 09:04:07 [auto1.it] INFO: Found listing with ID: EZ27389
2026-03-28 09:04:07 [auto1.it] INFO: Found listing with ID: NZ40909
2026-03-28 09:04:07 [auto1.it] INFO: Found listing with ID: UW92889
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW92889%27 HTTP/1.1" 200 None
2026-03-28 09:04:07 [auto1.it] INFO: Scrape type for UW92889: 0
2026-03-28 09:04:07 [auto1.it] INFO: Found listing with ID: NC90447
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC90447%27 HTTP/1.1" 200 None
2026-03-28 09:04:07 [auto1.it] INFO: Scrape type for NC90447: 2
2026-03-28 09:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18b44cfe-4eb8-5ab8-9693-cf6da0938176 with identifier: NC90447
2026-03-28 09:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18b44cfe-4eb8-5ab8-9693-cf6da0938176 with scrape type 2
2026-03-28 09:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18b44cfe-4eb8-5ab8-9693-cf6da0938176 with scrape type 2
2026-03-28 09:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 18b44cfe-4eb8-5ab8-9693-cf6da0938176, identifier: NC90447
2026-03-28 09:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 18b44cfe-4eb8-5ab8-9693-cf6da0938176 with identifier: NC90447
2026-03-28 09:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 18b44cfe-4eb8-5ab8-9693-cf6da0938176 with identifier: NC90447
2026-03-28 09:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 18b44cfe-4eb8-5ab8-9693-cf6da0938176 with identifier: NC90447 to the API
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:44:15Z',
 'fuel_type': 'diesel',
 'id': '18b44cfe-4eb8-5ab8-9693-cf6da0938176',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC90447',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 161064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-03',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC90447%27 HTTP/1.1" 200 None
2026-03-28 09:04:07 [auto1.it] INFO: Saving data for NC90447: {'auction_closing_time': 1774716255.0, 'created_time': 1774602028.520609, 'last_price_update_time': 1774688647.956088}
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NC90447') HTTP/1.1" 204 0
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: GR65234
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR65234%27 HTTP/1.1" 200 None
2026-03-28 09:04:08 [auto1.it] INFO: Scrape type for GR65234: 0
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: VS88689
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: KA98059
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: MZ03364
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ03364%27 HTTP/1.1" 200 None
2026-03-28 09:04:08 [auto1.it] INFO: Scrape type for MZ03364: 0
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: FF49180
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: NZ37386
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ37386%27 HTTP/1.1" 200 None
2026-03-28 09:04:08 [auto1.it] INFO: Scrape type for NZ37386: 0
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: PN03774
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN03774%27 HTTP/1.1" 200 None
2026-03-28 09:04:08 [auto1.it] INFO: Scrape type for PN03774: 0
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: EV67651
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: JV05910
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV05910%27 HTTP/1.1" 200 None
2026-03-28 09:04:08 [auto1.it] INFO: Scrape type for JV05910: 0
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: KZ16799
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: HZ70208
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: VR56129
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: EJ60730
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: BE98404
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE98404%27 HTTP/1.1" 200 None
2026-03-28 09:04:08 [auto1.it] INFO: Scrape type for BE98404: 2
2026-03-28 09:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7813385b-b691-566c-9cf0-58efcfa24ce7 with identifier: BE98404
2026-03-28 09:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7813385b-b691-566c-9cf0-58efcfa24ce7 with scrape type 2
2026-03-28 09:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7813385b-b691-566c-9cf0-58efcfa24ce7 with scrape type 2
2026-03-28 09:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7813385b-b691-566c-9cf0-58efcfa24ce7, identifier: BE98404
2026-03-28 09:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7813385b-b691-566c-9cf0-58efcfa24ce7 with identifier: BE98404
2026-03-28 09:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7813385b-b691-566c-9cf0-58efcfa24ce7 with identifier: BE98404
2026-03-28 09:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7813385b-b691-566c-9cf0-58efcfa24ce7 with identifier: BE98404 to the API
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:21:32Z',
 'fuel_type': 'diesel',
 'id': '7813385b-b691-566c-9cf0-58efcfa24ce7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE98404',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 190950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-22',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2010}
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE98404%27 HTTP/1.1" 200 None
2026-03-28 09:04:08 [auto1.it] INFO: Saving data for BE98404: {'auction_closing_time': 1774714892.0, 'created_time': 1774299863.119619, 'last_price_update_time': 1774688648.564927}
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BE98404') HTTP/1.1" 204 0
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: CZ22961
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: AY46194
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: PR79135
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: UC24034
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC24034%27 HTTP/1.1" 200 None
2026-03-28 09:04:08 [auto1.it] INFO: Scrape type for UC24034: 0
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: FX03621
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: AG93268
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: XV25356
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: SN26450
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: PA07928
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA07928%27 HTTP/1.1" 200 None
2026-03-28 09:04:08 [auto1.it] INFO: Scrape type for PA07928: 0
2026-03-28 09:04:08 [auto1.it] INFO: Found listing with ID: LV99150
2026-03-28 09:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:04:09 [auto1.it] INFO: Channel: 24h | Page: 75 | totalHits: 3435 | hits on page: 40
2026-03-28 09:04:09 [auto1.it] INFO: Found listing with ID: UL06285
2026-03-28 09:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL06285%27 HTTP/1.1" 200 None
2026-03-28 09:04:09 [auto1.it] INFO: Scrape type for UL06285: 2
2026-03-28 09:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a10c1e96-8b32-58f9-8dac-60aad3b38836 with identifier: UL06285
2026-03-28 09:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a10c1e96-8b32-58f9-8dac-60aad3b38836 with scrape type 2
2026-03-28 09:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a10c1e96-8b32-58f9-8dac-60aad3b38836 with scrape type 2
2026-03-28 09:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a10c1e96-8b32-58f9-8dac-60aad3b38836, identifier: UL06285
2026-03-28 09:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a10c1e96-8b32-58f9-8dac-60aad3b38836 with identifier: UL06285
2026-03-28 09:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a10c1e96-8b32-58f9-8dac-60aad3b38836 with identifier: UL06285
2026-03-28 09:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a10c1e96-8b32-58f9-8dac-60aad3b38836 with identifier: UL06285 to the API
2026-03-28 09:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:20:21Z',
 'fuel_type': 'diesel',
 'id': 'a10c1e96-8b32-58f9-8dac-60aad3b38836',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL06285',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Optima',
 'odometer': 212812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-27',
 'seller_name': None,
 'title': 'Kia Optima 1.7 CRDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2017}
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL06285%27 HTTP/1.1" 200 None
2026-03-28 09:04:10 [auto1.it] INFO: Saving data for UL06285: {'auction_closing_time': 1774714821.0, 'created_time': 1774300075.733606, 'last_price_update_time': 1774688650.104485}
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UL06285') HTTP/1.1" 204 0
2026-03-28 09:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:10 [auto1.it] INFO: Found listing with ID: JB83291
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB83291%27 HTTP/1.1" 200 None
2026-03-28 09:04:10 [auto1.it] INFO: Scrape type for JB83291: 0
2026-03-28 09:04:10 [auto1.it] INFO: Found listing with ID: TG59717
2026-03-28 09:04:10 [auto1.it] INFO: Found listing with ID: DX02178
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX02178%27 HTTP/1.1" 200 None
2026-03-28 09:04:10 [auto1.it] INFO: Scrape type for DX02178: 0
2026-03-28 09:04:10 [auto1.it] INFO: Found listing with ID: BD73790
2026-03-28 09:04:10 [auto1.it] INFO: Found listing with ID: PK74621
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK74621%27 HTTP/1.1" 200 None
2026-03-28 09:04:10 [auto1.it] INFO: Scrape type for PK74621: 2
2026-03-28 09:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c924d97-8d1b-5999-88d8-33db84479f19 with identifier: PK74621
2026-03-28 09:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c924d97-8d1b-5999-88d8-33db84479f19 with scrape type 2
2026-03-28 09:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c924d97-8d1b-5999-88d8-33db84479f19 with scrape type 2
2026-03-28 09:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5c924d97-8d1b-5999-88d8-33db84479f19, identifier: PK74621
2026-03-28 09:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5c924d97-8d1b-5999-88d8-33db84479f19 with identifier: PK74621
2026-03-28 09:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5c924d97-8d1b-5999-88d8-33db84479f19 with identifier: PK74621
2026-03-28 09:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5c924d97-8d1b-5999-88d8-33db84479f19 with identifier: PK74621 to the API
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:10:18Z',
 'fuel_type': 'diesel',
 'id': '5c924d97-8d1b-5999-88d8-33db84479f19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK74621',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 105284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-13',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 160 CDI AMG Sport',
 'transmission': 'manual',
 'trim': 'AMG Sport',
 'year': 2016}
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK74621%27 HTTP/1.1" 200 None
2026-03-28 09:04:10 [auto1.it] INFO: Saving data for PK74621: {'auction_closing_time': 1774714218.0, 'created_time': 1774300047.893466, 'last_price_update_time': 1774688650.603647}
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PK74621') HTTP/1.1" 204 0
2026-03-28 09:04:10 [auto1.it] INFO: Found listing with ID: TG93645
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG93645%27 HTTP/1.1" 200 None
2026-03-28 09:04:10 [auto1.it] INFO: Scrape type for TG93645: 0
2026-03-28 09:04:10 [auto1.it] INFO: Found listing with ID: DD55036
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD55036%27 HTTP/1.1" 200 None
2026-03-28 09:04:10 [auto1.it] INFO: Scrape type for DD55036: 0
2026-03-28 09:04:10 [auto1.it] INFO: Found listing with ID: SH99694
2026-03-28 09:04:10 [auto1.it] INFO: Found listing with ID: NF38082
2026-03-28 09:04:10 [auto1.it] INFO: Found listing with ID: BY06123
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY06123%27 HTTP/1.1" 200 None
2026-03-28 09:04:10 [auto1.it] INFO: Scrape type for BY06123: 0
2026-03-28 09:04:10 [auto1.it] INFO: Found listing with ID: PT68883
2026-03-28 09:04:10 [auto1.it] INFO: Found listing with ID: BF81880
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF81880%27 HTTP/1.1" 200 None
2026-03-28 09:04:10 [auto1.it] INFO: Scrape type for BF81880: 0
2026-03-28 09:04:10 [auto1.it] INFO: Found listing with ID: HG18459
2026-03-28 09:04:10 [auto1.it] INFO: Found listing with ID: SB68054
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB68054%27 HTTP/1.1" 200 None
2026-03-28 09:04:10 [auto1.it] INFO: Scrape type for SB68054: 0
2026-03-28 09:04:10 [auto1.it] INFO: Found listing with ID: VY30881
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY30881%27 HTTP/1.1" 200 None
2026-03-28 09:04:10 [auto1.it] INFO: Scrape type for VY30881: 2
2026-03-28 09:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8495f1c5-7fb9-5cf4-bfe3-1434215fa1be with identifier: VY30881
2026-03-28 09:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8495f1c5-7fb9-5cf4-bfe3-1434215fa1be with scrape type 2
2026-03-28 09:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8495f1c5-7fb9-5cf4-bfe3-1434215fa1be with scrape type 2
2026-03-28 09:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8495f1c5-7fb9-5cf4-bfe3-1434215fa1be, identifier: VY30881
2026-03-28 09:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8495f1c5-7fb9-5cf4-bfe3-1434215fa1be with identifier: VY30881
2026-03-28 09:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8495f1c5-7fb9-5cf4-bfe3-1434215fa1be with identifier: VY30881
2026-03-28 09:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8495f1c5-7fb9-5cf4-bfe3-1434215fa1be with identifier: VY30881 to the API
2026-03-28 09:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:34:55Z',
 'fuel_type': 'diesel',
 'id': '8495f1c5-7fb9-5cf4-bfe3-1434215fa1be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY30881',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 143228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-11',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 220 d Shooting Brake BlueTEC Sport',
 'transmission': 'automatic',
 'trim': 'BlueTEC Sport',
 'year': 2016}
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY30881%27 HTTP/1.1" 200 None
2026-03-28 09:04:11 [auto1.it] INFO: Saving data for VY30881: {'auction_closing_time': 1774715695.0, 'created_time': 1773136030.098204, 'last_price_update_time': 1774688651.11548}
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VY30881') HTTP/1.1" 204 0
2026-03-28 09:04:11 [auto1.it] INFO: Found listing with ID: KT34727
2026-03-28 09:04:11 [auto1.it] INFO: Found listing with ID: YB75201
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB75201%27 HTTP/1.1" 200 None
2026-03-28 09:04:11 [auto1.it] INFO: Scrape type for YB75201: 0
2026-03-28 09:04:11 [auto1.it] INFO: Found listing with ID: UE17288
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE17288%27 HTTP/1.1" 200 None
2026-03-28 09:04:11 [auto1.it] INFO: Scrape type for UE17288: 2
2026-03-28 09:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 137dd08d-3e3a-5c38-ad2f-57a8db15011c with identifier: UE17288
2026-03-28 09:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 137dd08d-3e3a-5c38-ad2f-57a8db15011c with scrape type 2
2026-03-28 09:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 137dd08d-3e3a-5c38-ad2f-57a8db15011c with scrape type 2
2026-03-28 09:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 137dd08d-3e3a-5c38-ad2f-57a8db15011c, identifier: UE17288
2026-03-28 09:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 137dd08d-3e3a-5c38-ad2f-57a8db15011c with identifier: UE17288
2026-03-28 09:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 137dd08d-3e3a-5c38-ad2f-57a8db15011c with identifier: UE17288
2026-03-28 09:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 137dd08d-3e3a-5c38-ad2f-57a8db15011c with identifier: UE17288 to the API
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:41:47Z',
 'fuel_type': 'diesel',
 'id': '137dd08d-3e3a-5c38-ad2f-57a8db15011c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE17288',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 254595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-12',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.3 JTD Progression',
 'transmission': 'manual',
 'trim': 'Progression',
 'year': 2011}
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE17288%27 HTTP/1.1" 200 None
2026-03-28 09:04:11 [auto1.it] INFO: Saving data for UE17288: {'auction_closing_time': 1774716107.0, 'created_time': 1774094606.958989, 'last_price_update_time': 1774688651.617255}
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UE17288') HTTP/1.1" 204 0
2026-03-28 09:04:11 [auto1.it] INFO: Found listing with ID: YX10047
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX10047%27 HTTP/1.1" 200 None
2026-03-28 09:04:11 [auto1.it] INFO: Scrape type for YX10047: 2
2026-03-28 09:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7257a163-62a2-5aa9-aaa9-c799e6e43204 with identifier: YX10047
2026-03-28 09:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7257a163-62a2-5aa9-aaa9-c799e6e43204 with scrape type 2
2026-03-28 09:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7257a163-62a2-5aa9-aaa9-c799e6e43204 with scrape type 2
2026-03-28 09:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7257a163-62a2-5aa9-aaa9-c799e6e43204, identifier: YX10047
2026-03-28 09:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7257a163-62a2-5aa9-aaa9-c799e6e43204 with identifier: YX10047
2026-03-28 09:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7257a163-62a2-5aa9-aaa9-c799e6e43204 with identifier: YX10047
2026-03-28 09:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7257a163-62a2-5aa9-aaa9-c799e6e43204 with identifier: YX10047 to the API
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:25:51Z',
 'fuel_type': 'diesel',
 'id': '7257a163-62a2-5aa9-aaa9-c799e6e43204',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX10047',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 203516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion',
 'year': 2017}
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX10047%27 HTTP/1.1" 200 None
2026-03-28 09:04:12 [auto1.it] INFO: Saving data for YX10047: {'auction_closing_time': 1774715151.0, 'created_time': 1774602043.061623, 'last_price_update_time': 1774688652.010303}
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YX10047') HTTP/1.1" 204 0
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: BD43330
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: FT22704
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT22704%27 HTTP/1.1" 200 None
2026-03-28 09:04:12 [auto1.it] INFO: Scrape type for FT22704: 0
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: FU42856
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU42856%27 HTTP/1.1" 200 None
2026-03-28 09:04:12 [auto1.it] INFO: Scrape type for FU42856: 0
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: WY54071
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY54071%27 HTTP/1.1" 200 None
2026-03-28 09:04:12 [auto1.it] INFO: Scrape type for WY54071: 0
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: CS68621
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS68621%27 HTTP/1.1" 200 None
2026-03-28 09:04:12 [auto1.it] INFO: Scrape type for CS68621: 0
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: FT43083
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: HU04780
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: BM42520
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM42520%27 HTTP/1.1" 200 None
2026-03-28 09:04:12 [auto1.it] INFO: Scrape type for BM42520: 0
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: MD14180
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: PY21369
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: XZ55537
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ55537%27 HTTP/1.1" 200 None
2026-03-28 09:04:12 [auto1.it] INFO: Scrape type for XZ55537: 0
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: XW45727
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: MJ56549
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: RG49415
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: MZ03960
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ03960%27 HTTP/1.1" 200 None
2026-03-28 09:04:12 [auto1.it] INFO: Scrape type for MZ03960: 2
2026-03-28 09:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a08765b-580c-55f5-b78d-7844787b6b1e with identifier: MZ03960
2026-03-28 09:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a08765b-580c-55f5-b78d-7844787b6b1e with scrape type 2
2026-03-28 09:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a08765b-580c-55f5-b78d-7844787b6b1e with scrape type 2
2026-03-28 09:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4a08765b-580c-55f5-b78d-7844787b6b1e, identifier: MZ03960
2026-03-28 09:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4a08765b-580c-55f5-b78d-7844787b6b1e with identifier: MZ03960
2026-03-28 09:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4a08765b-580c-55f5-b78d-7844787b6b1e with identifier: MZ03960
2026-03-28 09:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4a08765b-580c-55f5-b78d-7844787b6b1e with identifier: MZ03960 to the API
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:24:24Z',
 'fuel_type': 'diesel',
 'id': '4a08765b-580c-55f5-b78d-7844787b6b1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ03960',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 174928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Xprime ISG 2WD',
 'transmission': 'automatic',
 'trim': 'Xprime ISG 2WD',
 'year': 2019}
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ03960%27 HTTP/1.1" 200 None
2026-03-28 09:04:12 [auto1.it] INFO: Saving data for MZ03960: {'auction_closing_time': 1774715064.0, 'created_time': 1774267290.804713, 'last_price_update_time': 1774688652.523638}
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MZ03960') HTTP/1.1" 204 0
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: SX19566
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX19566%27 HTTP/1.1" 200 None
2026-03-28 09:04:12 [auto1.it] INFO: Scrape type for SX19566: 0
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: TT73216
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: SW30840
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: JT48153
2026-03-28 09:04:12 [auto1.it] INFO: Found listing with ID: XY41121
2026-03-28 09:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:04:14 [auto1.it] INFO: Channel: 24h | Page: 76 | totalHits: 3435 | hits on page: 40
2026-03-28 09:04:14 [auto1.it] INFO: Found listing with ID: NP81459
2026-03-28 09:04:14 [auto1.it] INFO: Found listing with ID: YG79824
2026-03-28 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG79824%27 HTTP/1.1" 200 None
2026-03-28 09:04:14 [auto1.it] INFO: Scrape type for YG79824: 2
2026-03-28 09:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f3486be-dfad-522c-967c-bc0e73ff29c5 with identifier: YG79824
2026-03-28 09:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f3486be-dfad-522c-967c-bc0e73ff29c5 with scrape type 2
2026-03-28 09:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f3486be-dfad-522c-967c-bc0e73ff29c5 with scrape type 2
2026-03-28 09:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1f3486be-dfad-522c-967c-bc0e73ff29c5, identifier: YG79824
2026-03-28 09:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1f3486be-dfad-522c-967c-bc0e73ff29c5 with identifier: YG79824
2026-03-28 09:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1f3486be-dfad-522c-967c-bc0e73ff29c5 with identifier: YG79824
2026-03-28 09:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1f3486be-dfad-522c-967c-bc0e73ff29c5 with identifier: YG79824 to the API
2026-03-28 09:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:03:22Z',
 'fuel_type': 'diesel',
 'id': '1f3486be-dfad-522c-967c-bc0e73ff29c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG79824',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 151410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-25',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 2.1 CDI kompakt Activity Ambiente',
 'transmission': 'automatic',
 'trim': 'kompakt Activity Ambiente',
 'year': 2008}
2026-03-28 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG79824%27 HTTP/1.1" 200 None
2026-03-28 09:04:14 [auto1.it] INFO: Saving data for YG79824: {'auction_closing_time': 1774713802.0, 'created_time': 1774602049.31692, 'last_price_update_time': 1774688654.808271}
2026-03-28 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YG79824') HTTP/1.1" 204 0
2026-03-28 09:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:14 [auto1.it] INFO: Found listing with ID: JD30640
2026-03-28 09:04:14 [auto1.it] INFO: Found listing with ID: WL66559
2026-03-28 09:04:14 [auto1.it] INFO: Found listing with ID: HD95534
2026-03-28 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD95534%27 HTTP/1.1" 200 None
2026-03-28 09:04:14 [auto1.it] INFO: Scrape type for HD95534: 0
2026-03-28 09:04:14 [auto1.it] INFO: Found listing with ID: HY50336
2026-03-28 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY50336%27 HTTP/1.1" 200 None
2026-03-28 09:04:14 [auto1.it] INFO: Scrape type for HY50336: 2
2026-03-28 09:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c872a8a2-8087-5078-951e-4c0d44173d43 with identifier: HY50336
2026-03-28 09:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c872a8a2-8087-5078-951e-4c0d44173d43 with scrape type 2
2026-03-28 09:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c872a8a2-8087-5078-951e-4c0d44173d43 with scrape type 2
2026-03-28 09:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c872a8a2-8087-5078-951e-4c0d44173d43, identifier: HY50336
2026-03-28 09:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c872a8a2-8087-5078-951e-4c0d44173d43 with identifier: HY50336
2026-03-28 09:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c872a8a2-8087-5078-951e-4c0d44173d43 with identifier: HY50336
2026-03-28 09:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c872a8a2-8087-5078-951e-4c0d44173d43 with identifier: HY50336 to the API
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:34:52Z',
 'fuel_type': 'petrol',
 'id': 'c872a8a2-8087-5078-951e-4c0d44173d43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY50336',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 70865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY50336%27 HTTP/1.1" 200 None
2026-03-28 09:04:15 [auto1.it] INFO: Saving data for HY50336: {'auction_closing_time': 1774715692.0, 'created_time': 1774386248.663674, 'last_price_update_time': 1774688655.232705}
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HY50336') HTTP/1.1" 204 0
2026-03-28 09:04:15 [auto1.it] INFO: Found listing with ID: TU52552
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU52552%27 HTTP/1.1" 200 None
2026-03-28 09:04:15 [auto1.it] INFO: Scrape type for TU52552: 0
2026-03-28 09:04:15 [auto1.it] INFO: Found listing with ID: SP76043
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP76043%27 HTTP/1.1" 200 None
2026-03-28 09:04:15 [auto1.it] INFO: Scrape type for SP76043: 2
2026-03-28 09:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e073524f-75b8-5aba-b3d1-af1caf1ad7f7 with identifier: SP76043
2026-03-28 09:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e073524f-75b8-5aba-b3d1-af1caf1ad7f7 with scrape type 2
2026-03-28 09:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e073524f-75b8-5aba-b3d1-af1caf1ad7f7 with scrape type 2
2026-03-28 09:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e073524f-75b8-5aba-b3d1-af1caf1ad7f7, identifier: SP76043
2026-03-28 09:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e073524f-75b8-5aba-b3d1-af1caf1ad7f7 with identifier: SP76043
2026-03-28 09:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e073524f-75b8-5aba-b3d1-af1caf1ad7f7 with identifier: SP76043
2026-03-28 09:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e073524f-75b8-5aba-b3d1-af1caf1ad7f7 with identifier: SP76043 to the API
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:06:38Z',
 'fuel_type': 'diesel',
 'id': 'e073524f-75b8-5aba-b3d1-af1caf1ad7f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP76043',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 403641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-31',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2016}
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP76043%27 HTTP/1.1" 200 None
2026-03-28 09:04:15 [auto1.it] INFO: Saving data for SP76043: {'auction_closing_time': 1774713998.0, 'created_time': 1774299688.498396, 'last_price_update_time': 1774688655.734183}
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SP76043') HTTP/1.1" 204 0
2026-03-28 09:04:15 [auto1.it] INFO: Found listing with ID: DS02463
2026-03-28 09:04:15 [auto1.it] INFO: Found listing with ID: DV09922
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV09922%27 HTTP/1.1" 200 None
2026-03-28 09:04:15 [auto1.it] INFO: Scrape type for DV09922: 2
2026-03-28 09:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b299618a-8b5a-5fe9-98e5-742fbb55f86f with identifier: DV09922
2026-03-28 09:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b299618a-8b5a-5fe9-98e5-742fbb55f86f with scrape type 2
2026-03-28 09:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b299618a-8b5a-5fe9-98e5-742fbb55f86f with scrape type 2
2026-03-28 09:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b299618a-8b5a-5fe9-98e5-742fbb55f86f, identifier: DV09922
2026-03-28 09:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b299618a-8b5a-5fe9-98e5-742fbb55f86f with identifier: DV09922
2026-03-28 09:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b299618a-8b5a-5fe9-98e5-742fbb55f86f with identifier: DV09922
2026-03-28 09:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b299618a-8b5a-5fe9-98e5-742fbb55f86f with identifier: DV09922 to the API
2026-03-28 09:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:10Z',
 'fuel_type': 'diesel',
 'id': 'b299618a-8b5a-5fe9-98e5-742fbb55f86f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV09922',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 125372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'Audi Q3 35 TDI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2019}
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV09922%27 HTTP/1.1" 200 None
2026-03-28 09:04:16 [auto1.it] INFO: Saving data for DV09922: {'auction_closing_time': 1774715830.0, 'created_time': 1774299648.468733, 'last_price_update_time': 1774688656.136582}
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DV09922') HTTP/1.1" 204 0
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: CM00839
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: TL02319
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: KT26389
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: FB26923
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB26923%27 HTTP/1.1" 200 None
2026-03-28 09:04:16 [auto1.it] INFO: Scrape type for FB26923: 0
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: FC72088
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC72088%27 HTTP/1.1" 200 None
2026-03-28 09:04:16 [auto1.it] INFO: Scrape type for FC72088: 0
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: CA11723
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA11723%27 HTTP/1.1" 200 None
2026-03-28 09:04:16 [auto1.it] INFO: Scrape type for CA11723: 0
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: EZ66710
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: HW61207
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: UB12324
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB12324%27 HTTP/1.1" 200 None
2026-03-28 09:04:16 [auto1.it] INFO: Scrape type for UB12324: 2
2026-03-28 09:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0ad68c7-8ff0-5556-85eb-091bc742c18e with identifier: UB12324
2026-03-28 09:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0ad68c7-8ff0-5556-85eb-091bc742c18e with scrape type 2
2026-03-28 09:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0ad68c7-8ff0-5556-85eb-091bc742c18e with scrape type 2
2026-03-28 09:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a0ad68c7-8ff0-5556-85eb-091bc742c18e, identifier: UB12324
2026-03-28 09:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a0ad68c7-8ff0-5556-85eb-091bc742c18e with identifier: UB12324
2026-03-28 09:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a0ad68c7-8ff0-5556-85eb-091bc742c18e with identifier: UB12324
2026-03-28 09:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a0ad68c7-8ff0-5556-85eb-091bc742c18e with identifier: UB12324 to the API
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:21:52Z',
 'fuel_type': 'diesel',
 'id': 'a0ad68c7-8ff0-5556-85eb-091bc742c18e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB12324',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 211108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-18',
 'seller_name': None,
 'title': 'BMW 3er 316d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB12324%27 HTTP/1.1" 200 None
2026-03-28 09:04:16 [auto1.it] INFO: Saving data for UB12324: {'auction_closing_time': 1774714912.0, 'created_time': 1774602080.011505, 'last_price_update_time': 1774688656.569151}
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UB12324') HTTP/1.1" 204 0
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: ZZ85760
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: DS09153
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: PV39557
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV39557%27 HTTP/1.1" 200 None
2026-03-28 09:04:16 [auto1.it] INFO: Scrape type for PV39557: 0
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: JU08968
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU08968%27 HTTP/1.1" 200 None
2026-03-28 09:04:16 [auto1.it] INFO: Scrape type for JU08968: 0
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: RM13688
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM13688%27 HTTP/1.1" 200 None
2026-03-28 09:04:16 [auto1.it] INFO: Scrape type for RM13688: 0
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: DS07920
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: BJ95013
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ95013%27 HTTP/1.1" 200 None
2026-03-28 09:04:16 [auto1.it] INFO: Scrape type for BJ95013: 0
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: AH42596
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: XJ39556
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ39556%27 HTTP/1.1" 200 None
2026-03-28 09:04:16 [auto1.it] INFO: Scrape type for XJ39556: 0
2026-03-28 09:04:16 [auto1.it] INFO: Found listing with ID: PE96276
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE96276%27 HTTP/1.1" 200 None
2026-03-28 09:04:16 [auto1.it] INFO: Scrape type for PE96276: 2
2026-03-28 09:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39196acc-cc43-5d50-a267-797d31d579ca with identifier: PE96276
2026-03-28 09:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39196acc-cc43-5d50-a267-797d31d579ca with scrape type 2
2026-03-28 09:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39196acc-cc43-5d50-a267-797d31d579ca with scrape type 2
2026-03-28 09:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 39196acc-cc43-5d50-a267-797d31d579ca, identifier: PE96276
2026-03-28 09:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 39196acc-cc43-5d50-a267-797d31d579ca with identifier: PE96276
2026-03-28 09:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 39196acc-cc43-5d50-a267-797d31d579ca with identifier: PE96276
2026-03-28 09:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 39196acc-cc43-5d50-a267-797d31d579ca with identifier: PE96276 to the API
2026-03-28 09:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:25:33Z',
 'fuel_type': 'diesel',
 'id': '39196acc-cc43-5d50-a267-797d31d579ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE96276',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 122049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-14',
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE96276%27 HTTP/1.1" 200 None
2026-03-28 09:04:17 [auto1.it] INFO: Saving data for PE96276: {'auction_closing_time': 1774715133.0, 'created_time': 1774299755.704721, 'last_price_update_time': 1774688657.171554}
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PE96276') HTTP/1.1" 204 0
2026-03-28 09:04:17 [auto1.it] INFO: Found listing with ID: VX84045
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX84045%27 HTTP/1.1" 200 None
2026-03-28 09:04:17 [auto1.it] INFO: Scrape type for VX84045: 0
2026-03-28 09:04:17 [auto1.it] INFO: Found listing with ID: JC61958
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC61958%27 HTTP/1.1" 200 None
2026-03-28 09:04:17 [auto1.it] INFO: Scrape type for JC61958: 0
2026-03-28 09:04:17 [auto1.it] INFO: Found listing with ID: WB02542
2026-03-28 09:04:17 [auto1.it] INFO: Found listing with ID: KW54926
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW54926%27 HTTP/1.1" 200 None
2026-03-28 09:04:17 [auto1.it] INFO: Scrape type for KW54926: 0
2026-03-28 09:04:17 [auto1.it] INFO: Found listing with ID: MH68095
2026-03-28 09:04:17 [auto1.it] INFO: Found listing with ID: TT28559
2026-03-28 09:04:17 [auto1.it] INFO: Found listing with ID: HG73673
2026-03-28 09:04:17 [auto1.it] INFO: Found listing with ID: SS18980
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS18980%27 HTTP/1.1" 200 None
2026-03-28 09:04:17 [auto1.it] INFO: Scrape type for SS18980: 0
2026-03-28 09:04:17 [auto1.it] INFO: Found listing with ID: FZ15341
2026-03-28 09:04:17 [auto1.it] INFO: Found listing with ID: UH39950
2026-03-28 09:04:17 [auto1.it] INFO: Found listing with ID: WU48456
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU48456%27 HTTP/1.1" 200 None
2026-03-28 09:04:17 [auto1.it] INFO: Scrape type for WU48456: 0
2026-03-28 09:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:04:17 [auto1.it] INFO: Channel: 24h | Page: 77 | totalHits: 3435 | hits on page: 40
2026-03-28 09:04:17 [auto1.it] INFO: Found listing with ID: WN29902
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN29902%27 HTTP/1.1" 200 None
2026-03-28 09:04:17 [auto1.it] INFO: Scrape type for WN29902: 0
2026-03-28 09:04:17 [auto1.it] INFO: Found listing with ID: AZ64167
2026-03-28 09:04:17 [auto1.it] INFO: Found listing with ID: ZG57893
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG57893%27 HTTP/1.1" 200 None
2026-03-28 09:04:17 [auto1.it] INFO: Scrape type for ZG57893: 0
2026-03-28 09:04:17 [auto1.it] INFO: Found listing with ID: LR70211
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR70211%27 HTTP/1.1" 200 None
2026-03-28 09:04:17 [auto1.it] INFO: Scrape type for LR70211: 0
2026-03-28 09:04:17 [auto1.it] INFO: Found listing with ID: LY33062
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY33062%27 HTTP/1.1" 200 None
2026-03-28 09:04:17 [auto1.it] INFO: Scrape type for LY33062: 2
2026-03-28 09:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e7be0de-5a29-5639-9057-6de3c90ffb8d with identifier: LY33062
2026-03-28 09:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7be0de-5a29-5639-9057-6de3c90ffb8d with scrape type 2
2026-03-28 09:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e7be0de-5a29-5639-9057-6de3c90ffb8d with scrape type 2
2026-03-28 09:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9e7be0de-5a29-5639-9057-6de3c90ffb8d, identifier: LY33062
2026-03-28 09:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9e7be0de-5a29-5639-9057-6de3c90ffb8d with identifier: LY33062
2026-03-28 09:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9e7be0de-5a29-5639-9057-6de3c90ffb8d with identifier: LY33062
2026-03-28 09:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9e7be0de-5a29-5639-9057-6de3c90ffb8d with identifier: LY33062 to the API
2026-03-28 09:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:14:45Z',
 'fuel_type': 'diesel',
 'id': '9e7be0de-5a29-5639-9057-6de3c90ffb8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY33062',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 447635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-05',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2018}
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY33062%27 HTTP/1.1" 200 None
2026-03-28 09:04:18 [auto1.it] INFO: Saving data for LY33062: {'auction_closing_time': 1774714485.0, 'created_time': 1774299941.852521, 'last_price_update_time': 1774688658.123537}
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LY33062') HTTP/1.1" 204 0
2026-03-28 09:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: HD69394
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: UR14764
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: XY34648
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: LK74824
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK74824%27 HTTP/1.1" 200 None
2026-03-28 09:04:18 [auto1.it] INFO: Scrape type for LK74824: 0
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: JV49964
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: RB26067
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB26067%27 HTTP/1.1" 200 None
2026-03-28 09:04:18 [auto1.it] INFO: Scrape type for RB26067: 0
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: JK56818
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK56818%27 HTTP/1.1" 200 None
2026-03-28 09:04:18 [auto1.it] INFO: Scrape type for JK56818: 0
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: LP45822
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: KF78303
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: AS07739
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: CD01213
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: EW42527
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: JU78402
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: FZ10631
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: PR30387
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: XD70855
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: KK35105
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK35105%27 HTTP/1.1" 200 None
2026-03-28 09:04:18 [auto1.it] INFO: Scrape type for KK35105: 0
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: FD87905
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: EU38381
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: EA99644
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: FT94062
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: ED98224
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: DV90531
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV90531%27 HTTP/1.1" 200 None
2026-03-28 09:04:18 [auto1.it] INFO: Scrape type for DV90531: 2
2026-03-28 09:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aae9b83b-4244-58bb-8e47-991d138fa720 with identifier: DV90531
2026-03-28 09:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aae9b83b-4244-58bb-8e47-991d138fa720 with scrape type 2
2026-03-28 09:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aae9b83b-4244-58bb-8e47-991d138fa720 with scrape type 2
2026-03-28 09:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aae9b83b-4244-58bb-8e47-991d138fa720, identifier: DV90531
2026-03-28 09:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aae9b83b-4244-58bb-8e47-991d138fa720 with identifier: DV90531
2026-03-28 09:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aae9b83b-4244-58bb-8e47-991d138fa720 with identifier: DV90531
2026-03-28 09:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aae9b83b-4244-58bb-8e47-991d138fa720 with identifier: DV90531 to the API
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:53:19Z',
 'fuel_type': 'diesel',
 'id': 'aae9b83b-4244-58bb-8e47-991d138fa720',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV90531',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 71694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-25',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2017}
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV90531%27 HTTP/1.1" 200 None
2026-03-28 09:04:18 [auto1.it] INFO: Saving data for DV90531: {'auction_closing_time': 1774716799.0, 'created_time': 1772222905.791029, 'last_price_update_time': 1774688658.697443}
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DV90531') HTTP/1.1" 204 0
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: WG94514
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: KE74592
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE74592%27 HTTP/1.1" 200 None
2026-03-28 09:04:18 [auto1.it] INFO: Scrape type for KE74592: 0
2026-03-28 09:04:18 [auto1.it] INFO: Found listing with ID: RA84354
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA84354%27 HTTP/1.1" 200 None
2026-03-28 09:04:18 [auto1.it] INFO: Scrape type for RA84354: 2
2026-03-28 09:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deaca3c1-24c5-5151-9026-7c05473730ca with identifier: RA84354
2026-03-28 09:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deaca3c1-24c5-5151-9026-7c05473730ca with scrape type 2
2026-03-28 09:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deaca3c1-24c5-5151-9026-7c05473730ca with scrape type 2
2026-03-28 09:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: deaca3c1-24c5-5151-9026-7c05473730ca, identifier: RA84354
2026-03-28 09:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: deaca3c1-24c5-5151-9026-7c05473730ca with identifier: RA84354
2026-03-28 09:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: deaca3c1-24c5-5151-9026-7c05473730ca with identifier: RA84354
2026-03-28 09:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: deaca3c1-24c5-5151-9026-7c05473730ca with identifier: RA84354 to the API
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:14:29Z',
 'fuel_type': 'petrol',
 'id': 'deaca3c1-24c5-5151-9026-7c05473730ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA84354',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 133663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-15',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA84354%27 HTTP/1.1" 200 None
2026-03-28 09:04:19 [auto1.it] INFO: Saving data for RA84354: {'auction_closing_time': 1774714469.0, 'created_time': 1774602069.937458, 'last_price_update_time': 1774688659.243458}
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RA84354') HTTP/1.1" 204 0
2026-03-28 09:04:19 [auto1.it] INFO: Found listing with ID: NT11806
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT11806%27 HTTP/1.1" 200 None
2026-03-28 09:04:19 [auto1.it] INFO: Scrape type for NT11806: 2
2026-03-28 09:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c515a4f-8069-55c6-afbb-0208b957b399 with identifier: NT11806
2026-03-28 09:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c515a4f-8069-55c6-afbb-0208b957b399 with scrape type 2
2026-03-28 09:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c515a4f-8069-55c6-afbb-0208b957b399 with scrape type 2
2026-03-28 09:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6c515a4f-8069-55c6-afbb-0208b957b399, identifier: NT11806
2026-03-28 09:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6c515a4f-8069-55c6-afbb-0208b957b399 with identifier: NT11806
2026-03-28 09:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6c515a4f-8069-55c6-afbb-0208b957b399 with identifier: NT11806
2026-03-28 09:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6c515a4f-8069-55c6-afbb-0208b957b399 with identifier: NT11806 to the API
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:42:45Z',
 'fuel_type': 'hybrid',
 'id': '6c515a4f-8069-55c6-afbb-0208b957b399',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT11806',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 309814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-20',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2016}
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT11806%27 HTTP/1.1" 200 None
2026-03-28 09:04:19 [auto1.it] INFO: Saving data for NT11806: {'auction_closing_time': 1774716165.0, 'created_time': 1774602069.071963, 'last_price_update_time': 1774688659.652107}
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NT11806') HTTP/1.1" 204 0
2026-03-28 09:04:19 [auto1.it] INFO: Found listing with ID: PZ52577
2026-03-28 09:04:19 [auto1.it] INFO: Found listing with ID: MA17223
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA17223%27 HTTP/1.1" 200 None
2026-03-28 09:04:19 [auto1.it] INFO: Scrape type for MA17223: 0
2026-03-28 09:04:19 [auto1.it] INFO: Found listing with ID: ZM35614
2026-03-28 09:04:19 [auto1.it] INFO: Found listing with ID: FS29770
2026-03-28 09:04:19 [auto1.it] INFO: Found listing with ID: XW21530
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW21530%27 HTTP/1.1" 200 None
2026-03-28 09:04:19 [auto1.it] INFO: Scrape type for XW21530: 2
2026-03-28 09:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d6956fb-1ff3-57bc-93c3-66b44c32e689 with identifier: XW21530
2026-03-28 09:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d6956fb-1ff3-57bc-93c3-66b44c32e689 with scrape type 2
2026-03-28 09:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d6956fb-1ff3-57bc-93c3-66b44c32e689 with scrape type 2
2026-03-28 09:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3d6956fb-1ff3-57bc-93c3-66b44c32e689, identifier: XW21530
2026-03-28 09:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3d6956fb-1ff3-57bc-93c3-66b44c32e689 with identifier: XW21530
2026-03-28 09:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3d6956fb-1ff3-57bc-93c3-66b44c32e689 with identifier: XW21530
2026-03-28 09:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3d6956fb-1ff3-57bc-93c3-66b44c32e689 with identifier: XW21530 to the API
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:32:55Z',
 'fuel_type': 'petrol',
 'id': '3d6956fb-1ff3-57bc-93c3-66b44c32e689',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW21530',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 91486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2022}
2026-03-28 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW21530%27 HTTP/1.1" 200 None
2026-03-28 09:04:20 [auto1.it] INFO: Saving data for XW21530: {'auction_closing_time': 1774715575.0, 'created_time': 1774602071.904032, 'last_price_update_time': 1774688660.051517}
2026-03-28 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XW21530') HTTP/1.1" 204 0
2026-03-28 09:04:20 [auto1.it] INFO: Found listing with ID: PU63843
2026-03-28 09:04:20 [auto1.it] INFO: Found listing with ID: DW91233
2026-03-28 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW91233%27 HTTP/1.1" 200 None
2026-03-28 09:04:20 [auto1.it] INFO: Scrape type for DW91233: 0
2026-03-28 09:04:20 [auto1.it] INFO: Found listing with ID: EA21012
2026-03-28 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA21012%27 HTTP/1.1" 200 None
2026-03-28 09:04:20 [auto1.it] INFO: Scrape type for EA21012: 2
2026-03-28 09:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f0cee35-3ca4-5d7d-8969-deffb18536c3 with identifier: EA21012
2026-03-28 09:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f0cee35-3ca4-5d7d-8969-deffb18536c3 with scrape type 2
2026-03-28 09:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f0cee35-3ca4-5d7d-8969-deffb18536c3 with scrape type 2
2026-03-28 09:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2f0cee35-3ca4-5d7d-8969-deffb18536c3, identifier: EA21012
2026-03-28 09:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2f0cee35-3ca4-5d7d-8969-deffb18536c3 with identifier: EA21012
2026-03-28 09:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2f0cee35-3ca4-5d7d-8969-deffb18536c3 with identifier: EA21012
2026-03-28 09:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2f0cee35-3ca4-5d7d-8969-deffb18536c3 with identifier: EA21012 to the API
2026-03-28 09:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:49:54Z',
 'fuel_type': 'diesel',
 'id': '2f0cee35-3ca4-5d7d-8969-deffb18536c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA21012',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 83572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-14',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA21012%27 HTTP/1.1" 200 None
2026-03-28 09:04:20 [auto1.it] INFO: Saving data for EA21012: {'auction_closing_time': 1774716594.0, 'created_time': 1774299639.232874, 'last_price_update_time': 1774688660.466895}
2026-03-28 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EA21012') HTTP/1.1" 204 0
2026-03-28 09:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:04:21 [auto1.it] INFO: Channel: 24h | Page: 78 | totalHits: 3435 | hits on page: 40
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: SR85753
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: LC41998
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC41998%27 HTTP/1.1" 200 None
2026-03-28 09:04:21 [auto1.it] INFO: Scrape type for LC41998: 0
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: TZ26377
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: ZV75074
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: CP26264
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: YT14284
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT14284%27 HTTP/1.1" 200 None
2026-03-28 09:04:21 [auto1.it] INFO: Scrape type for YT14284: 0
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: XC32215
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: YZ66981
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ66981%27 HTTP/1.1" 200 None
2026-03-28 09:04:21 [auto1.it] INFO: Scrape type for YZ66981: 0
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: GC55004
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC55004%27 HTTP/1.1" 200 None
2026-03-28 09:04:21 [auto1.it] INFO: Scrape type for GC55004: 2
2026-03-28 09:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e8219bf-6dcf-5824-b3f2-ff7ecb7b273c with identifier: GC55004
2026-03-28 09:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e8219bf-6dcf-5824-b3f2-ff7ecb7b273c with scrape type 2
2026-03-28 09:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e8219bf-6dcf-5824-b3f2-ff7ecb7b273c with scrape type 2
2026-03-28 09:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5e8219bf-6dcf-5824-b3f2-ff7ecb7b273c, identifier: GC55004
2026-03-28 09:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5e8219bf-6dcf-5824-b3f2-ff7ecb7b273c with identifier: GC55004
2026-03-28 09:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5e8219bf-6dcf-5824-b3f2-ff7ecb7b273c with identifier: GC55004
2026-03-28 09:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5e8219bf-6dcf-5824-b3f2-ff7ecb7b273c with identifier: GC55004 to the API
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:44:10Z',
 'fuel_type': 'diesel',
 'id': '5e8219bf-6dcf-5824-b3f2-ff7ecb7b273c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC55004',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 149176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Audi A3 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2016}
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC55004%27 HTTP/1.1" 200 None
2026-03-28 09:04:21 [auto1.it] INFO: Saving data for GC55004: {'auction_closing_time': 1774716250.0, 'created_time': 1774299686.796028, 'last_price_update_time': 1774688661.635168}
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GC55004') HTTP/1.1" 204 0
2026-03-28 09:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: RL48638
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: MZ97051
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: DV74338
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: DA57942
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA57942%27 HTTP/1.1" 200 None
2026-03-28 09:04:21 [auto1.it] INFO: Scrape type for DA57942: 0
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: RD83320
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: FC73004
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: UK76860
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: XH07717
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: FR80508
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: ZT64017
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT64017%27 HTTP/1.1" 200 None
2026-03-28 09:04:21 [auto1.it] INFO: Scrape type for ZT64017: 0
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: CH37521
2026-03-28 09:04:21 [auto1.it] INFO: Found listing with ID: JU23021
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU23021%27 HTTP/1.1" 200 None
2026-03-28 09:04:21 [auto1.it] INFO: Scrape type for JU23021: 2
2026-03-28 09:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 004e6535-e787-547b-8a35-7e0a1205c975 with identifier: JU23021
2026-03-28 09:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 004e6535-e787-547b-8a35-7e0a1205c975 with scrape type 2
2026-03-28 09:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 004e6535-e787-547b-8a35-7e0a1205c975 with scrape type 2
2026-03-28 09:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 004e6535-e787-547b-8a35-7e0a1205c975, identifier: JU23021
2026-03-28 09:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 004e6535-e787-547b-8a35-7e0a1205c975 with identifier: JU23021
2026-03-28 09:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 004e6535-e787-547b-8a35-7e0a1205c975 with identifier: JU23021
2026-03-28 09:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 004e6535-e787-547b-8a35-7e0a1205c975 with identifier: JU23021 to the API
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:46:53Z',
 'fuel_type': 'petrol',
 'id': '004e6535-e787-547b-8a35-7e0a1205c975',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU23021',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 59120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-28',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2016}
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU23021%27 HTTP/1.1" 200 None
2026-03-28 09:04:22 [auto1.it] INFO: Saving data for JU23021: {'auction_closing_time': 1774716413.0, 'created_time': 1774300026.187675, 'last_price_update_time': 1774688662.076902}
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JU23021') HTTP/1.1" 204 0
2026-03-28 09:04:22 [auto1.it] INFO: Found listing with ID: BD54797
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD54797%27 HTTP/1.1" 200 None
2026-03-28 09:04:22 [auto1.it] INFO: Scrape type for BD54797: 0
2026-03-28 09:04:22 [auto1.it] INFO: Found listing with ID: CV42265
2026-03-28 09:04:22 [auto1.it] INFO: Found listing with ID: VL10175
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL10175%27 HTTP/1.1" 200 None
2026-03-28 09:04:22 [auto1.it] INFO: Scrape type for VL10175: 2
2026-03-28 09:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9726028-f7c7-5462-9ae1-126f641895a9 with identifier: VL10175
2026-03-28 09:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9726028-f7c7-5462-9ae1-126f641895a9 with scrape type 2
2026-03-28 09:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9726028-f7c7-5462-9ae1-126f641895a9 with scrape type 2
2026-03-28 09:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e9726028-f7c7-5462-9ae1-126f641895a9, identifier: VL10175
2026-03-28 09:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e9726028-f7c7-5462-9ae1-126f641895a9 with identifier: VL10175
2026-03-28 09:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e9726028-f7c7-5462-9ae1-126f641895a9 with identifier: VL10175
2026-03-28 09:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e9726028-f7c7-5462-9ae1-126f641895a9 with identifier: VL10175 to the API
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:41:18Z',
 'fuel_type': 'diesel',
 'id': 'e9726028-f7c7-5462-9ae1-126f641895a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL10175',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 207533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-10',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL10175%27 HTTP/1.1" 200 None
2026-03-28 09:04:22 [auto1.it] INFO: Saving data for VL10175: {'auction_closing_time': 1774716078.0, 'created_time': 1773129541.043489, 'last_price_update_time': 1774688662.611129}
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VL10175') HTTP/1.1" 204 0
2026-03-28 09:04:22 [auto1.it] INFO: Found listing with ID: RB61179
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB61179%27 HTTP/1.1" 200 None
2026-03-28 09:04:22 [auto1.it] INFO: Scrape type for RB61179: 0
2026-03-28 09:04:22 [auto1.it] INFO: Found listing with ID: TX50484
2026-03-28 09:04:22 [auto1.it] INFO: Found listing with ID: ST20254
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST20254%27 HTTP/1.1" 200 None
2026-03-28 09:04:22 [auto1.it] INFO: Scrape type for ST20254: 2
2026-03-28 09:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e76bd315-fcb9-5e0d-aa73-89ab6b524b03 with identifier: ST20254
2026-03-28 09:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e76bd315-fcb9-5e0d-aa73-89ab6b524b03 with scrape type 2
2026-03-28 09:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e76bd315-fcb9-5e0d-aa73-89ab6b524b03 with scrape type 2
2026-03-28 09:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e76bd315-fcb9-5e0d-aa73-89ab6b524b03, identifier: ST20254
2026-03-28 09:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e76bd315-fcb9-5e0d-aa73-89ab6b524b03 with identifier: ST20254
2026-03-28 09:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e76bd315-fcb9-5e0d-aa73-89ab6b524b03 with identifier: ST20254
2026-03-28 09:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e76bd315-fcb9-5e0d-aa73-89ab6b524b03 with identifier: ST20254 to the API
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:17:44Z',
 'fuel_type': 'diesel',
 'id': 'e76bd315-fcb9-5e0d-aa73-89ab6b524b03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST20254',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 225902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'Jeep Renegade 2.0 M-Jet Trailhawk 4WD',
 'transmission': 'automatic',
 'trim': 'Trailhawk 4WD',
 'year': 2017}
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST20254%27 HTTP/1.1" 200 None
2026-03-28 09:04:23 [auto1.it] INFO: Saving data for ST20254: {'auction_closing_time': 1774714664.0, 'created_time': 1774274470.161725, 'last_price_update_time': 1774688663.092267}
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ST20254') HTTP/1.1" 204 0
2026-03-28 09:04:23 [auto1.it] INFO: Found listing with ID: UC27147
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC27147%27 HTTP/1.1" 200 None
2026-03-28 09:04:23 [auto1.it] INFO: Scrape type for UC27147: 0
2026-03-28 09:04:23 [auto1.it] INFO: Found listing with ID: BV06574
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV06574%27 HTTP/1.1" 200 None
2026-03-28 09:04:23 [auto1.it] INFO: Scrape type for BV06574: 0
2026-03-28 09:04:23 [auto1.it] INFO: Found listing with ID: TC65145
2026-03-28 09:04:23 [auto1.it] INFO: Found listing with ID: SG53706
2026-03-28 09:04:23 [auto1.it] INFO: Found listing with ID: SM56678
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM56678%27 HTTP/1.1" 200 None
2026-03-28 09:04:23 [auto1.it] INFO: Scrape type for SM56678: 0
2026-03-28 09:04:23 [auto1.it] INFO: Found listing with ID: BX57696
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX57696%27 HTTP/1.1" 200 None
2026-03-28 09:04:23 [auto1.it] INFO: Scrape type for BX57696: 2
2026-03-28 09:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a51fe678-20bf-599b-9fba-cb5dbd1d6e21 with identifier: BX57696
2026-03-28 09:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a51fe678-20bf-599b-9fba-cb5dbd1d6e21 with scrape type 2
2026-03-28 09:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a51fe678-20bf-599b-9fba-cb5dbd1d6e21 with scrape type 2
2026-03-28 09:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a51fe678-20bf-599b-9fba-cb5dbd1d6e21, identifier: BX57696
2026-03-28 09:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a51fe678-20bf-599b-9fba-cb5dbd1d6e21 with identifier: BX57696
2026-03-28 09:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a51fe678-20bf-599b-9fba-cb5dbd1d6e21 with identifier: BX57696
2026-03-28 09:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a51fe678-20bf-599b-9fba-cb5dbd1d6e21 with identifier: BX57696 to the API
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:50:39Z',
 'fuel_type': 'diesel',
 'id': 'a51fe678-20bf-599b-9fba-cb5dbd1d6e21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX57696',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 164407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-11',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX57696%27 HTTP/1.1" 200 None
2026-03-28 09:04:23 [auto1.it] INFO: Saving data for BX57696: {'auction_closing_time': 1774716639.0, 'created_time': 1774267474.286865, 'last_price_update_time': 1774688663.537482}
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BX57696') HTTP/1.1" 204 0
2026-03-28 09:04:23 [auto1.it] INFO: Found listing with ID: UK17345
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK17345%27 HTTP/1.1" 200 None
2026-03-28 09:04:23 [auto1.it] INFO: Scrape type for UK17345: 0
2026-03-28 09:04:23 [auto1.it] INFO: Found listing with ID: ER04044
2026-03-28 09:04:23 [auto1.it] INFO: Found listing with ID: PG80369
2026-03-28 09:04:23 [auto1.it] INFO: Found listing with ID: ET07404
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET07404%27 HTTP/1.1" 200 None
2026-03-28 09:04:23 [auto1.it] INFO: Scrape type for ET07404: 2
2026-03-28 09:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a98b2b3-fc01-5f91-951d-abdb5db3d15a with identifier: ET07404
2026-03-28 09:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a98b2b3-fc01-5f91-951d-abdb5db3d15a with scrape type 2
2026-03-28 09:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a98b2b3-fc01-5f91-951d-abdb5db3d15a with scrape type 2
2026-03-28 09:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4a98b2b3-fc01-5f91-951d-abdb5db3d15a, identifier: ET07404
2026-03-28 09:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4a98b2b3-fc01-5f91-951d-abdb5db3d15a with identifier: ET07404
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 09:04:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4a98b2b3-fc01-5f91-951d-abdb5db3d15a with identifier: ET07404
2026-03-28 09:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4a98b2b3-fc01-5f91-951d-abdb5db3d15a with identifier: ET07404 to the API
2026-03-28 09:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:52:39Z',
 'fuel_type': 'petrol',
 'id': '4a98b2b3-fc01-5f91-951d-abdb5db3d15a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET07404',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Avenger',
 'odometer': 55276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-23',
 'seller_name': None,
 'title': 'Jeep Avenger 1.2 T-GDI Summit',
 'transmission': 'manual',
 'trim': 'Summit',
 'year': 2023}
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET07404%27 HTTP/1.1" 200 None
2026-03-28 09:04:24 [auto1.it] INFO: Saving data for ET07404: {'auction_closing_time': 1774716759.0, 'created_time': 1774274511.265264, 'last_price_update_time': 1774688664.159333}
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ET07404') HTTP/1.1" 204 0
2026-03-28 09:04:24 [auto1.it] INFO: Found listing with ID: LD41720
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD41720%27 HTTP/1.1" 200 None
2026-03-28 09:04:24 [auto1.it] INFO: Scrape type for LD41720: 2
2026-03-28 09:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d239f50-db45-5e83-a676-c88fb61c0bd2 with identifier: LD41720
2026-03-28 09:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d239f50-db45-5e83-a676-c88fb61c0bd2 with scrape type 2
2026-03-28 09:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d239f50-db45-5e83-a676-c88fb61c0bd2 with scrape type 2
2026-03-28 09:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2d239f50-db45-5e83-a676-c88fb61c0bd2, identifier: LD41720
2026-03-28 09:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2d239f50-db45-5e83-a676-c88fb61c0bd2 with identifier: LD41720
2026-03-28 09:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2d239f50-db45-5e83-a676-c88fb61c0bd2 with identifier: LD41720
2026-03-28 09:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2d239f50-db45-5e83-a676-c88fb61c0bd2 with identifier: LD41720 to the API
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:12:21Z',
 'fuel_type': 'diesel',
 'id': '2d239f50-db45-5e83-a676-c88fb61c0bd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD41720',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 194278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-23',
 'seller_name': None,
 'title': 'Opel Mokka X 1.6 CDTI DPF Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2018}
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD41720%27 HTTP/1.1" 200 None
2026-03-28 09:04:24 [auto1.it] INFO: Saving data for LD41720: {'auction_closing_time': 1774714341.0, 'created_time': 1774299690.456406, 'last_price_update_time': 1774688664.562804}
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LD41720') HTTP/1.1" 204 0
2026-03-28 09:04:24 [auto1.it] INFO: Found listing with ID: YA87774
2026-03-28 09:04:24 [auto1.it] INFO: Found listing with ID: MU61390
2026-03-28 09:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:04:24 [auto1.it] INFO: Channel: 24h | Page: 79 | totalHits: 3435 | hits on page: 40
2026-03-28 09:04:24 [auto1.it] INFO: Found listing with ID: WH19380
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH19380%27 HTTP/1.1" 200 None
2026-03-28 09:04:24 [auto1.it] INFO: Scrape type for WH19380: 0
2026-03-28 09:04:24 [auto1.it] INFO: Found listing with ID: YX87347
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX87347%27 HTTP/1.1" 200 None
2026-03-28 09:04:24 [auto1.it] INFO: Scrape type for YX87347: 2
2026-03-28 09:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47e0100f-d91c-5eb0-adb6-528cef24deb1 with identifier: YX87347
2026-03-28 09:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47e0100f-d91c-5eb0-adb6-528cef24deb1 with scrape type 2
2026-03-28 09:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47e0100f-d91c-5eb0-adb6-528cef24deb1 with scrape type 2
2026-03-28 09:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 47e0100f-d91c-5eb0-adb6-528cef24deb1, identifier: YX87347
2026-03-28 09:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 47e0100f-d91c-5eb0-adb6-528cef24deb1 with identifier: YX87347
2026-03-28 09:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 47e0100f-d91c-5eb0-adb6-528cef24deb1 with identifier: YX87347
2026-03-28 09:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 47e0100f-d91c-5eb0-adb6-528cef24deb1 with identifier: YX87347 to the API
2026-03-28 09:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:44:59Z',
 'fuel_type': 'petrol',
 'id': '47e0100f-d91c-5eb0-adb6-528cef24deb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX87347',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Agila',
 'odometer': 56214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-27',
 'seller_name': None,
 'title': 'Opel Agila 1.2 Elective',
 'transmission': 'automatic',
 'trim': 'Elective',
 'year': 2013}
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX87347%27 HTTP/1.1" 200 None
2026-03-28 09:04:25 [auto1.it] INFO: Saving data for YX87347: {'auction_closing_time': 1774716299.0, 'created_time': 1774299771.548966, 'last_price_update_time': 1774688665.141156}
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YX87347') HTTP/1.1" 204 0
2026-03-28 09:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: PA70519
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: SC05419
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: EG89993
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: TT44801
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: BR85251
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: ML20734
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: ZZ56254
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: CX56381
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: UG05722
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UG05722%27 HTTP/1.1" 200 None
2026-03-28 09:04:25 [auto1.it] INFO: Scrape type for UG05722: 2
2026-03-28 09:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b9a2139-b1fe-590d-a0da-1b22133b15c5 with identifier: UG05722
2026-03-28 09:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b9a2139-b1fe-590d-a0da-1b22133b15c5 with scrape type 2
2026-03-28 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b9a2139-b1fe-590d-a0da-1b22133b15c5 with scrape type 2
2026-03-28 09:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7b9a2139-b1fe-590d-a0da-1b22133b15c5, identifier: UG05722
2026-03-28 09:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7b9a2139-b1fe-590d-a0da-1b22133b15c5 with identifier: UG05722
2026-03-28 09:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7b9a2139-b1fe-590d-a0da-1b22133b15c5 with identifier: UG05722
2026-03-28 09:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7b9a2139-b1fe-590d-a0da-1b22133b15c5 with identifier: UG05722 to the API
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:29:07Z',
 'fuel_type': 'hybrid',
 'id': '7b9a2139-b1fe-590d-a0da-1b22133b15c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG05722',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 163808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UG05722%27 HTTP/1.1" 200 None
2026-03-28 09:04:25 [auto1.it] INFO: Saving data for UG05722: {'auction_closing_time': 1774715347.0, 'created_time': 1774602066.050261, 'last_price_update_time': 1774688665.541322}
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UG05722') HTTP/1.1" 204 0
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: ED77139
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED77139%27 HTTP/1.1" 200 None
2026-03-28 09:04:25 [auto1.it] INFO: Scrape type for ED77139: 0
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: UX44191
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: ZU39445
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: WM00919
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: YU40333
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU40333%27 HTTP/1.1" 200 None
2026-03-28 09:04:25 [auto1.it] INFO: Scrape type for YU40333: 0
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: XB00155
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: VY08559
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: DT24064
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: AF97148
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: TK41328
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK41328%27 HTTP/1.1" 200 None
2026-03-28 09:04:25 [auto1.it] INFO: Scrape type for TK41328: 0
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: EW75020
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: XG00486
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: LZ05951
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ05951%27 HTTP/1.1" 200 None
2026-03-28 09:04:25 [auto1.it] INFO: Scrape type for LZ05951: 0
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: YU33914
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: SN78206
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: PH25620
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: RZ31848
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ31848%27 HTTP/1.1" 200 None
2026-03-28 09:04:25 [auto1.it] INFO: Scrape type for RZ31848: 0
2026-03-28 09:04:25 [auto1.it] INFO: Found listing with ID: DW68997
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW68997%27 HTTP/1.1" 200 None
2026-03-28 09:04:25 [auto1.it] INFO: Scrape type for DW68997: 2
2026-03-28 09:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6da9c7d-79e9-503c-99a6-fe88826bf7ac with identifier: DW68997
2026-03-28 09:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6da9c7d-79e9-503c-99a6-fe88826bf7ac with scrape type 2
2026-03-28 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6da9c7d-79e9-503c-99a6-fe88826bf7ac with scrape type 2
2026-03-28 09:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a6da9c7d-79e9-503c-99a6-fe88826bf7ac, identifier: DW68997
2026-03-28 09:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a6da9c7d-79e9-503c-99a6-fe88826bf7ac with identifier: DW68997
2026-03-28 09:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a6da9c7d-79e9-503c-99a6-fe88826bf7ac with identifier: DW68997
2026-03-28 09:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a6da9c7d-79e9-503c-99a6-fe88826bf7ac with identifier: DW68997 to the API
2026-03-28 09:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:14:03Z',
 'fuel_type': 'diesel',
 'id': 'a6da9c7d-79e9-503c-99a6-fe88826bf7ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW68997',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 317186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW68997%27 HTTP/1.1" 200 None
2026-03-28 09:04:26 [auto1.it] INFO: Saving data for DW68997: {'auction_closing_time': 1774714443.0, 'created_time': 1774299754.946974, 'last_price_update_time': 1774688666.14595}
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DW68997') HTTP/1.1" 204 0
2026-03-28 09:04:26 [auto1.it] INFO: Found listing with ID: MH53431
2026-03-28 09:04:26 [auto1.it] INFO: Found listing with ID: SF43415
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF43415%27 HTTP/1.1" 200 None
2026-03-28 09:04:26 [auto1.it] INFO: Scrape type for SF43415: 2
2026-03-28 09:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5667ea3f-6315-5434-8ded-ea7754664543 with identifier: SF43415
2026-03-28 09:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5667ea3f-6315-5434-8ded-ea7754664543 with scrape type 2
2026-03-28 09:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5667ea3f-6315-5434-8ded-ea7754664543 with scrape type 2
2026-03-28 09:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5667ea3f-6315-5434-8ded-ea7754664543, identifier: SF43415
2026-03-28 09:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5667ea3f-6315-5434-8ded-ea7754664543 with identifier: SF43415
2026-03-28 09:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5667ea3f-6315-5434-8ded-ea7754664543 with identifier: SF43415
2026-03-28 09:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5667ea3f-6315-5434-8ded-ea7754664543 with identifier: SF43415 to the API
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:49:25Z',
 'fuel_type': 'petrol',
 'id': '5667ea3f-6315-5434-8ded-ea7754664543',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF43415',
 'listing': 'auction',
 'make': 'Daihatsu',
 'model': 'Terios',
 'odometer': 255589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-01',
 'seller_name': None,
 'title': 'Daihatsu Terios 1.5 Hiro 4WD',
 'transmission': 'manual',
 'trim': 'Hiro 4WD',
 'year': 2009}
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF43415%27 HTTP/1.1" 200 None
2026-03-28 09:04:26 [auto1.it] INFO: Saving data for SF43415: {'auction_closing_time': 1774716565.0, 'created_time': 1774299692.191751, 'last_price_update_time': 1774688666.674818}
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SF43415') HTTP/1.1" 204 0
2026-03-28 09:04:26 [auto1.it] INFO: Found listing with ID: RD96225
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD96225%27 HTTP/1.1" 200 None
2026-03-28 09:04:26 [auto1.it] INFO: Scrape type for RD96225: 0
2026-03-28 09:04:26 [auto1.it] INFO: Found listing with ID: YF34065
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF34065%27 HTTP/1.1" 200 None
2026-03-28 09:04:26 [auto1.it] INFO: Scrape type for YF34065: 0
2026-03-28 09:04:26 [auto1.it] INFO: Found listing with ID: RH67441
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH67441%27 HTTP/1.1" 200 None
2026-03-28 09:04:26 [auto1.it] INFO: Scrape type for RH67441: 0
2026-03-28 09:04:26 [auto1.it] INFO: Found listing with ID: KV39692
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV39692%27 HTTP/1.1" 200 None
2026-03-28 09:04:26 [auto1.it] INFO: Scrape type for KV39692: 0
2026-03-28 09:04:26 [auto1.it] INFO: Found listing with ID: XC56824
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC56824%27 HTTP/1.1" 200 None
2026-03-28 09:04:26 [auto1.it] INFO: Scrape type for XC56824: 0
2026-03-28 09:04:26 [auto1.it] INFO: Found listing with ID: YG84271
2026-03-28 09:04:26 [auto1.it] INFO: Found listing with ID: UY38032
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY38032%27 HTTP/1.1" 200 None
2026-03-28 09:04:26 [auto1.it] INFO: Scrape type for UY38032: 0
2026-03-28 09:04:26 [auto1.it] INFO: Found listing with ID: TT97007
2026-03-28 09:04:26 [auto1.it] INFO: Found listing with ID: UL45556
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL45556%27 HTTP/1.1" 200 None
2026-03-28 09:04:26 [auto1.it] INFO: Scrape type for UL45556: 0
2026-03-28 09:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:04:27 [auto1.it] INFO: Channel: 24h | Page: 80 | totalHits: 3435 | hits on page: 40
2026-03-28 09:04:27 [auto1.it] INFO: Found listing with ID: GT53480
2026-03-28 09:04:27 [auto1.it] INFO: Found listing with ID: RL33082
2026-03-28 09:04:27 [auto1.it] INFO: Found listing with ID: TG24306
2026-03-28 09:04:27 [auto1.it] INFO: Found listing with ID: NE13837
2026-03-28 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE13837%27 HTTP/1.1" 200 None
2026-03-28 09:04:27 [auto1.it] INFO: Scrape type for NE13837: 0
2026-03-28 09:04:27 [auto1.it] INFO: Found listing with ID: LR71348
2026-03-28 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR71348%27 HTTP/1.1" 200 None
2026-03-28 09:04:27 [auto1.it] INFO: Scrape type for LR71348: 2
2026-03-28 09:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d14f0dcb-b0e7-5c6d-8c7b-3a86e7e13c84 with identifier: LR71348
2026-03-28 09:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d14f0dcb-b0e7-5c6d-8c7b-3a86e7e13c84 with scrape type 2
2026-03-28 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d14f0dcb-b0e7-5c6d-8c7b-3a86e7e13c84 with scrape type 2
2026-03-28 09:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d14f0dcb-b0e7-5c6d-8c7b-3a86e7e13c84, identifier: LR71348
2026-03-28 09:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d14f0dcb-b0e7-5c6d-8c7b-3a86e7e13c84 with identifier: LR71348
2026-03-28 09:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d14f0dcb-b0e7-5c6d-8c7b-3a86e7e13c84 with identifier: LR71348
2026-03-28 09:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d14f0dcb-b0e7-5c6d-8c7b-3a86e7e13c84 with identifier: LR71348 to the API
2026-03-28 09:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:55:45Z',
 'fuel_type': 'diesel',
 'id': 'd14f0dcb-b0e7-5c6d-8c7b-3a86e7e13c84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR71348',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 276215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-16',
 'seller_name': None,
 'title': 'Ford Transit 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2017}
2026-03-28 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR71348%27 HTTP/1.1" 200 None
2026-03-28 09:04:27 [auto1.it] INFO: Saving data for LR71348: {'auction_closing_time': 1774716945.0, 'created_time': 1774602074.707922, 'last_price_update_time': 1774688667.994285}
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LR71348') HTTP/1.1" 204 0
2026-03-28 09:04:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: GW48563
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW48563%27 HTTP/1.1" 200 None
2026-03-28 09:04:28 [auto1.it] INFO: Scrape type for GW48563: 0
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: FF22275
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF22275%27 HTTP/1.1" 200 None
2026-03-28 09:04:28 [auto1.it] INFO: Scrape type for FF22275: 0
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: LX97199
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX97199%27 HTTP/1.1" 200 None
2026-03-28 09:04:28 [auto1.it] INFO: Scrape type for LX97199: 0
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: DK51991
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK51991%27 HTTP/1.1" 200 None
2026-03-28 09:04:28 [auto1.it] INFO: Scrape type for DK51991: 0
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: LY57551
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: HE58096
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: PN84990
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: SM22245
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM22245%27 HTTP/1.1" 200 None
2026-03-28 09:04:28 [auto1.it] INFO: Scrape type for SM22245: 0
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: EP08968
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP08968%27 HTTP/1.1" 200 None
2026-03-28 09:04:28 [auto1.it] INFO: Scrape type for EP08968: 0
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: FB65897
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: KF31033
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: RA25408
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: KG02437
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: DP78893
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: UJ66117
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: BG99585
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: XC65612
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC65612%27 HTTP/1.1" 200 None
2026-03-28 09:04:28 [auto1.it] INFO: Scrape type for XC65612: 0
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: JR54731
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: JU83939
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: WP21128
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP21128%27 HTTP/1.1" 200 None
2026-03-28 09:04:28 [auto1.it] INFO: Scrape type for WP21128: 0
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: AL62204
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL62204%27 HTTP/1.1" 200 None
2026-03-28 09:04:28 [auto1.it] INFO: Scrape type for AL62204: 2
2026-03-28 09:04:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f03ebcb5-8b08-5425-b128-032aad838beb with identifier: AL62204
2026-03-28 09:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f03ebcb5-8b08-5425-b128-032aad838beb with scrape type 2
2026-03-28 09:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f03ebcb5-8b08-5425-b128-032aad838beb with scrape type 2
2026-03-28 09:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f03ebcb5-8b08-5425-b128-032aad838beb, identifier: AL62204
2026-03-28 09:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f03ebcb5-8b08-5425-b128-032aad838beb with identifier: AL62204
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 09:04:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 09:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f03ebcb5-8b08-5425-b128-032aad838beb with identifier: AL62204
2026-03-28 09:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f03ebcb5-8b08-5425-b128-032aad838beb with identifier: AL62204 to the API
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:01:18Z',
 'fuel_type': 'petrol',
 'id': 'f03ebcb5-8b08-5425-b128-032aad838beb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL62204',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 142306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-11',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Lovely',
 'transmission': 'manual',
 'trim': 'Lovely',
 'year': 2016}
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL62204%27 HTTP/1.1" 200 None
2026-03-28 09:04:28 [auto1.it] INFO: Saving data for AL62204: {'auction_closing_time': 1774713678.0, 'created_time': 1774602075.684408, 'last_price_update_time': 1774688668.754835}
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AL62204') HTTP/1.1" 204 0
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: SS09351
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: TH21432
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH21432%27 HTTP/1.1" 200 None
2026-03-28 09:04:28 [auto1.it] INFO: Scrape type for TH21432: 0
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: ZX88730
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX88730%27 HTTP/1.1" 200 None
2026-03-28 09:04:28 [auto1.it] INFO: Scrape type for ZX88730: 0
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: SK49323
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: CJ66066
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ66066%27 HTTP/1.1" 200 None
2026-03-28 09:04:28 [auto1.it] INFO: Scrape type for CJ66066: 0
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: AK04319
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK04319%27 HTTP/1.1" 200 None
2026-03-28 09:04:28 [auto1.it] INFO: Scrape type for AK04319: 0
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: LW29692
2026-03-28 09:04:28 [auto1.it] INFO: Found listing with ID: PM88021
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM88021%27 HTTP/1.1" 200 None
2026-03-28 09:04:28 [auto1.it] INFO: Scrape type for PM88021: 2
2026-03-28 09:04:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f20d3a0e-ed75-59d2-92de-88f69d0094d6 with identifier: PM88021
2026-03-28 09:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f20d3a0e-ed75-59d2-92de-88f69d0094d6 with scrape type 2
2026-03-28 09:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f20d3a0e-ed75-59d2-92de-88f69d0094d6 with scrape type 2
2026-03-28 09:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f20d3a0e-ed75-59d2-92de-88f69d0094d6, identifier: PM88021
2026-03-28 09:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f20d3a0e-ed75-59d2-92de-88f69d0094d6 with identifier: PM88021
2026-03-28 09:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f20d3a0e-ed75-59d2-92de-88f69d0094d6 with identifier: PM88021
2026-03-28 09:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f20d3a0e-ed75-59d2-92de-88f69d0094d6 with identifier: PM88021 to the API
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:43:40Z',
 'fuel_type': 'diesel',
 'id': 'f20d3a0e-ed75-59d2-92de-88f69d0094d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM88021',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 216352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-13',
 'seller_name': None,
 'title': 'Ford EcoSport 1.5 TDCi Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2017}
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM88021%27 HTTP/1.1" 200 None
2026-03-28 09:04:29 [auto1.it] INFO: Saving data for PM88021: {'auction_closing_time': 1774716220.0, 'created_time': 1774274479.126769, 'last_price_update_time': 1774688669.319665}
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM88021') HTTP/1.1" 204 0
2026-03-28 09:04:29 [auto1.it] INFO: Found listing with ID: DB18786
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB18786%27 HTTP/1.1" 200 None
2026-03-28 09:04:29 [auto1.it] INFO: Scrape type for DB18786: 0
2026-03-28 09:04:29 [auto1.it] INFO: Found listing with ID: DW69714
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW69714%27 HTTP/1.1" 200 None
2026-03-28 09:04:29 [auto1.it] INFO: Scrape type for DW69714: 0
2026-03-28 09:04:29 [auto1.it] INFO: Found listing with ID: GB19602
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB19602%27 HTTP/1.1" 200 None
2026-03-28 09:04:29 [auto1.it] INFO: Scrape type for GB19602: 0
2026-03-28 09:04:29 [auto1.it] INFO: Found listing with ID: JR93194
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR93194%27 HTTP/1.1" 200 None
2026-03-28 09:04:29 [auto1.it] INFO: Scrape type for JR93194: 0
2026-03-28 09:04:29 [auto1.it] INFO: Found listing with ID: CD59495
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD59495%27 HTTP/1.1" 200 None
2026-03-28 09:04:29 [auto1.it] INFO: Scrape type for CD59495: 0
2026-03-28 09:04:29 [auto1.it] INFO: Found listing with ID: SV37675
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV37675%27 HTTP/1.1" 200 None
2026-03-28 09:04:29 [auto1.it] INFO: Scrape type for SV37675: 0
2026-03-28 09:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:04:30 [auto1.it] INFO: Channel: 24h | Page: 81 | totalHits: 3435 | hits on page: 40
2026-03-28 09:04:30 [auto1.it] INFO: Found listing with ID: JV83854
2026-03-28 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV83854%27 HTTP/1.1" 200 None
2026-03-28 09:04:30 [auto1.it] INFO: Scrape type for JV83854: 2
2026-03-28 09:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fea294c8-5c81-5148-b665-3019eb160dec with identifier: JV83854
2026-03-28 09:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fea294c8-5c81-5148-b665-3019eb160dec with scrape type 2
2026-03-28 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fea294c8-5c81-5148-b665-3019eb160dec with scrape type 2
2026-03-28 09:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fea294c8-5c81-5148-b665-3019eb160dec, identifier: JV83854
2026-03-28 09:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fea294c8-5c81-5148-b665-3019eb160dec with identifier: JV83854
2026-03-28 09:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fea294c8-5c81-5148-b665-3019eb160dec with identifier: JV83854
2026-03-28 09:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fea294c8-5c81-5148-b665-3019eb160dec with identifier: JV83854 to the API
2026-03-28 09:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:49:14Z',
 'fuel_type': 'petrol',
 'id': 'fea294c8-5c81-5148-b665-3019eb160dec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV83854',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 177877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-22',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 N-Tec',
 'transmission': 'manual',
 'trim': 'N-Tec',
 'year': 2010}
2026-03-28 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV83854%27 HTTP/1.1" 200 None
2026-03-28 09:04:30 [auto1.it] INFO: Saving data for JV83854: {'auction_closing_time': 1774716554.0, 'created_time': 1774602129.178907, 'last_price_update_time': 1774688670.64166}
2026-03-28 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JV83854') HTTP/1.1" 204 0
2026-03-28 09:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:30 [auto1.it] INFO: Found listing with ID: XJ39462
2026-03-28 09:04:30 [auto1.it] INFO: Found listing with ID: NB02604
2026-03-28 09:04:30 [auto1.it] INFO: Found listing with ID: AZ52753
2026-03-28 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ52753%27 HTTP/1.1" 200 None
2026-03-28 09:04:30 [auto1.it] INFO: Scrape type for AZ52753: 0
2026-03-28 09:04:30 [auto1.it] INFO: Found listing with ID: HS22715
2026-03-28 09:04:30 [auto1.it] INFO: Found listing with ID: GB11317
2026-03-28 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB11317%27 HTTP/1.1" 200 None
2026-03-28 09:04:30 [auto1.it] INFO: Scrape type for GB11317: 2
2026-03-28 09:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67258a08-3238-5413-ac72-309d1b5d1664 with identifier: GB11317
2026-03-28 09:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67258a08-3238-5413-ac72-309d1b5d1664 with scrape type 2
2026-03-28 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67258a08-3238-5413-ac72-309d1b5d1664 with scrape type 2
2026-03-28 09:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 67258a08-3238-5413-ac72-309d1b5d1664, identifier: GB11317
2026-03-28 09:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 67258a08-3238-5413-ac72-309d1b5d1664 with identifier: GB11317
2026-03-28 09:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 67258a08-3238-5413-ac72-309d1b5d1664 with identifier: GB11317
2026-03-28 09:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 67258a08-3238-5413-ac72-309d1b5d1664 with identifier: GB11317 to the API
2026-03-28 09:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:04:11Z',
 'fuel_type': 'petrol',
 'id': '67258a08-3238-5413-ac72-309d1b5d1664',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB11317',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 46801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-06',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2021}
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB11317%27 HTTP/1.1" 200 None
2026-03-28 09:04:31 [auto1.it] INFO: Saving data for GB11317: {'auction_closing_time': 1774713851.0, 'created_time': 1774274500.350564, 'last_price_update_time': 1774688671.483795}
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GB11317') HTTP/1.1" 204 0
2026-03-28 09:04:31 [auto1.it] INFO: Found listing with ID: WW83170
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW83170%27 HTTP/1.1" 200 None
2026-03-28 09:04:31 [auto1.it] INFO: Scrape type for WW83170: 0
2026-03-28 09:04:31 [auto1.it] INFO: Found listing with ID: SL34558
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL34558%27 HTTP/1.1" 200 None
2026-03-28 09:04:31 [auto1.it] INFO: Scrape type for SL34558: 0
2026-03-28 09:04:31 [auto1.it] INFO: Found listing with ID: DW35808
2026-03-28 09:04:31 [auto1.it] INFO: Found listing with ID: RN99841
2026-03-28 09:04:31 [auto1.it] INFO: Found listing with ID: ZX72389
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX72389%27 HTTP/1.1" 200 None
2026-03-28 09:04:31 [auto1.it] INFO: Scrape type for ZX72389: 0
2026-03-28 09:04:31 [auto1.it] INFO: Found listing with ID: VA41104
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA41104%27 HTTP/1.1" 200 None
2026-03-28 09:04:31 [auto1.it] INFO: Scrape type for VA41104: 0
2026-03-28 09:04:31 [auto1.it] INFO: Found listing with ID: PW56521
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW56521%27 HTTP/1.1" 200 None
2026-03-28 09:04:31 [auto1.it] INFO: Scrape type for PW56521: 0
2026-03-28 09:04:31 [auto1.it] INFO: Found listing with ID: LH59018
2026-03-28 09:04:31 [auto1.it] INFO: Found listing with ID: AP47784
2026-03-28 09:04:31 [auto1.it] INFO: Found listing with ID: MT68027
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT68027%27 HTTP/1.1" 200 None
2026-03-28 09:04:31 [auto1.it] INFO: Scrape type for MT68027: 2
2026-03-28 09:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 866a2cc2-03bb-5f53-a8cd-b458ac0f4df9 with identifier: MT68027
2026-03-28 09:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 866a2cc2-03bb-5f53-a8cd-b458ac0f4df9 with scrape type 2
2026-03-28 09:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 866a2cc2-03bb-5f53-a8cd-b458ac0f4df9 with scrape type 2
2026-03-28 09:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 866a2cc2-03bb-5f53-a8cd-b458ac0f4df9, identifier: MT68027
2026-03-28 09:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 866a2cc2-03bb-5f53-a8cd-b458ac0f4df9 with identifier: MT68027
2026-03-28 09:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 866a2cc2-03bb-5f53-a8cd-b458ac0f4df9 with identifier: MT68027
2026-03-28 09:04:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 866a2cc2-03bb-5f53-a8cd-b458ac0f4df9 with identifier: MT68027 to the API
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:47:49Z',
 'fuel_type': 'diesel',
 'id': '866a2cc2-03bb-5f53-a8cd-b458ac0f4df9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT68027',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 99133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-15',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive Luxury Line',
 'transmission': 'automatic',
 'trim': 'xDrive Luxury Line',
 'year': 2017}
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT68027%27 HTTP/1.1" 200 None
2026-03-28 09:04:32 [auto1.it] INFO: Saving data for MT68027: {'auction_closing_time': 1774716469.0, 'created_time': 1773522201.89058, 'last_price_update_time': 1774688672.019837}
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MT68027') HTTP/1.1" 204 0
2026-03-28 09:04:32 [auto1.it] INFO: Found listing with ID: ZA31579
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA31579%27 HTTP/1.1" 200 None
2026-03-28 09:04:32 [auto1.it] INFO: Scrape type for ZA31579: 0
2026-03-28 09:04:32 [auto1.it] INFO: Found listing with ID: UX29999
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX29999%27 HTTP/1.1" 200 None
2026-03-28 09:04:32 [auto1.it] INFO: Scrape type for UX29999: 2
2026-03-28 09:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 786b5ce1-ed87-538d-b371-b85f4dfbf6ac with identifier: UX29999
2026-03-28 09:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 786b5ce1-ed87-538d-b371-b85f4dfbf6ac with scrape type 2
2026-03-28 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 786b5ce1-ed87-538d-b371-b85f4dfbf6ac with scrape type 2
2026-03-28 09:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 786b5ce1-ed87-538d-b371-b85f4dfbf6ac, identifier: UX29999
2026-03-28 09:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 786b5ce1-ed87-538d-b371-b85f4dfbf6ac with identifier: UX29999
2026-03-28 09:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 786b5ce1-ed87-538d-b371-b85f4dfbf6ac with identifier: UX29999
2026-03-28 09:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 786b5ce1-ed87-538d-b371-b85f4dfbf6ac with identifier: UX29999 to the API
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:22:00Z',
 'fuel_type': 'diesel',
 'id': '786b5ce1-ed87-538d-b371-b85f4dfbf6ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX29999',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 82936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-29',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Q4 Lusso',
 'transmission': 'automatic',
 'trim': 'Q4 Lusso',
 'year': 2018}
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX29999%27 HTTP/1.1" 200 None
2026-03-28 09:04:32 [auto1.it] INFO: Saving data for UX29999: {'auction_closing_time': 1774714920.0, 'created_time': 1774602077.40486, 'last_price_update_time': 1774688672.525705}
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UX29999') HTTP/1.1" 204 0
2026-03-28 09:04:32 [auto1.it] INFO: Found listing with ID: JH67201
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH67201%27 HTTP/1.1" 200 None
2026-03-28 09:04:32 [auto1.it] INFO: Scrape type for JH67201: 0
2026-03-28 09:04:32 [auto1.it] INFO: Found listing with ID: AL30811
2026-03-28 09:04:32 [auto1.it] INFO: Found listing with ID: TT50547
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT50547%27 HTTP/1.1" 200 None
2026-03-28 09:04:32 [auto1.it] INFO: Scrape type for TT50547: 0
2026-03-28 09:04:32 [auto1.it] INFO: Found listing with ID: JY70774
2026-03-28 09:04:32 [auto1.it] INFO: Found listing with ID: MX32120
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX32120%27 HTTP/1.1" 200 None
2026-03-28 09:04:32 [auto1.it] INFO: Scrape type for MX32120: 0
2026-03-28 09:04:32 [auto1.it] INFO: Found listing with ID: WW01067
2026-03-28 09:04:32 [auto1.it] INFO: Found listing with ID: CN60691
2026-03-28 09:04:32 [auto1.it] INFO: Found listing with ID: BR31309
2026-03-28 09:04:32 [auto1.it] INFO: Found listing with ID: DC03945
2026-03-28 09:04:32 [auto1.it] INFO: Found listing with ID: AY12786
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY12786%27 HTTP/1.1" 200 None
2026-03-28 09:04:32 [auto1.it] INFO: Scrape type for AY12786: 0
2026-03-28 09:04:32 [auto1.it] INFO: Found listing with ID: TB60435
2026-03-28 09:04:32 [auto1.it] INFO: Found listing with ID: ZA78643
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA78643%27 HTTP/1.1" 200 None
2026-03-28 09:04:32 [auto1.it] INFO: Scrape type for ZA78643: 2
2026-03-28 09:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bb37f2e-a5c6-518b-a687-82c5384dbf63 with identifier: ZA78643
2026-03-28 09:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bb37f2e-a5c6-518b-a687-82c5384dbf63 with scrape type 2
2026-03-28 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bb37f2e-a5c6-518b-a687-82c5384dbf63 with scrape type 2
2026-03-28 09:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7bb37f2e-a5c6-518b-a687-82c5384dbf63, identifier: ZA78643
2026-03-28 09:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7bb37f2e-a5c6-518b-a687-82c5384dbf63 with identifier: ZA78643
2026-03-28 09:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7bb37f2e-a5c6-518b-a687-82c5384dbf63 with identifier: ZA78643
2026-03-28 09:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7bb37f2e-a5c6-518b-a687-82c5384dbf63 with identifier: ZA78643 to the API
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:10:59Z',
 'fuel_type': 'petrol',
 'id': '7bb37f2e-a5c6-518b-a687-82c5384dbf63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA78643',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 155327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-07',
 'seller_name': None,
 'title': 'Suzuki Swift 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2013}
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA78643%27 HTTP/1.1" 200 None
2026-03-28 09:04:32 [auto1.it] INFO: Saving data for ZA78643: {'auction_closing_time': 1774714259.0, 'created_time': 1774602088.086822, 'last_price_update_time': 1774688672.997349}
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZA78643') HTTP/1.1" 204 0
2026-03-28 09:04:33 [auto1.it] INFO: Found listing with ID: VC37401
2026-03-28 09:04:33 [auto1.it] INFO: Found listing with ID: AW98600
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW98600%27 HTTP/1.1" 200 None
2026-03-28 09:04:33 [auto1.it] INFO: Scrape type for AW98600: 0
2026-03-28 09:04:33 [auto1.it] INFO: Found listing with ID: MS98879
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS98879%27 HTTP/1.1" 200 None
2026-03-28 09:04:33 [auto1.it] INFO: Scrape type for MS98879: 0
2026-03-28 09:04:33 [auto1.it] INFO: Found listing with ID: GZ29519
2026-03-28 09:04:33 [auto1.it] INFO: Found listing with ID: NJ63404
2026-03-28 09:04:33 [auto1.it] INFO: Found listing with ID: UW94573
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW94573%27 HTTP/1.1" 200 None
2026-03-28 09:04:33 [auto1.it] INFO: Scrape type for UW94573: 0
2026-03-28 09:04:33 [auto1.it] INFO: Found listing with ID: VG76075
2026-03-28 09:04:33 [auto1.it] INFO: Found listing with ID: ZG86392
2026-03-28 09:04:33 [auto1.it] INFO: Found listing with ID: DP39396
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP39396%27 HTTP/1.1" 200 None
2026-03-28 09:04:33 [auto1.it] INFO: Scrape type for DP39396: 2
2026-03-28 09:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27cd4758-3291-5493-ae6f-38e92bafeec9 with identifier: DP39396
2026-03-28 09:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27cd4758-3291-5493-ae6f-38e92bafeec9 with scrape type 2
2026-03-28 09:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27cd4758-3291-5493-ae6f-38e92bafeec9 with scrape type 2
2026-03-28 09:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 27cd4758-3291-5493-ae6f-38e92bafeec9, identifier: DP39396
2026-03-28 09:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 27cd4758-3291-5493-ae6f-38e92bafeec9 with identifier: DP39396
2026-03-28 09:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 27cd4758-3291-5493-ae6f-38e92bafeec9 with identifier: DP39396
2026-03-28 09:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 27cd4758-3291-5493-ae6f-38e92bafeec9 with identifier: DP39396 to the API
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:40:31Z',
 'fuel_type': 'petrol',
 'id': '27cd4758-3291-5493-ae6f-38e92bafeec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP39396',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 61282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-31',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2021}
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP39396%27 HTTP/1.1" 200 None
2026-03-28 09:04:33 [auto1.it] INFO: Saving data for DP39396: {'auction_closing_time': 1774716031.0, 'created_time': 1774267322.438675, 'last_price_update_time': 1774688673.581099}
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DP39396') HTTP/1.1" 204 0
2026-03-28 09:04:33 [auto1.it] INFO: Found listing with ID: EB44431
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB44431%27 HTTP/1.1" 200 None
2026-03-28 09:04:33 [auto1.it] INFO: Scrape type for EB44431: 0
2026-03-28 09:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:04:34 [auto1.it] INFO: Channel: 24h | Page: 82 | totalHits: 3436 | hits on page: 40
2026-03-28 09:04:34 [auto1.it] INFO: Found listing with ID: EB44431
2026-03-28 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB44431%27 HTTP/1.1" 200 None
2026-03-28 09:04:34 [auto1.it] INFO: Scrape type for EB44431: 0
2026-03-28 09:04:34 [auto1.it] INFO: Found listing with ID: KM03539
2026-03-28 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM03539%27 HTTP/1.1" 200 None
2026-03-28 09:04:34 [auto1.it] INFO: Scrape type for KM03539: 0
2026-03-28 09:04:34 [auto1.it] INFO: Found listing with ID: RE99850
2026-03-28 09:04:34 [auto1.it] INFO: Found listing with ID: SK80279
2026-03-28 09:04:34 [auto1.it] INFO: Found listing with ID: US69373
2026-03-28 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US69373%27 HTTP/1.1" 200 None
2026-03-28 09:04:34 [auto1.it] INFO: Scrape type for US69373: 0
2026-03-28 09:04:34 [auto1.it] INFO: Found listing with ID: NC67394
2026-03-28 09:04:34 [auto1.it] INFO: Found listing with ID: JF90456
2026-03-28 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF90456%27 HTTP/1.1" 200 None
2026-03-28 09:04:34 [auto1.it] INFO: Scrape type for JF90456: 0
2026-03-28 09:04:34 [auto1.it] INFO: Found listing with ID: JC41210
2026-03-28 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC41210%27 HTTP/1.1" 200 None
2026-03-28 09:04:34 [auto1.it] INFO: Scrape type for JC41210: 0
2026-03-28 09:04:34 [auto1.it] INFO: Found listing with ID: HW82018
2026-03-28 09:04:34 [auto1.it] INFO: Found listing with ID: VY08024
2026-03-28 09:04:34 [auto1.it] INFO: Found listing with ID: AE09913
2026-03-28 09:04:34 [auto1.it] INFO: Found listing with ID: ST64226
2026-03-28 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST64226%27 HTTP/1.1" 200 None
2026-03-28 09:04:34 [auto1.it] INFO: Scrape type for ST64226: 0
2026-03-28 09:04:34 [auto1.it] INFO: Found listing with ID: TH88339
2026-03-28 09:04:34 [auto1.it] INFO: Found listing with ID: XJ18858
2026-03-28 09:04:34 [auto1.it] INFO: Found listing with ID: NM56587
2026-03-28 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM56587%27 HTTP/1.1" 200 None
2026-03-28 09:04:34 [auto1.it] INFO: Scrape type for NM56587: 2
2026-03-28 09:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 776753dc-97ed-5b53-a84b-511ed5d3488e with identifier: NM56587
2026-03-28 09:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 776753dc-97ed-5b53-a84b-511ed5d3488e with scrape type 2
2026-03-28 09:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 776753dc-97ed-5b53-a84b-511ed5d3488e with scrape type 2
2026-03-28 09:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 776753dc-97ed-5b53-a84b-511ed5d3488e, identifier: NM56587
2026-03-28 09:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 776753dc-97ed-5b53-a84b-511ed5d3488e with identifier: NM56587
2026-03-28 09:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 776753dc-97ed-5b53-a84b-511ed5d3488e with identifier: NM56587
2026-03-28 09:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 776753dc-97ed-5b53-a84b-511ed5d3488e with identifier: NM56587 to the API
2026-03-28 09:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:43:25Z',
 'fuel_type': 'diesel',
 'id': '776753dc-97ed-5b53-a84b-511ed5d3488e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM56587',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 149968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-27',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Business',
 'transmission': 'automatic',
 'trim': 'Q4 Business',
 'year': 2019}
2026-03-28 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM56587%27 HTTP/1.1" 200 None
2026-03-28 09:04:35 [auto1.it] INFO: Saving data for NM56587: {'auction_closing_time': 1774716205.0, 'created_time': 1774602082.122866, 'last_price_update_time': 1774688675.378012}
2026-03-28 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NM56587') HTTP/1.1" 204 0
2026-03-28 09:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:35 [auto1.it] INFO: Found listing with ID: NF96122
2026-03-28 09:04:35 [auto1.it] INFO: Found listing with ID: SX04553
2026-03-28 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX04553%27 HTTP/1.1" 200 None
2026-03-28 09:04:35 [auto1.it] INFO: Scrape type for SX04553: 2
2026-03-28 09:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74079aa4-72cf-5726-82b5-f3fc25c59b34 with identifier: SX04553
2026-03-28 09:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74079aa4-72cf-5726-82b5-f3fc25c59b34 with scrape type 2
2026-03-28 09:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74079aa4-72cf-5726-82b5-f3fc25c59b34 with scrape type 2
2026-03-28 09:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 74079aa4-72cf-5726-82b5-f3fc25c59b34, identifier: SX04553
2026-03-28 09:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 74079aa4-72cf-5726-82b5-f3fc25c59b34 with identifier: SX04553
2026-03-28 09:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 74079aa4-72cf-5726-82b5-f3fc25c59b34 with identifier: SX04553
2026-03-28 09:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 74079aa4-72cf-5726-82b5-f3fc25c59b34 with identifier: SX04553 to the API
2026-03-28 09:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:54:28Z',
 'fuel_type': 'diesel',
 'id': '74079aa4-72cf-5726-82b5-f3fc25c59b34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX04553',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 145375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-29',
 'seller_name': None,
 'title': 'Seat Ateca 1.6 TDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2020}
2026-03-28 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX04553%27 HTTP/1.1" 200 None
2026-03-28 09:04:35 [auto1.it] INFO: Saving data for SX04553: {'auction_closing_time': 1774716868.0, 'created_time': 1774602128.716998, 'last_price_update_time': 1774688675.860136}
2026-03-28 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SX04553') HTTP/1.1" 204 0
2026-03-28 09:04:35 [auto1.it] INFO: Found listing with ID: LB78915
2026-03-28 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB78915%27 HTTP/1.1" 200 None
2026-03-28 09:04:35 [auto1.it] INFO: Scrape type for LB78915: 2
2026-03-28 09:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abe25e49-58e0-5f9d-9e42-23047874f590 with identifier: LB78915
2026-03-28 09:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abe25e49-58e0-5f9d-9e42-23047874f590 with scrape type 2
2026-03-28 09:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abe25e49-58e0-5f9d-9e42-23047874f590 with scrape type 2
2026-03-28 09:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: abe25e49-58e0-5f9d-9e42-23047874f590, identifier: LB78915
2026-03-28 09:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: abe25e49-58e0-5f9d-9e42-23047874f590 with identifier: LB78915
2026-03-28 09:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: abe25e49-58e0-5f9d-9e42-23047874f590 with identifier: LB78915
2026-03-28 09:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: abe25e49-58e0-5f9d-9e42-23047874f590 with identifier: LB78915 to the API
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:33:37Z',
 'fuel_type': 'petrol',
 'id': 'abe25e49-58e0-5f9d-9e42-23047874f590',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB78915',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 199761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-20',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2007}
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB78915%27 HTTP/1.1" 200 None
2026-03-28 09:04:36 [auto1.it] INFO: Saving data for LB78915: {'auction_closing_time': 1774715617.0, 'created_time': 1774101637.952861, 'last_price_update_time': 1774688676.255049}
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LB78915') HTTP/1.1" 204 0
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: NC00198
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC00198%27 HTTP/1.1" 200 None
2026-03-28 09:04:36 [auto1.it] INFO: Scrape type for NC00198: 0
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: GA39078
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: JP92326
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: NC97185
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC97185%27 HTTP/1.1" 200 None
2026-03-28 09:04:36 [auto1.it] INFO: Scrape type for NC97185: 0
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: MJ97902
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: NV87278
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV87278%27 HTTP/1.1" 200 None
2026-03-28 09:04:36 [auto1.it] INFO: Scrape type for NV87278: 0
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: EM60693
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM60693%27 HTTP/1.1" 200 None
2026-03-28 09:04:36 [auto1.it] INFO: Scrape type for EM60693: 0
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: XH17321
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: ES59878
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES59878%27 HTTP/1.1" 200 None
2026-03-28 09:04:36 [auto1.it] INFO: Scrape type for ES59878: 0
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: SK90576
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: SX21241
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX21241%27 HTTP/1.1" 200 None
2026-03-28 09:04:36 [auto1.it] INFO: Scrape type for SX21241: 0
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: FF76752
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: MG44195
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG44195%27 HTTP/1.1" 200 None
2026-03-28 09:04:36 [auto1.it] INFO: Scrape type for MG44195: 0
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: WY95771
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: GN63834
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN63834%27 HTTP/1.1" 200 None
2026-03-28 09:04:36 [auto1.it] INFO: Scrape type for GN63834: 0
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: PA53057
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: TL40655
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: VX86460
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX86460%27 HTTP/1.1" 200 None
2026-03-28 09:04:36 [auto1.it] INFO: Scrape type for VX86460: 0
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: LX42454
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX42454%27 HTTP/1.1" 200 None
2026-03-28 09:04:36 [auto1.it] INFO: Scrape type for LX42454: 2
2026-03-28 09:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 946007ea-a454-592c-a25d-aa3ca67dc784 with identifier: LX42454
2026-03-28 09:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 946007ea-a454-592c-a25d-aa3ca67dc784 with scrape type 2
2026-03-28 09:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 946007ea-a454-592c-a25d-aa3ca67dc784 with scrape type 2
2026-03-28 09:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 946007ea-a454-592c-a25d-aa3ca67dc784, identifier: LX42454
2026-03-28 09:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 946007ea-a454-592c-a25d-aa3ca67dc784 with identifier: LX42454
2026-03-28 09:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 946007ea-a454-592c-a25d-aa3ca67dc784 with identifier: LX42454
2026-03-28 09:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 946007ea-a454-592c-a25d-aa3ca67dc784 with identifier: LX42454 to the API
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:37:35Z',
 'fuel_type': 'diesel',
 'id': '946007ea-a454-592c-a25d-aa3ca67dc784',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX42454',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 53095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-26',
 'seller_name': None,
 'title': 'Skoda Karoq 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2023}
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX42454%27 HTTP/1.1" 200 None
2026-03-28 09:04:36 [auto1.it] INFO: Saving data for LX42454: {'auction_closing_time': 1774715855.0, 'created_time': 1774274461.361713, 'last_price_update_time': 1774688676.836276}
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LX42454') HTTP/1.1" 204 0
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: HK70439
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK70439%27 HTTP/1.1" 200 None
2026-03-28 09:04:36 [auto1.it] INFO: Scrape type for HK70439: 0
2026-03-28 09:04:36 [auto1.it] INFO: Found listing with ID: ER51817
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER51817%27 HTTP/1.1" 200 None
2026-03-28 09:04:36 [auto1.it] INFO: Scrape type for ER51817: 2
2026-03-28 09:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d8b0534-2f81-5b85-a6ee-f02ea1d4b92c with identifier: ER51817
2026-03-28 09:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d8b0534-2f81-5b85-a6ee-f02ea1d4b92c with scrape type 2
2026-03-28 09:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d8b0534-2f81-5b85-a6ee-f02ea1d4b92c with scrape type 2
2026-03-28 09:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1d8b0534-2f81-5b85-a6ee-f02ea1d4b92c, identifier: ER51817
2026-03-28 09:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1d8b0534-2f81-5b85-a6ee-f02ea1d4b92c with identifier: ER51817
2026-03-28 09:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1d8b0534-2f81-5b85-a6ee-f02ea1d4b92c with identifier: ER51817
2026-03-28 09:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1d8b0534-2f81-5b85-a6ee-f02ea1d4b92c with identifier: ER51817 to the API
2026-03-28 09:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:27:36Z',
 'fuel_type': 'petrol',
 'id': '1d8b0534-2f81-5b85-a6ee-f02ea1d4b92c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER51817',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 113462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-19',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2017}
2026-03-28 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER51817%27 HTTP/1.1" 200 None
2026-03-28 09:04:37 [auto1.it] INFO: Saving data for ER51817: {'auction_closing_time': 1774715256.0, 'created_time': 1774602126.474483, 'last_price_update_time': 1774688677.341588}
2026-03-28 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ER51817') HTTP/1.1" 204 0
2026-03-28 09:04:37 [auto1.it] INFO: Found listing with ID: CA07197
2026-03-28 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA07197%27 HTTP/1.1" 200 None
2026-03-28 09:04:37 [auto1.it] INFO: Scrape type for CA07197: 0
2026-03-28 09:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:04:38 [auto1.it] INFO: Channel: 24h | Page: 83 | totalHits: 3436 | hits on page: 40
2026-03-28 09:04:38 [auto1.it] INFO: Found listing with ID: TJ19111
2026-03-28 09:04:38 [auto1.it] INFO: Found listing with ID: XX93100
2026-03-28 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX93100%27 HTTP/1.1" 200 None
2026-03-28 09:04:38 [auto1.it] INFO: Scrape type for XX93100: 0
2026-03-28 09:04:38 [auto1.it] INFO: Found listing with ID: MR16221
2026-03-28 09:04:38 [auto1.it] INFO: Found listing with ID: YP04797
2026-03-28 09:04:38 [auto1.it] INFO: Found listing with ID: DE48831
2026-03-28 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE48831%27 HTTP/1.1" 200 None
2026-03-28 09:04:38 [auto1.it] INFO: Scrape type for DE48831: 0
2026-03-28 09:04:38 [auto1.it] INFO: Found listing with ID: LS49318
2026-03-28 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS49318%27 HTTP/1.1" 200 None
2026-03-28 09:04:38 [auto1.it] INFO: Scrape type for LS49318: 2
2026-03-28 09:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd8f6ccf-21f0-5790-b6c9-e703b61bc739 with identifier: LS49318
2026-03-28 09:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd8f6ccf-21f0-5790-b6c9-e703b61bc739 with scrape type 2
2026-03-28 09:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd8f6ccf-21f0-5790-b6c9-e703b61bc739 with scrape type 2
2026-03-28 09:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd8f6ccf-21f0-5790-b6c9-e703b61bc739, identifier: LS49318
2026-03-28 09:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd8f6ccf-21f0-5790-b6c9-e703b61bc739 with identifier: LS49318
2026-03-28 09:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd8f6ccf-21f0-5790-b6c9-e703b61bc739 with identifier: LS49318
2026-03-28 09:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd8f6ccf-21f0-5790-b6c9-e703b61bc739 with identifier: LS49318 to the API
2026-03-28 09:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:03:10Z',
 'fuel_type': 'diesel',
 'id': 'dd8f6ccf-21f0-5790-b6c9-e703b61bc739',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS49318',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 79861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-12',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2019}
2026-03-28 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS49318%27 HTTP/1.1" 200 None
2026-03-28 09:04:38 [auto1.it] INFO: Saving data for LS49318: {'auction_closing_time': 1774713790.0, 'created_time': 1771023117.611739, 'last_price_update_time': 1774688678.751151}
2026-03-28 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LS49318') HTTP/1.1" 204 0
2026-03-28 09:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:38 [auto1.it] INFO: Found listing with ID: ZW56281
2026-03-28 09:04:38 [auto1.it] INFO: Found listing with ID: ET21203
2026-03-28 09:04:38 [auto1.it] INFO: Found listing with ID: SV89112
2026-03-28 09:04:38 [auto1.it] INFO: Found listing with ID: ZL07806
2026-03-28 09:04:38 [auto1.it] INFO: Found listing with ID: WH83035
2026-03-28 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH83035%27 HTTP/1.1" 200 None
2026-03-28 09:04:38 [auto1.it] INFO: Scrape type for WH83035: 0
2026-03-28 09:04:38 [auto1.it] INFO: Found listing with ID: XX96776
2026-03-28 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX96776%27 HTTP/1.1" 200 None
2026-03-28 09:04:38 [auto1.it] INFO: Scrape type for XX96776: 2
2026-03-28 09:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abacf63f-fca8-5db7-a376-ba334238cee0 with identifier: XX96776
2026-03-28 09:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abacf63f-fca8-5db7-a376-ba334238cee0 with scrape type 2
2026-03-28 09:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abacf63f-fca8-5db7-a376-ba334238cee0 with scrape type 2
2026-03-28 09:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: abacf63f-fca8-5db7-a376-ba334238cee0, identifier: XX96776
2026-03-28 09:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: abacf63f-fca8-5db7-a376-ba334238cee0 with identifier: XX96776
2026-03-28 09:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: abacf63f-fca8-5db7-a376-ba334238cee0 with identifier: XX96776
2026-03-28 09:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: abacf63f-fca8-5db7-a376-ba334238cee0 with identifier: XX96776 to the API
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:30:32Z',
 'fuel_type': 'petrol',
 'id': 'abacf63f-fca8-5db7-a376-ba334238cee0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX96776',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 92967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-25',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 1.4 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX96776%27 HTTP/1.1" 200 None
2026-03-28 09:04:39 [auto1.it] INFO: Saving data for XX96776: {'auction_closing_time': 1774715432.0, 'created_time': 1773232857.506026, 'last_price_update_time': 1774688679.194148}
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XX96776') HTTP/1.1" 204 0
2026-03-28 09:04:39 [auto1.it] INFO: Found listing with ID: VV97216
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV97216%27 HTTP/1.1" 200 None
2026-03-28 09:04:39 [auto1.it] INFO: Scrape type for VV97216: 2
2026-03-28 09:04:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 389dce05-ba67-59b6-a7c7-36784b22e499 with identifier: VV97216
2026-03-28 09:04:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 389dce05-ba67-59b6-a7c7-36784b22e499 with scrape type 2
2026-03-28 09:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 389dce05-ba67-59b6-a7c7-36784b22e499 with scrape type 2
2026-03-28 09:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 389dce05-ba67-59b6-a7c7-36784b22e499, identifier: VV97216
2026-03-28 09:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 389dce05-ba67-59b6-a7c7-36784b22e499 with identifier: VV97216
2026-03-28 09:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 389dce05-ba67-59b6-a7c7-36784b22e499 with identifier: VV97216
2026-03-28 09:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 389dce05-ba67-59b6-a7c7-36784b22e499 with identifier: VV97216 to the API
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:30:28Z',
 'fuel_type': 'diesel',
 'id': '389dce05-ba67-59b6-a7c7-36784b22e499',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV97216',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 25205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-05',
 'seller_name': None,
 'title': 'Fiat Doblo 1.5 Blue-HDi Kasten L1',
 'transmission': 'manual',
 'trim': 'Kasten L1',
 'year': 2023}
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV97216%27 HTTP/1.1" 200 None
2026-03-28 09:04:39 [auto1.it] INFO: Saving data for VV97216: {'auction_closing_time': 1774715428.0, 'created_time': 1774602133.108753, 'last_price_update_time': 1774688679.683429}
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VV97216') HTTP/1.1" 204 0
2026-03-28 09:04:39 [auto1.it] INFO: Found listing with ID: DP87516
2026-03-28 09:04:39 [auto1.it] INFO: Found listing with ID: FF48098
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF48098%27 HTTP/1.1" 200 None
2026-03-28 09:04:39 [auto1.it] INFO: Scrape type for FF48098: 0
2026-03-28 09:04:39 [auto1.it] INFO: Found listing with ID: GV75261
2026-03-28 09:04:39 [auto1.it] INFO: Found listing with ID: TV74767
2026-03-28 09:04:39 [auto1.it] INFO: Found listing with ID: YW82008
2026-03-28 09:04:39 [auto1.it] INFO: Found listing with ID: KD02463
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD02463%27 HTTP/1.1" 200 None
2026-03-28 09:04:39 [auto1.it] INFO: Scrape type for KD02463: 0
2026-03-28 09:04:39 [auto1.it] INFO: Found listing with ID: RT31033
2026-03-28 09:04:39 [auto1.it] INFO: Found listing with ID: KW23650
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW23650%27 HTTP/1.1" 200 None
2026-03-28 09:04:39 [auto1.it] INFO: Scrape type for KW23650: 0
2026-03-28 09:04:39 [auto1.it] INFO: Found listing with ID: DW12322
2026-03-28 09:04:39 [auto1.it] INFO: Found listing with ID: HL13838
2026-03-28 09:04:39 [auto1.it] INFO: Found listing with ID: KS49913
2026-03-28 09:04:39 [auto1.it] INFO: Found listing with ID: BT22959
2026-03-28 09:04:39 [auto1.it] INFO: Found listing with ID: MN59888
2026-03-28 09:04:39 [auto1.it] INFO: Found listing with ID: FW35723
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW35723%27 HTTP/1.1" 200 None
2026-03-28 09:04:39 [auto1.it] INFO: Scrape type for FW35723: 2
2026-03-28 09:04:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 048e1d70-21ab-543a-bbb9-43548d9478ae with identifier: FW35723
2026-03-28 09:04:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 048e1d70-21ab-543a-bbb9-43548d9478ae with scrape type 2
2026-03-28 09:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 048e1d70-21ab-543a-bbb9-43548d9478ae with scrape type 2
2026-03-28 09:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 048e1d70-21ab-543a-bbb9-43548d9478ae, identifier: FW35723
2026-03-28 09:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 048e1d70-21ab-543a-bbb9-43548d9478ae with identifier: FW35723
2026-03-28 09:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 048e1d70-21ab-543a-bbb9-43548d9478ae with identifier: FW35723
2026-03-28 09:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 048e1d70-21ab-543a-bbb9-43548d9478ae with identifier: FW35723 to the API
2026-03-28 09:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:51:15Z',
 'fuel_type': 'diesel',
 'id': '048e1d70-21ab-543a-bbb9-43548d9478ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW35723',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 72509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-27',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2023}
2026-03-28 09:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW35723%27 HTTP/1.1" 200 None
2026-03-28 09:04:40 [auto1.it] INFO: Saving data for FW35723: {'auction_closing_time': 1774716675.0, 'created_time': 1773136356.369057, 'last_price_update_time': 1774688680.130794}
2026-03-28 09:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FW35723') HTTP/1.1" 204 0
2026-03-28 09:04:40 [auto1.it] INFO: Found listing with ID: KR27714
2026-03-28 09:04:40 [auto1.it] INFO: Found listing with ID: ED22447
2026-03-28 09:04:40 [auto1.it] INFO: Found listing with ID: VJ79188
2026-03-28 09:04:40 [auto1.it] INFO: Found listing with ID: LU63689
2026-03-28 09:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU63689%27 HTTP/1.1" 200 None
2026-03-28 09:04:40 [auto1.it] INFO: Scrape type for LU63689: 2
2026-03-28 09:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bd9f5c9-7b6e-58a3-a7fe-62d122bdce64 with identifier: LU63689
2026-03-28 09:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bd9f5c9-7b6e-58a3-a7fe-62d122bdce64 with scrape type 2
2026-03-28 09:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bd9f5c9-7b6e-58a3-a7fe-62d122bdce64 with scrape type 2
2026-03-28 09:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3bd9f5c9-7b6e-58a3-a7fe-62d122bdce64, identifier: LU63689
2026-03-28 09:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3bd9f5c9-7b6e-58a3-a7fe-62d122bdce64 with identifier: LU63689
2026-03-28 09:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3bd9f5c9-7b6e-58a3-a7fe-62d122bdce64 with identifier: LU63689
2026-03-28 09:04:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3bd9f5c9-7b6e-58a3-a7fe-62d122bdce64 with identifier: LU63689 to the API
2026-03-28 09:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:59:33Z',
 'fuel_type': 'petrol',
 'id': '3bd9f5c9-7b6e-58a3-a7fe-62d122bdce64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU63689',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Idea',
 'odometer': 118727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-30',
 'seller_name': None,
 'title': 'Fiat Idea 1.4 Emotion',
 'transmission': 'manual',
 'trim': 'Emotion',
 'year': 2006}
2026-03-28 09:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU63689%27 HTTP/1.1" 200 None
2026-03-28 09:04:40 [auto1.it] INFO: Saving data for LU63689: {'auction_closing_time': 1774717173.0, 'created_time': 1774602125.501663, 'last_price_update_time': 1774688680.623239}
2026-03-28 09:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LU63689') HTTP/1.1" 204 0
2026-03-28 09:04:40 [auto1.it] INFO: Found listing with ID: WV37243
2026-03-28 09:04:40 [auto1.it] INFO: Found listing with ID: JB13262
2026-03-28 09:04:40 [auto1.it] INFO: Found listing with ID: CC61798
2026-03-28 09:04:40 [auto1.it] INFO: Found listing with ID: WD34729
2026-03-28 09:04:40 [auto1.it] INFO: Found listing with ID: XH41983
2026-03-28 09:04:40 [auto1.it] INFO: Found listing with ID: ZW84587
2026-03-28 09:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW84587%27 HTTP/1.1" 200 None
2026-03-28 09:04:40 [auto1.it] INFO: Scrape type for ZW84587: 2
2026-03-28 09:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c96a834-14ad-5632-9f34-cf801cf79a3a with identifier: ZW84587
2026-03-28 09:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c96a834-14ad-5632-9f34-cf801cf79a3a with scrape type 2
2026-03-28 09:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c96a834-14ad-5632-9f34-cf801cf79a3a with scrape type 2
2026-03-28 09:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9c96a834-14ad-5632-9f34-cf801cf79a3a, identifier: ZW84587
2026-03-28 09:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9c96a834-14ad-5632-9f34-cf801cf79a3a with identifier: ZW84587
2026-03-28 09:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9c96a834-14ad-5632-9f34-cf801cf79a3a with identifier: ZW84587
2026-03-28 09:04:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9c96a834-14ad-5632-9f34-cf801cf79a3a with identifier: ZW84587 to the API
2026-03-28 09:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:36:45Z',
 'fuel_type': 'diesel',
 'id': '9c96a834-14ad-5632-9f34-cf801cf79a3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW84587',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 129915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-10',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2020}
2026-03-28 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW84587%27 HTTP/1.1" 200 None
2026-03-28 09:04:41 [auto1.it] INFO: Saving data for ZW84587: {'auction_closing_time': 1774715805.0, 'created_time': 1772626441.917212, 'last_price_update_time': 1774688681.059909}
2026-03-28 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZW84587') HTTP/1.1" 204 0
2026-03-28 09:04:41 [auto1.it] INFO: Found listing with ID: LN05453
2026-03-28 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN05453%27 HTTP/1.1" 200 None
2026-03-28 09:04:41 [auto1.it] INFO: Scrape type for LN05453: 2
2026-03-28 09:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eafd968d-d4d2-5090-8e94-2fae17b53c2a with identifier: LN05453
2026-03-28 09:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eafd968d-d4d2-5090-8e94-2fae17b53c2a with scrape type 2
2026-03-28 09:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eafd968d-d4d2-5090-8e94-2fae17b53c2a with scrape type 2
2026-03-28 09:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eafd968d-d4d2-5090-8e94-2fae17b53c2a, identifier: LN05453
2026-03-28 09:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eafd968d-d4d2-5090-8e94-2fae17b53c2a with identifier: LN05453
2026-03-28 09:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eafd968d-d4d2-5090-8e94-2fae17b53c2a with identifier: LN05453
2026-03-28 09:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eafd968d-d4d2-5090-8e94-2fae17b53c2a with identifier: LN05453 to the API
2026-03-28 09:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:37:29Z',
 'fuel_type': 'diesel',
 'id': 'eafd968d-d4d2-5090-8e94-2fae17b53c2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN05453',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 119765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-30',
 'seller_name': None,
 'title': 'MINI Countryman Cooper SD',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN05453%27 HTTP/1.1" 200 None
2026-03-28 09:04:41 [auto1.it] INFO: Saving data for LN05453: {'auction_closing_time': 1774715849.0, 'created_time': 1773136057.557158, 'last_price_update_time': 1774688681.455492}
2026-03-28 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LN05453') HTTP/1.1" 204 0
2026-03-28 09:04:41 [auto1.it] INFO: Found listing with ID: RT93241
2026-03-28 09:04:41 [auto1.it] INFO: Found listing with ID: RY04213
2026-03-28 09:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:04:41 [auto1.it] INFO: Channel: 24h | Page: 84 | totalHits: 3436 | hits on page: 40
2026-03-28 09:04:41 [auto1.it] INFO: Found listing with ID: ER90508
2026-03-28 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER90508%27 HTTP/1.1" 200 None
2026-03-28 09:04:41 [auto1.it] INFO: Scrape type for ER90508: 2
2026-03-28 09:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 615cc3c5-f14d-5174-b9e9-776eb7691707 with identifier: ER90508
2026-03-28 09:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 615cc3c5-f14d-5174-b9e9-776eb7691707 with scrape type 2
2026-03-28 09:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 615cc3c5-f14d-5174-b9e9-776eb7691707 with scrape type 2
2026-03-28 09:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 615cc3c5-f14d-5174-b9e9-776eb7691707, identifier: ER90508
2026-03-28 09:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 615cc3c5-f14d-5174-b9e9-776eb7691707 with identifier: ER90508
2026-03-28 09:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 615cc3c5-f14d-5174-b9e9-776eb7691707 with identifier: ER90508
2026-03-28 09:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 615cc3c5-f14d-5174-b9e9-776eb7691707 with identifier: ER90508 to the API
2026-03-28 09:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:30:08Z',
 'fuel_type': 'petrol',
 'id': '615cc3c5-f14d-5174-b9e9-776eb7691707',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER90508',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 219776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-31',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER90508%27 HTTP/1.1" 200 None
2026-03-28 09:04:42 [auto1.it] INFO: Saving data for ER90508: {'auction_closing_time': 1774715408.0, 'created_time': 1773130949.491152, 'last_price_update_time': 1774688682.062229}
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ER90508') HTTP/1.1" 204 0
2026-03-28 09:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:42 [auto1.it] INFO: Found listing with ID: HZ93936
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ93936%27 HTTP/1.1" 200 None
2026-03-28 09:04:42 [auto1.it] INFO: Scrape type for HZ93936: 2
2026-03-28 09:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23620069-80a3-5f04-a89f-b9116754e3f5 with identifier: HZ93936
2026-03-28 09:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23620069-80a3-5f04-a89f-b9116754e3f5 with scrape type 2
2026-03-28 09:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23620069-80a3-5f04-a89f-b9116754e3f5 with scrape type 2
2026-03-28 09:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 23620069-80a3-5f04-a89f-b9116754e3f5, identifier: HZ93936
2026-03-28 09:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 23620069-80a3-5f04-a89f-b9116754e3f5 with identifier: HZ93936
2026-03-28 09:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 23620069-80a3-5f04-a89f-b9116754e3f5 with identifier: HZ93936
2026-03-28 09:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 23620069-80a3-5f04-a89f-b9116754e3f5 with identifier: HZ93936 to the API
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:12:00Z',
 'fuel_type': 'diesel',
 'id': '23620069-80a3-5f04-a89f-b9116754e3f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ93936',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 172736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-31',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Classic blue 2WD',
 'transmission': 'manual',
 'trim': 'Classic blue 2WD',
 'year': 2015}
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ93936%27 HTTP/1.1" 200 None
2026-03-28 09:04:42 [auto1.it] INFO: Saving data for HZ93936: {'auction_closing_time': 1774714320.0, 'created_time': 1774602129.584226, 'last_price_update_time': 1774688682.503351}
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HZ93936') HTTP/1.1" 204 0
2026-03-28 09:04:42 [auto1.it] INFO: Found listing with ID: NF97325
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF97325%27 HTTP/1.1" 200 None
2026-03-28 09:04:42 [auto1.it] INFO: Scrape type for NF97325: 2
2026-03-28 09:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acef5101-5a42-5b2a-9548-9ab4ae633b14 with identifier: NF97325
2026-03-28 09:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acef5101-5a42-5b2a-9548-9ab4ae633b14 with scrape type 2
2026-03-28 09:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acef5101-5a42-5b2a-9548-9ab4ae633b14 with scrape type 2
2026-03-28 09:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: acef5101-5a42-5b2a-9548-9ab4ae633b14, identifier: NF97325
2026-03-28 09:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: acef5101-5a42-5b2a-9548-9ab4ae633b14 with identifier: NF97325
2026-03-28 09:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: acef5101-5a42-5b2a-9548-9ab4ae633b14 with identifier: NF97325
2026-03-28 09:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: acef5101-5a42-5b2a-9548-9ab4ae633b14 with identifier: NF97325 to the API
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:49:09Z',
 'fuel_type': 'gas',
 'id': 'acef5101-5a42-5b2a-9548-9ab4ae633b14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF97325',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 54672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-25',
 'seller_name': None,
 'title': 'Renault Captur 1.0 TCe LPG Techno',
 'transmission': 'manual',
 'trim': 'Techno',
 'year': 2023}
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF97325%27 HTTP/1.1" 200 None
2026-03-28 09:04:42 [auto1.it] INFO: Saving data for NF97325: {'auction_closing_time': 1774716549.0, 'created_time': 1774602134.994999, 'last_price_update_time': 1774688682.910736}
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF97325') HTTP/1.1" 204 0
2026-03-28 09:04:42 [auto1.it] INFO: Found listing with ID: JE32335
2026-03-28 09:04:42 [auto1.it] INFO: Found listing with ID: BJ63933
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ63933%27 HTTP/1.1" 200 None
2026-03-28 09:04:42 [auto1.it] INFO: Scrape type for BJ63933: 2
2026-03-28 09:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f92537a-4129-524d-bdd9-ffa012700bb8 with identifier: BJ63933
2026-03-28 09:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f92537a-4129-524d-bdd9-ffa012700bb8 with scrape type 2
2026-03-28 09:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f92537a-4129-524d-bdd9-ffa012700bb8 with scrape type 2
2026-03-28 09:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f92537a-4129-524d-bdd9-ffa012700bb8, identifier: BJ63933
2026-03-28 09:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f92537a-4129-524d-bdd9-ffa012700bb8 with identifier: BJ63933
2026-03-28 09:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f92537a-4129-524d-bdd9-ffa012700bb8 with identifier: BJ63933
2026-03-28 09:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f92537a-4129-524d-bdd9-ffa012700bb8 with identifier: BJ63933 to the API
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:28:25Z',
 'fuel_type': 'diesel',
 'id': '0f92537a-4129-524d-bdd9-ffa012700bb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ63933',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 161990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-28',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ63933%27 HTTP/1.1" 200 None
2026-03-28 09:04:43 [auto1.it] INFO: Saving data for BJ63933: {'auction_closing_time': 1774715305.0, 'created_time': 1774602127.368554, 'last_price_update_time': 1774688683.312824}
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BJ63933') HTTP/1.1" 204 0
2026-03-28 09:04:43 [auto1.it] INFO: Found listing with ID: LR54413
2026-03-28 09:04:43 [auto1.it] INFO: Found listing with ID: XN19179
2026-03-28 09:04:43 [auto1.it] INFO: Found listing with ID: EZ73351
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ73351%27 HTTP/1.1" 200 None
2026-03-28 09:04:43 [auto1.it] INFO: Scrape type for EZ73351: 2
2026-03-28 09:04:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3a63779-536f-5a30-afae-479c86d5b6e4 with identifier: EZ73351
2026-03-28 09:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3a63779-536f-5a30-afae-479c86d5b6e4 with scrape type 2
2026-03-28 09:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3a63779-536f-5a30-afae-479c86d5b6e4 with scrape type 2
2026-03-28 09:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e3a63779-536f-5a30-afae-479c86d5b6e4, identifier: EZ73351
2026-03-28 09:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e3a63779-536f-5a30-afae-479c86d5b6e4 with identifier: EZ73351
2026-03-28 09:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e3a63779-536f-5a30-afae-479c86d5b6e4 with identifier: EZ73351
2026-03-28 09:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e3a63779-536f-5a30-afae-479c86d5b6e4 with identifier: EZ73351 to the API
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:43:44Z',
 'fuel_type': 'diesel',
 'id': 'e3a63779-536f-5a30-afae-479c86d5b6e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ73351',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 144730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-06',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2014}
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ73351%27 HTTP/1.1" 200 None
2026-03-28 09:04:43 [auto1.it] INFO: Saving data for EZ73351: {'auction_closing_time': 1774716224.0, 'created_time': 1772223867.639229, 'last_price_update_time': 1774688683.723439}
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EZ73351') HTTP/1.1" 204 0
2026-03-28 09:04:43 [auto1.it] INFO: Found listing with ID: SB88786
2026-03-28 09:04:43 [auto1.it] INFO: Found listing with ID: HE93915
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE93915%27 HTTP/1.1" 200 None
2026-03-28 09:04:43 [auto1.it] INFO: Scrape type for HE93915: 2
2026-03-28 09:04:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3da12c31-4b38-509e-b958-cf9aed65689b with identifier: HE93915
2026-03-28 09:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3da12c31-4b38-509e-b958-cf9aed65689b with scrape type 2
2026-03-28 09:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3da12c31-4b38-509e-b958-cf9aed65689b with scrape type 2
2026-03-28 09:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3da12c31-4b38-509e-b958-cf9aed65689b, identifier: HE93915
2026-03-28 09:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3da12c31-4b38-509e-b958-cf9aed65689b with identifier: HE93915
2026-03-28 09:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3da12c31-4b38-509e-b958-cf9aed65689b with identifier: HE93915
2026-03-28 09:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3da12c31-4b38-509e-b958-cf9aed65689b with identifier: HE93915 to the API
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:19:04Z',
 'fuel_type': 'diesel',
 'id': '3da12c31-4b38-509e-b958-cf9aed65689b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE93915',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 63868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-23',
 'seller_name': None,
 'title': 'Jeep Renegade 2.0 M-Jet Trailhawk 4WD',
 'transmission': 'automatic',
 'trim': 'Trailhawk 4WD',
 'year': 2017}
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE93915%27 HTTP/1.1" 200 None
2026-03-28 09:04:44 [auto1.it] INFO: Saving data for HE93915: {'auction_closing_time': 1774714744.0, 'created_time': 1774602138.357571, 'last_price_update_time': 1774688684.098655}
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HE93915') HTTP/1.1" 204 0
2026-03-28 09:04:44 [auto1.it] INFO: Found listing with ID: ED09945
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED09945%27 HTTP/1.1" 200 None
2026-03-28 09:04:44 [auto1.it] INFO: Scrape type for ED09945: 2
2026-03-28 09:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3fc4ba9-abdc-5aa1-af8d-d2f68a6e006c with identifier: ED09945
2026-03-28 09:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3fc4ba9-abdc-5aa1-af8d-d2f68a6e006c with scrape type 2
2026-03-28 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3fc4ba9-abdc-5aa1-af8d-d2f68a6e006c with scrape type 2
2026-03-28 09:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d3fc4ba9-abdc-5aa1-af8d-d2f68a6e006c, identifier: ED09945
2026-03-28 09:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d3fc4ba9-abdc-5aa1-af8d-d2f68a6e006c with identifier: ED09945
2026-03-28 09:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d3fc4ba9-abdc-5aa1-af8d-d2f68a6e006c with identifier: ED09945
2026-03-28 09:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d3fc4ba9-abdc-5aa1-af8d-d2f68a6e006c with identifier: ED09945 to the API
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:57:59Z',
 'fuel_type': 'diesel',
 'id': 'd3fc4ba9-abdc-5aa1-af8d-d2f68a6e006c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED09945',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 137958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-07',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2011}
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED09945%27 HTTP/1.1" 200 None
2026-03-28 09:04:44 [auto1.it] INFO: Saving data for ED09945: {'auction_closing_time': 1774717079.0, 'created_time': 1773130517.83813, 'last_price_update_time': 1774688684.64012}
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ED09945') HTTP/1.1" 204 0
2026-03-28 09:04:44 [auto1.it] INFO: Found listing with ID: HA74709
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA74709%27 HTTP/1.1" 200 None
2026-03-28 09:04:44 [auto1.it] INFO: Scrape type for HA74709: 0
2026-03-28 09:04:44 [auto1.it] INFO: Found listing with ID: XJ87572
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ87572%27 HTTP/1.1" 200 None
2026-03-28 09:04:44 [auto1.it] INFO: Scrape type for XJ87572: 0
2026-03-28 09:04:44 [auto1.it] INFO: Found listing with ID: FZ12921
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ12921%27 HTTP/1.1" 200 None
2026-03-28 09:04:44 [auto1.it] INFO: Scrape type for FZ12921: 2
2026-03-28 09:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8606f0d4-597d-5afd-9b85-858fdfe9661d with identifier: FZ12921
2026-03-28 09:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8606f0d4-597d-5afd-9b85-858fdfe9661d with scrape type 2
2026-03-28 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8606f0d4-597d-5afd-9b85-858fdfe9661d with scrape type 2
2026-03-28 09:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8606f0d4-597d-5afd-9b85-858fdfe9661d, identifier: FZ12921
2026-03-28 09:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8606f0d4-597d-5afd-9b85-858fdfe9661d with identifier: FZ12921
2026-03-28 09:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8606f0d4-597d-5afd-9b85-858fdfe9661d with identifier: FZ12921
2026-03-28 09:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8606f0d4-597d-5afd-9b85-858fdfe9661d with identifier: FZ12921 to the API
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:42:56Z',
 'fuel_type': 'petrol',
 'id': '8606f0d4-597d-5afd-9b85-858fdfe9661d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ12921',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 92116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-27',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Live',
 'transmission': 'manual',
 'trim': 'Live',
 'year': 2016}
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ12921%27 HTTP/1.1" 200 None
2026-03-28 09:04:45 [auto1.it] INFO: Saving data for FZ12921: {'auction_closing_time': 1774716176.0, 'created_time': 1774602098.812144, 'last_price_update_time': 1774688685.096947}
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FZ12921') HTTP/1.1" 204 0
2026-03-28 09:04:45 [auto1.it] INFO: Found listing with ID: SE27388
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE27388%27 HTTP/1.1" 200 None
2026-03-28 09:04:45 [auto1.it] INFO: Scrape type for SE27388: 2
2026-03-28 09:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 955e349b-d9a0-58b9-8e61-ad78d94918d1 with identifier: SE27388
2026-03-28 09:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 955e349b-d9a0-58b9-8e61-ad78d94918d1 with scrape type 2
2026-03-28 09:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 955e349b-d9a0-58b9-8e61-ad78d94918d1 with scrape type 2
2026-03-28 09:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 955e349b-d9a0-58b9-8e61-ad78d94918d1, identifier: SE27388
2026-03-28 09:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 955e349b-d9a0-58b9-8e61-ad78d94918d1 with identifier: SE27388
2026-03-28 09:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 955e349b-d9a0-58b9-8e61-ad78d94918d1 with identifier: SE27388
2026-03-28 09:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 955e349b-d9a0-58b9-8e61-ad78d94918d1 with identifier: SE27388 to the API
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:53:23Z',
 'fuel_type': 'diesel',
 'id': '955e349b-d9a0-58b9-8e61-ad78d94918d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE27388',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 198096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-26',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE27388%27 HTTP/1.1" 200 None
2026-03-28 09:04:45 [auto1.it] INFO: Saving data for SE27388: {'auction_closing_time': 1774716803.0, 'created_time': 1774602137.499118, 'last_price_update_time': 1774688685.496785}
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SE27388') HTTP/1.1" 204 0
2026-03-28 09:04:45 [auto1.it] INFO: Found listing with ID: JS62412
2026-03-28 09:04:45 [auto1.it] INFO: Found listing with ID: ZV11200
2026-03-28 09:04:45 [auto1.it] INFO: Found listing with ID: ZZ46834
2026-03-28 09:04:45 [auto1.it] INFO: Found listing with ID: HR66434
2026-03-28 09:04:45 [auto1.it] INFO: Found listing with ID: ZK25944
2026-03-28 09:04:45 [auto1.it] INFO: Found listing with ID: SM34278
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM34278%27 HTTP/1.1" 200 None
2026-03-28 09:04:45 [auto1.it] INFO: Scrape type for SM34278: 2
2026-03-28 09:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 596c2d1f-8ccb-5209-9ec6-ecb6228bcda5 with identifier: SM34278
2026-03-28 09:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 596c2d1f-8ccb-5209-9ec6-ecb6228bcda5 with scrape type 2
2026-03-28 09:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 596c2d1f-8ccb-5209-9ec6-ecb6228bcda5 with scrape type 2
2026-03-28 09:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 596c2d1f-8ccb-5209-9ec6-ecb6228bcda5, identifier: SM34278
2026-03-28 09:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 596c2d1f-8ccb-5209-9ec6-ecb6228bcda5 with identifier: SM34278
2026-03-28 09:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 596c2d1f-8ccb-5209-9ec6-ecb6228bcda5 with identifier: SM34278
2026-03-28 09:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 596c2d1f-8ccb-5209-9ec6-ecb6228bcda5 with identifier: SM34278 to the API
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-28T16:31:59Z',
 'fuel_type': 'diesel',
 'id': '596c2d1f-8ccb-5209-9ec6-ecb6228bcda5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM34278',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'XV',
 'odometer': 325598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-27',
 'seller_name': None,
 'title': 'Subaru XV 2.0 Diesel Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2014}
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM34278%27 HTTP/1.1" 200 None
2026-03-28 09:04:45 [auto1.it] INFO: Saving data for SM34278: {'auction_closing_time': 1774715519.0, 'created_time': 1774602106.291385, 'last_price_update_time': 1774688685.889926}
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SM34278') HTTP/1.1" 204 0
2026-03-28 09:04:46 [auto1.it] INFO: Found listing with ID: EU08042
2026-03-28 09:04:46 [auto1.it] INFO: Found listing with ID: LC36038
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC36038%27 HTTP/1.1" 200 None
2026-03-28 09:04:46 [auto1.it] INFO: Scrape type for LC36038: 2
2026-03-28 09:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f25b8bf-64cb-5f71-bb29-5299685e3fe1 with identifier: LC36038
2026-03-28 09:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f25b8bf-64cb-5f71-bb29-5299685e3fe1 with scrape type 2
2026-03-28 09:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f25b8bf-64cb-5f71-bb29-5299685e3fe1 with scrape type 2
2026-03-28 09:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9f25b8bf-64cb-5f71-bb29-5299685e3fe1, identifier: LC36038
2026-03-28 09:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9f25b8bf-64cb-5f71-bb29-5299685e3fe1 with identifier: LC36038
2026-03-28 09:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9f25b8bf-64cb-5f71-bb29-5299685e3fe1 with identifier: LC36038
2026-03-28 09:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9f25b8bf-64cb-5f71-bb29-5299685e3fe1 with identifier: LC36038 to the API
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:44:34Z',
 'fuel_type': 'diesel',
 'id': '9f25b8bf-64cb-5f71-bb29-5299685e3fe1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC36038',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 181900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-27',
 'seller_name': None,
 'title': 'Citroen DS3 1.4 HDi SoChic',
 'transmission': 'manual',
 'trim': 'SoChic',
 'year': 2014}
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC36038%27 HTTP/1.1" 200 None
2026-03-28 09:04:46 [auto1.it] INFO: Saving data for LC36038: {'auction_closing_time': 1774716274.0, 'created_time': 1774602102.966271, 'last_price_update_time': 1774688686.386366}
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LC36038') HTTP/1.1" 204 0
2026-03-28 09:04:46 [auto1.it] INFO: Found listing with ID: RJ82738
2026-03-28 09:04:46 [auto1.it] INFO: Found listing with ID: UR83709
2026-03-28 09:04:46 [auto1.it] INFO: Found listing with ID: KM71175
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM71175%27 HTTP/1.1" 200 None
2026-03-28 09:04:46 [auto1.it] INFO: Scrape type for KM71175: 2
2026-03-28 09:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d93326ab-6b7c-56ac-b114-9772731be791 with identifier: KM71175
2026-03-28 09:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d93326ab-6b7c-56ac-b114-9772731be791 with scrape type 2
2026-03-28 09:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d93326ab-6b7c-56ac-b114-9772731be791 with scrape type 2
2026-03-28 09:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d93326ab-6b7c-56ac-b114-9772731be791, identifier: KM71175
2026-03-28 09:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d93326ab-6b7c-56ac-b114-9772731be791 with identifier: KM71175
2026-03-28 09:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d93326ab-6b7c-56ac-b114-9772731be791 with identifier: KM71175
2026-03-28 09:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d93326ab-6b7c-56ac-b114-9772731be791 with identifier: KM71175 to the API
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:56:30Z',
 'fuel_type': 'petrol',
 'id': 'd93326ab-6b7c-56ac-b114-9772731be791',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM71175',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 188359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-23',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Special Edition',
 'transmission': 'manual',
 'trim': 'Special Edition',
 'year': 2009}
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM71175%27 HTTP/1.1" 200 None
2026-03-28 09:04:46 [auto1.it] INFO: Saving data for KM71175: {'auction_closing_time': 1774716990.0, 'created_time': 1774299950.617649, 'last_price_update_time': 1774688686.835853}
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KM71175') HTTP/1.1" 204 0
2026-03-28 09:04:46 [auto1.it] INFO: Found listing with ID: ZP73975
2026-03-28 09:04:46 [auto1.it] INFO: Found listing with ID: LX64348
2026-03-28 09:04:46 [auto1.it] INFO: Found listing with ID: RY42018
2026-03-28 09:04:46 [auto1.it] INFO: Found listing with ID: MX61025
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX61025%27 HTTP/1.1" 200 None
2026-03-28 09:04:46 [auto1.it] INFO: Scrape type for MX61025: 2
2026-03-28 09:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ffe28dc-87db-5261-acad-9bcc115a1b30 with identifier: MX61025
2026-03-28 09:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ffe28dc-87db-5261-acad-9bcc115a1b30 with scrape type 2
2026-03-28 09:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ffe28dc-87db-5261-acad-9bcc115a1b30 with scrape type 2
2026-03-28 09:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6ffe28dc-87db-5261-acad-9bcc115a1b30, identifier: MX61025
2026-03-28 09:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6ffe28dc-87db-5261-acad-9bcc115a1b30 with identifier: MX61025
2026-03-28 09:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6ffe28dc-87db-5261-acad-9bcc115a1b30 with identifier: MX61025
2026-03-28 09:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6ffe28dc-87db-5261-acad-9bcc115a1b30 with identifier: MX61025 to the API
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:36:47Z',
 'fuel_type': 'diesel',
 'id': '6ffe28dc-87db-5261-acad-9bcc115a1b30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX61025',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 142641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Business BlueMotion',
 'transmission': 'manual',
 'trim': 'Business BlueMotion',
 'year': 2017}
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX61025%27 HTTP/1.1" 200 None
2026-03-28 09:04:47 [auto1.it] INFO: Saving data for MX61025: {'auction_closing_time': 1774715807.0, 'created_time': 1774602102.248338, 'last_price_update_time': 1774688687.258431}
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MX61025') HTTP/1.1" 204 0
2026-03-28 09:04:47 [auto1.it] INFO: Channel: 24h | Page: 85 | totalHits: 3436 | hits on page: 40
2026-03-28 09:04:47 [auto1.it] INFO: Found listing with ID: UL18238
2026-03-28 09:04:47 [auto1.it] INFO: Found listing with ID: UA98347
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA98347%27 HTTP/1.1" 200 None
2026-03-28 09:04:47 [auto1.it] INFO: Scrape type for UA98347: 2
2026-03-28 09:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aafc304a-5f27-50d9-8932-57bcfadaf2a9 with identifier: UA98347
2026-03-28 09:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aafc304a-5f27-50d9-8932-57bcfadaf2a9 with scrape type 2
2026-03-28 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aafc304a-5f27-50d9-8932-57bcfadaf2a9 with scrape type 2
2026-03-28 09:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aafc304a-5f27-50d9-8932-57bcfadaf2a9, identifier: UA98347
2026-03-28 09:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aafc304a-5f27-50d9-8932-57bcfadaf2a9 with identifier: UA98347
2026-03-28 09:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aafc304a-5f27-50d9-8932-57bcfadaf2a9 with identifier: UA98347
2026-03-28 09:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aafc304a-5f27-50d9-8932-57bcfadaf2a9 with identifier: UA98347 to the API
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-28T16:23:01Z',
 'fuel_type': 'petrol',
 'id': 'aafc304a-5f27-50d9-8932-57bcfadaf2a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA98347',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 65440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seller_name': None,
 'title': 'Jeep Compass 1.5 GSE T4 e-Hybrid Limited FWD',
 'transmission': 'automatic',
 'trim': 'Limited FWD',
 'year': 2022}
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA98347%27 HTTP/1.1" 200 None
2026-03-28 09:04:47 [auto1.it] INFO: Saving data for UA98347: {'auction_closing_time': 1774714981.0, 'created_time': 1774602098.352277, 'last_price_update_time': 1774688687.653016}
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UA98347') HTTP/1.1" 204 0
2026-03-28 09:04:47 [auto1.it] INFO: Found listing with ID: GL09473
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL09473%27 HTTP/1.1" 200 None
2026-03-28 09:04:47 [auto1.it] INFO: Scrape type for GL09473: 2
2026-03-28 09:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a472b1c-5325-5df2-a982-039d50cf9e22 with identifier: GL09473
2026-03-28 09:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a472b1c-5325-5df2-a982-039d50cf9e22 with scrape type 2
2026-03-28 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a472b1c-5325-5df2-a982-039d50cf9e22 with scrape type 2
2026-03-28 09:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4a472b1c-5325-5df2-a982-039d50cf9e22, identifier: GL09473
2026-03-28 09:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:47 [auto1.it] INFO: Found listing with ID: MA06356
2026-03-28 09:04:47 [auto1.it] INFO: Found listing with ID: XW51036
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW51036%27 HTTP/1.1" 200 None
2026-03-28 09:04:47 [auto1.it] INFO: Scrape type for XW51036: 2
2026-03-28 09:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11f59e60-c3e6-5d13-9de7-e47a67249621 with identifier: XW51036
2026-03-28 09:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11f59e60-c3e6-5d13-9de7-e47a67249621 with scrape type 2
2026-03-28 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11f59e60-c3e6-5d13-9de7-e47a67249621 with scrape type 2
2026-03-28 09:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 11f59e60-c3e6-5d13-9de7-e47a67249621, identifier: XW51036
2026-03-28 09:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4a472b1c-5325-5df2-a982-039d50cf9e22 with identifier: GL09473
2026-03-28 09:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4a472b1c-5325-5df2-a982-039d50cf9e22 with identifier: GL09473
2026-03-28 09:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4a472b1c-5325-5df2-a982-039d50cf9e22 with identifier: GL09473 to the API
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:22:41Z',
 'fuel_type': 'diesel',
 'id': '4a472b1c-5325-5df2-a982-039d50cf9e22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL09473',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 287715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-30',
 'seller_name': None,
 'title': 'Audi A5 Sportback 3.0 V6 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL09473%27 HTTP/1.1" 200 None
2026-03-28 09:04:48 [auto1.it] INFO: Saving data for GL09473: {'auction_closing_time': 1774714961.0, 'created_time': 1774602105.355178, 'last_price_update_time': 1774688688.255769}
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GL09473') HTTP/1.1" 204 0
2026-03-28 09:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 11f59e60-c3e6-5d13-9de7-e47a67249621 with identifier: XW51036
2026-03-28 09:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 11f59e60-c3e6-5d13-9de7-e47a67249621 with identifier: XW51036
2026-03-28 09:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 11f59e60-c3e6-5d13-9de7-e47a67249621 with identifier: XW51036 to the API
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:52:52Z',
 'fuel_type': 'petrol',
 'id': '11f59e60-c3e6-5d13-9de7-e47a67249621',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW51036',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 84288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-07',
 'seller_name': None,
 'title': 'Renault Twingo 0.9 Energy Lovely²',
 'transmission': 'manual',
 'trim': 'Lovely²',
 'year': 2017}
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW51036%27 HTTP/1.1" 200 None
2026-03-28 09:04:48 [auto1.it] INFO: Saving data for XW51036: {'auction_closing_time': 1774716772.0, 'created_time': 1774602123.368721, 'last_price_update_time': 1774688688.550145}
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XW51036') HTTP/1.1" 204 0
2026-03-28 09:04:48 [auto1.it] INFO: Found listing with ID: CN54432
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN54432%27 HTTP/1.1" 200 None
2026-03-28 09:04:48 [auto1.it] INFO: Scrape type for CN54432: 2
2026-03-28 09:04:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23143e00-0f91-5bfc-8695-c952f1de7bc4 with identifier: CN54432
2026-03-28 09:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23143e00-0f91-5bfc-8695-c952f1de7bc4 with scrape type 2
2026-03-28 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23143e00-0f91-5bfc-8695-c952f1de7bc4 with scrape type 2
2026-03-28 09:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 23143e00-0f91-5bfc-8695-c952f1de7bc4, identifier: CN54432
2026-03-28 09:04:48 [auto1.it] INFO: Found listing with ID: VX82839
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX82839%27 HTTP/1.1" 200 None
2026-03-28 09:04:48 [auto1.it] INFO: Scrape type for VX82839: 2
2026-03-28 09:04:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6d98673-031a-5405-b183-270e256602fa with identifier: VX82839
2026-03-28 09:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6d98673-031a-5405-b183-270e256602fa with scrape type 2
2026-03-28 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6d98673-031a-5405-b183-270e256602fa with scrape type 2
2026-03-28 09:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a6d98673-031a-5405-b183-270e256602fa, identifier: VX82839
2026-03-28 09:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 23143e00-0f91-5bfc-8695-c952f1de7bc4 with identifier: CN54432
2026-03-28 09:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 23143e00-0f91-5bfc-8695-c952f1de7bc4 with identifier: CN54432
2026-03-28 09:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 23143e00-0f91-5bfc-8695-c952f1de7bc4 with identifier: CN54432 to the API
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:35:47Z',
 'fuel_type': 'diesel',
 'id': '23143e00-0f91-5bfc-8695-c952f1de7bc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN54432',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 208206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-30',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 e-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN54432%27 HTTP/1.1" 200 None
2026-03-28 09:04:49 [auto1.it] INFO: Saving data for CN54432: {'auction_closing_time': 1774715747.0, 'created_time': 1774602114.256169, 'last_price_update_time': 1774688689.07798}
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CN54432') HTTP/1.1" 204 0
2026-03-28 09:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a6d98673-031a-5405-b183-270e256602fa with identifier: VX82839
2026-03-28 09:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a6d98673-031a-5405-b183-270e256602fa with identifier: VX82839
2026-03-28 09:04:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a6d98673-031a-5405-b183-270e256602fa with identifier: VX82839 to the API
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:58:36Z',
 'fuel_type': 'diesel',
 'id': 'a6d98673-031a-5405-b183-270e256602fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX82839',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 90040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-19',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2017}
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX82839%27 HTTP/1.1" 200 None
2026-03-28 09:04:49 [auto1.it] INFO: Saving data for VX82839: {'auction_closing_time': 1774717116.0, 'created_time': 1774602115.468948, 'last_price_update_time': 1774688689.349182}
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VX82839') HTTP/1.1" 204 0
2026-03-28 09:04:49 [auto1.it] INFO: Found listing with ID: AS27324
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS27324%27 HTTP/1.1" 200 None
2026-03-28 09:04:49 [auto1.it] INFO: Scrape type for AS27324: 2
2026-03-28 09:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 837523b7-fc76-5d95-819f-932f15116175 with identifier: AS27324
2026-03-28 09:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 837523b7-fc76-5d95-819f-932f15116175 with scrape type 2
2026-03-28 09:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 837523b7-fc76-5d95-819f-932f15116175 with scrape type 2
2026-03-28 09:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 837523b7-fc76-5d95-819f-932f15116175, identifier: AS27324
2026-03-28 09:04:49 [auto1.it] INFO: Found listing with ID: BJ69368
2026-03-28 09:04:49 [auto1.it] INFO: Found listing with ID: DT48918
2026-03-28 09:04:49 [auto1.it] INFO: Found listing with ID: VL74139
2026-03-28 09:04:49 [auto1.it] INFO: Found listing with ID: NN68396
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN68396%27 HTTP/1.1" 200 None
2026-03-28 09:04:49 [auto1.it] INFO: Scrape type for NN68396: 2
2026-03-28 09:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d5b44d8-5f06-50ff-940d-45d6aae736ec with identifier: NN68396
2026-03-28 09:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d5b44d8-5f06-50ff-940d-45d6aae736ec with scrape type 2
2026-03-28 09:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d5b44d8-5f06-50ff-940d-45d6aae736ec with scrape type 2
2026-03-28 09:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1d5b44d8-5f06-50ff-940d-45d6aae736ec, identifier: NN68396
2026-03-28 09:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 837523b7-fc76-5d95-819f-932f15116175 with identifier: AS27324
2026-03-28 09:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 837523b7-fc76-5d95-819f-932f15116175 with identifier: AS27324
2026-03-28 09:04:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 837523b7-fc76-5d95-819f-932f15116175 with identifier: AS27324 to the API
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:17:19Z',
 'fuel_type': 'petrol',
 'id': '837523b7-fc76-5d95-819f-932f15116175',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS27324',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 110474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-29',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.0 Turbo Super Q4',
 'transmission': 'automatic',
 'trim': 'Super Q4',
 'year': 2017}
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS27324%27 HTTP/1.1" 200 None
2026-03-28 09:04:49 [auto1.it] INFO: Saving data for AS27324: {'auction_closing_time': 1774714639.0, 'created_time': 1774602131.564846, 'last_price_update_time': 1774688689.8732}
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AS27324') HTTP/1.1" 204 0
2026-03-28 09:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1d5b44d8-5f06-50ff-940d-45d6aae736ec with identifier: NN68396
2026-03-28 09:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1d5b44d8-5f06-50ff-940d-45d6aae736ec with identifier: NN68396
2026-03-28 09:04:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1d5b44d8-5f06-50ff-940d-45d6aae736ec with identifier: NN68396 to the API
2026-03-28 09:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:31:37Z',
 'fuel_type': 'petrol',
 'id': '1d5b44d8-5f06-50ff-940d-45d6aae736ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN68396',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 290055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-10',
 'seller_name': None,
 'title': 'Audi A6 2.8 V6 FSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN68396%27 HTTP/1.1" 200 None
2026-03-28 09:04:50 [auto1.it] INFO: Saving data for NN68396: {'auction_closing_time': 1774715497.0, 'created_time': 1774602119.430677, 'last_price_update_time': 1774688690.602748}
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NN68396') HTTP/1.1" 204 0
2026-03-28 09:04:50 [auto1.it] INFO: Found listing with ID: WD12881
2026-03-28 09:04:50 [auto1.it] INFO: Found listing with ID: XP84134
2026-03-28 09:04:50 [auto1.it] INFO: Found listing with ID: DX59233
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX59233%27 HTTP/1.1" 200 None
2026-03-28 09:04:50 [auto1.it] INFO: Scrape type for DX59233: 0
2026-03-28 09:04:50 [auto1.it] INFO: Found listing with ID: US24028
2026-03-28 09:04:50 [auto1.it] INFO: Found listing with ID: UX21158
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX21158%27 HTTP/1.1" 200 None
2026-03-28 09:04:50 [auto1.it] INFO: Scrape type for UX21158: 0
2026-03-28 09:04:50 [auto1.it] INFO: Found listing with ID: GX75357
2026-03-28 09:04:50 [auto1.it] INFO: Found listing with ID: AR78219
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR78219%27 HTTP/1.1" 200 None
2026-03-28 09:04:50 [auto1.it] INFO: Scrape type for AR78219: 0
2026-03-28 09:04:50 [auto1.it] INFO: Found listing with ID: DA37611
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA37611%27 HTTP/1.1" 200 None
2026-03-28 09:04:50 [auto1.it] INFO: Scrape type for DA37611: 0
2026-03-28 09:04:50 [auto1.it] INFO: Found listing with ID: LD48805
2026-03-28 09:04:50 [auto1.it] INFO: Found listing with ID: RA37062
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA37062%27 HTTP/1.1" 200 None
2026-03-28 09:04:50 [auto1.it] INFO: Scrape type for RA37062: 0
2026-03-28 09:04:50 [auto1.it] INFO: Found listing with ID: XX59557
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX59557%27 HTTP/1.1" 200 None
2026-03-28 09:04:50 [auto1.it] INFO: Scrape type for XX59557: 2
2026-03-28 09:04:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d4a15eb-8dfb-5054-9bad-0856345f5179 with identifier: XX59557
2026-03-28 09:04:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d4a15eb-8dfb-5054-9bad-0856345f5179 with scrape type 2
2026-03-28 09:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d4a15eb-8dfb-5054-9bad-0856345f5179 with scrape type 2
2026-03-28 09:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4d4a15eb-8dfb-5054-9bad-0856345f5179, identifier: XX59557
2026-03-28 09:04:50 [auto1.it] INFO: Found listing with ID: BW07837
2026-03-28 09:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4d4a15eb-8dfb-5054-9bad-0856345f5179 with identifier: XX59557
2026-03-28 09:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4d4a15eb-8dfb-5054-9bad-0856345f5179 with identifier: XX59557
2026-03-28 09:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4d4a15eb-8dfb-5054-9bad-0856345f5179 with identifier: XX59557 to the API
2026-03-28 09:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:53:43Z',
 'fuel_type': 'diesel',
 'id': '4d4a15eb-8dfb-5054-9bad-0856345f5179',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX59557',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 204962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-15',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2018}
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX59557%27 HTTP/1.1" 200 None
2026-03-28 09:04:51 [auto1.it] INFO: Saving data for XX59557: {'auction_closing_time': 1774716823.0, 'created_time': 1772569858.348339, 'last_price_update_time': 1774688691.114896}
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XX59557') HTTP/1.1" 204 0
2026-03-28 09:04:51 [auto1.it] INFO: Found listing with ID: CJ01668
2026-03-28 09:04:51 [auto1.it] INFO: Found listing with ID: ED34625
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED34625%27 HTTP/1.1" 200 None
2026-03-28 09:04:51 [auto1.it] INFO: Scrape type for ED34625: 2
2026-03-28 09:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92b6cc0d-bbe9-5550-8d9d-0abebca7c970 with identifier: ED34625
2026-03-28 09:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92b6cc0d-bbe9-5550-8d9d-0abebca7c970 with scrape type 2
2026-03-28 09:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92b6cc0d-bbe9-5550-8d9d-0abebca7c970 with scrape type 2
2026-03-28 09:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 92b6cc0d-bbe9-5550-8d9d-0abebca7c970, identifier: ED34625
2026-03-28 09:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 92b6cc0d-bbe9-5550-8d9d-0abebca7c970 with identifier: ED34625
2026-03-28 09:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 92b6cc0d-bbe9-5550-8d9d-0abebca7c970 with identifier: ED34625
2026-03-28 09:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 92b6cc0d-bbe9-5550-8d9d-0abebca7c970 with identifier: ED34625 to the API
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:42:56Z',
 'fuel_type': 'diesel',
 'id': '92b6cc0d-bbe9-5550-8d9d-0abebca7c970',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED34625',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 194569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-21',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Shooting Brake Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2015}
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED34625%27 HTTP/1.1" 200 None
2026-03-28 09:04:51 [auto1.it] INFO: Saving data for ED34625: {'auction_closing_time': 1774716176.0, 'created_time': 1774602114.602724, 'last_price_update_time': 1774688691.566215}
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ED34625') HTTP/1.1" 204 0
2026-03-28 09:04:51 [auto1.it] INFO: Found listing with ID: NY40947
2026-03-28 09:04:51 [auto1.it] INFO: Found listing with ID: EB11724
2026-03-28 09:04:51 [auto1.it] INFO: Found listing with ID: BP64052
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP64052%27 HTTP/1.1" 200 None
2026-03-28 09:04:51 [auto1.it] INFO: Scrape type for BP64052: 2
2026-03-28 09:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a1f337b-05cd-5521-9365-6b5a10fe78a8 with identifier: BP64052
2026-03-28 09:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a1f337b-05cd-5521-9365-6b5a10fe78a8 with scrape type 2
2026-03-28 09:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a1f337b-05cd-5521-9365-6b5a10fe78a8 with scrape type 2
2026-03-28 09:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0a1f337b-05cd-5521-9365-6b5a10fe78a8, identifier: BP64052
2026-03-28 09:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0a1f337b-05cd-5521-9365-6b5a10fe78a8 with identifier: BP64052
2026-03-28 09:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0a1f337b-05cd-5521-9365-6b5a10fe78a8 with identifier: BP64052
2026-03-28 09:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0a1f337b-05cd-5521-9365-6b5a10fe78a8 with identifier: BP64052 to the API
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:38:21Z',
 'fuel_type': 'petrol',
 'id': '0a1f337b-05cd-5521-9365-6b5a10fe78a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP64052',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 142590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-21',
 'seller_name': None,
 'title': 'Seat Altea 1.6 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2007}
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP64052%27 HTTP/1.1" 200 None
2026-03-28 09:04:51 [auto1.it] INFO: Saving data for BP64052: {'auction_closing_time': 1774715901.0, 'created_time': 1774472608.626429, 'last_price_update_time': 1774688691.948954}
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BP64052') HTTP/1.1" 204 0
2026-03-28 09:04:51 [auto1.it] INFO: Found listing with ID: TJ20772
2026-03-28 09:04:51 [auto1.it] INFO: Found listing with ID: RS54948
2026-03-28 09:04:51 [auto1.it] INFO: Found listing with ID: MA83267
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA83267%27 HTTP/1.1" 200 None
2026-03-28 09:04:51 [auto1.it] INFO: Scrape type for MA83267: 2
2026-03-28 09:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95e59ee1-3cba-542d-990b-b717d4deee12 with identifier: MA83267
2026-03-28 09:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95e59ee1-3cba-542d-990b-b717d4deee12 with scrape type 2
2026-03-28 09:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95e59ee1-3cba-542d-990b-b717d4deee12 with scrape type 2
2026-03-28 09:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 95e59ee1-3cba-542d-990b-b717d4deee12, identifier: MA83267
2026-03-28 09:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 95e59ee1-3cba-542d-990b-b717d4deee12 with identifier: MA83267
2026-03-28 09:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 95e59ee1-3cba-542d-990b-b717d4deee12 with identifier: MA83267
2026-03-28 09:04:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 95e59ee1-3cba-542d-990b-b717d4deee12 with identifier: MA83267 to the API
2026-03-28 09:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:38:07Z',
 'fuel_type': 'diesel',
 'id': '95e59ee1-3cba-542d-990b-b717d4deee12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA83267',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 18763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-04',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 40 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-28 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA83267%27 HTTP/1.1" 200 None
2026-03-28 09:04:52 [auto1.it] INFO: Saving data for MA83267: {'auction_closing_time': 1774715887.0, 'created_time': 1773129777.810424, 'last_price_update_time': 1774688692.350067}
2026-03-28 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MA83267') HTTP/1.1" 204 0
2026-03-28 09:04:52 [auto1.it] INFO: Found listing with ID: KR95959
2026-03-28 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR95959%27 HTTP/1.1" 200 None
2026-03-28 09:04:52 [auto1.it] INFO: Scrape type for KR95959: 2
2026-03-28 09:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d603c4bd-12ca-5aa0-9ba4-0b09c12f8b1e with identifier: KR95959
2026-03-28 09:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d603c4bd-12ca-5aa0-9ba4-0b09c12f8b1e with scrape type 2
2026-03-28 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d603c4bd-12ca-5aa0-9ba4-0b09c12f8b1e with scrape type 2
2026-03-28 09:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d603c4bd-12ca-5aa0-9ba4-0b09c12f8b1e, identifier: KR95959
2026-03-28 09:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d603c4bd-12ca-5aa0-9ba4-0b09c12f8b1e with identifier: KR95959
2026-03-28 09:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d603c4bd-12ca-5aa0-9ba4-0b09c12f8b1e with identifier: KR95959
2026-03-28 09:04:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d603c4bd-12ca-5aa0-9ba4-0b09c12f8b1e with identifier: KR95959 to the API
2026-03-28 09:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:51:48Z',
 'fuel_type': 'diesel',
 'id': 'd603c4bd-12ca-5aa0-9ba4-0b09c12f8b1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR95959',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 280359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-03',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Business BlueMotion',
 'transmission': 'manual',
 'trim': 'Business BlueMotion',
 'year': 2017}
2026-03-28 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR95959%27 HTTP/1.1" 200 None
2026-03-28 09:04:52 [auto1.it] INFO: Saving data for KR95959: {'auction_closing_time': 1774716708.0, 'created_time': 1774602118.741155, 'last_price_update_time': 1774688692.72271}
2026-03-28 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KR95959') HTTP/1.1" 204 0
2026-03-28 09:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:04:52 [auto1.it] INFO: Found listing with ID: DT34666
2026-03-28 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT34666%27 HTTP/1.1" 200 None
2026-03-28 09:04:52 [auto1.it] INFO: Scrape type for DT34666: 2
2026-03-28 09:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 375415a4-853a-58c0-8e01-3dbbff68ec06 with identifier: DT34666
2026-03-28 09:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 375415a4-853a-58c0-8e01-3dbbff68ec06 with scrape type 2
2026-03-28 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 375415a4-853a-58c0-8e01-3dbbff68ec06 with scrape type 2
2026-03-28 09:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 375415a4-853a-58c0-8e01-3dbbff68ec06, identifier: DT34666
2026-03-28 09:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 375415a4-853a-58c0-8e01-3dbbff68ec06 with identifier: DT34666
2026-03-28 09:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 375415a4-853a-58c0-8e01-3dbbff68ec06 with identifier: DT34666
2026-03-28 09:04:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 375415a4-853a-58c0-8e01-3dbbff68ec06 with identifier: DT34666 to the API
2026-03-28 09:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:31:26Z',
 'fuel_type': 'diesel',
 'id': '375415a4-853a-58c0-8e01-3dbbff68ec06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT34666',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 107866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-30',
 'seller_name': None,
 'title': 'Fiat Punto 1.3 JTD Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2012}
2026-03-28 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT34666%27 HTTP/1.1" 200 None
2026-03-28 09:04:53 [auto1.it] INFO: Saving data for DT34666: {'auction_closing_time': 1774715486.0, 'created_time': 1774602108.097283, 'last_price_update_time': 1774688693.14562}
2026-03-28 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DT34666') HTTP/1.1" 204 0
2026-03-28 09:04:53 [auto1.it] INFO: Found listing with ID: WR61044
2026-03-28 09:04:53 [auto1.it] INFO: Found listing with ID: PN56075
2026-03-28 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN56075%27 HTTP/1.1" 200 None
2026-03-28 09:04:53 [auto1.it] INFO: Scrape type for PN56075: 2
2026-03-28 09:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f00bbfc8-6fe2-5ed5-a831-93a8b8d67a8e with identifier: PN56075
2026-03-28 09:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f00bbfc8-6fe2-5ed5-a831-93a8b8d67a8e with scrape type 2
2026-03-28 09:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f00bbfc8-6fe2-5ed5-a831-93a8b8d67a8e with scrape type 2
2026-03-28 09:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f00bbfc8-6fe2-5ed5-a831-93a8b8d67a8e, identifier: PN56075
2026-03-28 09:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f00bbfc8-6fe2-5ed5-a831-93a8b8d67a8e with identifier: PN56075
2026-03-28 09:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f00bbfc8-6fe2-5ed5-a831-93a8b8d67a8e with identifier: PN56075
2026-03-28 09:04:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f00bbfc8-6fe2-5ed5-a831-93a8b8d67a8e with identifier: PN56075 to the API
2026-03-28 09:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:32:20Z',
 'fuel_type': 'diesel',
 'id': 'f00bbfc8-6fe2-5ed5-a831-93a8b8d67a8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN56075',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 201688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-20',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTDM Distinctive',
 'transmission': 'manual',
 'trim': 'Distinctive',
 'year': 2013}
2026-03-28 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN56075%27 HTTP/1.1" 200 None
2026-03-28 09:04:53 [auto1.it] INFO: Saving data for PN56075: {'auction_closing_time': 1774715540.0, 'created_time': 1774602157.285696, 'last_price_update_time': 1774688693.553779}
2026-03-28 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PN56075') HTTP/1.1" 204 0
2026-03-28 09:04:53 [auto1.it] INFO: Channel: 24h | Page: 86 | totalHits: 3436 | hits on page: 36
2026-03-28 09:04:53 [auto1.it] INFO: Found listing with ID: JN19530
2026-03-28 09:04:53 [auto1.it] INFO: Found listing with ID: CP99007
2026-03-28 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP99007%27 HTTP/1.1" 200 None
2026-03-28 09:04:53 [auto1.it] INFO: Scrape type for CP99007: 2
2026-03-28 09:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d239c8d-aa36-594d-a839-daa3083e388b with identifier: CP99007
2026-03-28 09:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d239c8d-aa36-594d-a839-daa3083e388b with scrape type 2
2026-03-28 09:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d239c8d-aa36-594d-a839-daa3083e388b with scrape type 2
2026-03-28 09:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9d239c8d-aa36-594d-a839-daa3083e388b, identifier: CP99007
2026-03-28 09:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9d239c8d-aa36-594d-a839-daa3083e388b with identifier: CP99007
2026-03-28 09:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9d239c8d-aa36-594d-a839-daa3083e388b with identifier: CP99007
2026-03-28 09:04:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9d239c8d-aa36-594d-a839-daa3083e388b with identifier: CP99007 to the API
2026-03-28 09:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:34:00Z',
 'fuel_type': 'diesel',
 'id': '9d239c8d-aa36-594d-a839-daa3083e388b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP99007',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 83721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-24',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI BlueEfficiency Elegance',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Elegance',
 'year': 2009}
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP99007%27 HTTP/1.1" 200 None
2026-03-28 09:04:54 [auto1.it] INFO: Saving data for CP99007: {'auction_closing_time': 1774715640.0, 'created_time': 1773824506.505819, 'last_price_update_time': 1774688694.041154}
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CP99007') HTTP/1.1" 204 0
2026-03-28 09:04:54 [auto1.it] INFO: Found listing with ID: JU21728
2026-03-28 09:04:54 [auto1.it] INFO: Found listing with ID: RG06778
2026-03-28 09:04:54 [auto1.it] INFO: Found listing with ID: YW53472
2026-03-28 09:04:54 [auto1.it] INFO: Found listing with ID: GM11383
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM11383%27 HTTP/1.1" 200 None
2026-03-28 09:04:54 [auto1.it] INFO: Scrape type for GM11383: 2
2026-03-28 09:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a83c0ede-a3d5-5bb8-8a7d-c95987f9a43a with identifier: GM11383
2026-03-28 09:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a83c0ede-a3d5-5bb8-8a7d-c95987f9a43a with scrape type 2
2026-03-28 09:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a83c0ede-a3d5-5bb8-8a7d-c95987f9a43a with scrape type 2
2026-03-28 09:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a83c0ede-a3d5-5bb8-8a7d-c95987f9a43a, identifier: GM11383
2026-03-28 09:04:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 09:04:54 [auto1.it] INFO: Found listing with ID: ES67961
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES67961%27 HTTP/1.1" 200 None
2026-03-28 09:04:54 [auto1.it] INFO: Scrape type for ES67961: 2
2026-03-28 09:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87bf5868-c4ed-58b0-8c13-19b38e818d4f with identifier: ES67961
2026-03-28 09:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87bf5868-c4ed-58b0-8c13-19b38e818d4f with scrape type 2
2026-03-28 09:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87bf5868-c4ed-58b0-8c13-19b38e818d4f with scrape type 2
2026-03-28 09:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 87bf5868-c4ed-58b0-8c13-19b38e818d4f, identifier: ES67961
2026-03-28 09:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a83c0ede-a3d5-5bb8-8a7d-c95987f9a43a with identifier: GM11383
2026-03-28 09:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a83c0ede-a3d5-5bb8-8a7d-c95987f9a43a with identifier: GM11383
2026-03-28 09:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a83c0ede-a3d5-5bb8-8a7d-c95987f9a43a with identifier: GM11383 to the API
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:15:54Z',
 'fuel_type': 'diesel',
 'id': 'a83c0ede-a3d5-5bb8-8a7d-c95987f9a43a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM11383',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 108254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-22',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2015}
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM11383%27 HTTP/1.1" 200 None
2026-03-28 09:04:54 [auto1.it] INFO: Saving data for GM11383: {'auction_closing_time': 1774714554.0, 'created_time': 1772224800.962386, 'last_price_update_time': 1774688694.590427}
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GM11383') HTTP/1.1" 204 0
2026-03-28 09:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 87bf5868-c4ed-58b0-8c13-19b38e818d4f with identifier: ES67961
2026-03-28 09:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 87bf5868-c4ed-58b0-8c13-19b38e818d4f with identifier: ES67961
2026-03-28 09:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 87bf5868-c4ed-58b0-8c13-19b38e818d4f with identifier: ES67961 to the API
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:33:03Z',
 'fuel_type': 'petrol',
 'id': '87bf5868-c4ed-58b0-8c13-19b38e818d4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES67961',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 93782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-14',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES67961%27 HTTP/1.1" 200 None
2026-03-28 09:04:54 [auto1.it] INFO: Saving data for ES67961: {'auction_closing_time': 1774715583.0, 'created_time': 1774602122.959632, 'last_price_update_time': 1774688694.90792}
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ES67961') HTTP/1.1" 204 0
2026-03-28 09:04:54 [auto1.it] INFO: Found listing with ID: LU21739
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU21739%27 HTTP/1.1" 200 None
2026-03-28 09:04:54 [auto1.it] INFO: Scrape type for LU21739: 2
2026-03-28 09:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 831b0cd3-f677-56db-bb13-ebfbcc80c122 with identifier: LU21739
2026-03-28 09:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 831b0cd3-f677-56db-bb13-ebfbcc80c122 with scrape type 2
2026-03-28 09:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 831b0cd3-f677-56db-bb13-ebfbcc80c122 with scrape type 2
2026-03-28 09:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 831b0cd3-f677-56db-bb13-ebfbcc80c122, identifier: LU21739
2026-03-28 09:04:55 [auto1.it] INFO: Found listing with ID: YY37168
2026-03-28 09:04:55 [auto1.it] INFO: Found listing with ID: VC26054
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC26054%27 HTTP/1.1" 200 None
2026-03-28 09:04:55 [auto1.it] INFO: Scrape type for VC26054: 2
2026-03-28 09:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b5bb73a-c827-5492-b623-d9eef081af2d with identifier: VC26054
2026-03-28 09:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b5bb73a-c827-5492-b623-d9eef081af2d with scrape type 2
2026-03-28 09:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b5bb73a-c827-5492-b623-d9eef081af2d with scrape type 2
2026-03-28 09:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2b5bb73a-c827-5492-b623-d9eef081af2d, identifier: VC26054
2026-03-28 09:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 831b0cd3-f677-56db-bb13-ebfbcc80c122 with identifier: LU21739
2026-03-28 09:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 831b0cd3-f677-56db-bb13-ebfbcc80c122 with identifier: LU21739
2026-03-28 09:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 831b0cd3-f677-56db-bb13-ebfbcc80c122 with identifier: LU21739 to the API
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:26:02Z',
 'fuel_type': 'petrol',
 'id': '831b0cd3-f677-56db-bb13-ebfbcc80c122',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU21739',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 169946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-29',
 'seller_name': None,
 'title': 'Citroen C3 1.1 White Selection',
 'transmission': 'manual',
 'trim': 'White Selection',
 'year': 2011}
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU21739%27 HTTP/1.1" 200 None
2026-03-28 09:04:55 [auto1.it] INFO: Saving data for LU21739: {'auction_closing_time': 1774715162.0, 'created_time': 1774602121.863175, 'last_price_update_time': 1774688695.42952}
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LU21739') HTTP/1.1" 204 0
2026-03-28 09:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2b5bb73a-c827-5492-b623-d9eef081af2d with identifier: VC26054
2026-03-28 09:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2b5bb73a-c827-5492-b623-d9eef081af2d with identifier: VC26054
2026-03-28 09:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2b5bb73a-c827-5492-b623-d9eef081af2d with identifier: VC26054 to the API
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:33:51Z',
 'fuel_type': 'diesel',
 'id': '2b5bb73a-c827-5492-b623-d9eef081af2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC26054',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 193494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-29',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2018}
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC26054%27 HTTP/1.1" 200 None
2026-03-28 09:04:55 [auto1.it] INFO: Saving data for VC26054: {'auction_closing_time': 1774715631.0, 'created_time': 1772534514.690046, 'last_price_update_time': 1774688695.722799}
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VC26054') HTTP/1.1" 204 0
2026-03-28 09:04:55 [auto1.it] INFO: Found listing with ID: VS54724
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS54724%27 HTTP/1.1" 200 None
2026-03-28 09:04:55 [auto1.it] INFO: Scrape type for VS54724: 2
2026-03-28 09:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efe0a339-f6d9-5614-87b0-5242964b8de2 with identifier: VS54724
2026-03-28 09:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efe0a339-f6d9-5614-87b0-5242964b8de2 with scrape type 2
2026-03-28 09:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efe0a339-f6d9-5614-87b0-5242964b8de2 with scrape type 2
2026-03-28 09:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: efe0a339-f6d9-5614-87b0-5242964b8de2, identifier: VS54724
2026-03-28 09:04:55 [auto1.it] INFO: Found listing with ID: ZN14128
2026-03-28 09:04:55 [auto1.it] INFO: Found listing with ID: EV19228
2026-03-28 09:04:55 [auto1.it] INFO: Found listing with ID: RM88416
2026-03-28 09:04:55 [auto1.it] INFO: Found listing with ID: XV39349
2026-03-28 09:04:55 [auto1.it] INFO: Found listing with ID: KA77498
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA77498%27 HTTP/1.1" 200 None
2026-03-28 09:04:55 [auto1.it] INFO: Scrape type for KA77498: 2
2026-03-28 09:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb233731-92b1-5d8c-a58b-aa175514d969 with identifier: KA77498
2026-03-28 09:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb233731-92b1-5d8c-a58b-aa175514d969 with scrape type 2
2026-03-28 09:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb233731-92b1-5d8c-a58b-aa175514d969 with scrape type 2
2026-03-28 09:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fb233731-92b1-5d8c-a58b-aa175514d969, identifier: KA77498
2026-03-28 09:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: efe0a339-f6d9-5614-87b0-5242964b8de2 with identifier: VS54724
2026-03-28 09:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: efe0a339-f6d9-5614-87b0-5242964b8de2 with identifier: VS54724
2026-03-28 09:04:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: efe0a339-f6d9-5614-87b0-5242964b8de2 with identifier: VS54724 to the API
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:25Z',
 'fuel_type': 'diesel',
 'id': 'efe0a339-f6d9-5614-87b0-5242964b8de2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS54724',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 123601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-30',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2017}
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS54724%27 HTTP/1.1" 200 None
2026-03-28 09:04:56 [auto1.it] INFO: Saving data for VS54724: {'auction_closing_time': 1774715545.0, 'created_time': 1774602112.856115, 'last_price_update_time': 1774688696.228687}
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VS54724') HTTP/1.1" 204 0
2026-03-28 09:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fb233731-92b1-5d8c-a58b-aa175514d969 with identifier: KA77498
2026-03-28 09:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fb233731-92b1-5d8c-a58b-aa175514d969 with identifier: KA77498
2026-03-28 09:04:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fb233731-92b1-5d8c-a58b-aa175514d969 with identifier: KA77498 to the API
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-28T16:07:23Z',
 'fuel_type': 'petrol',
 'id': 'fb233731-92b1-5d8c-a58b-aa175514d969',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA77498',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 9894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-30',
 'seller_name': None,
 'title': 'Fiat Panda 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2024}
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA77498%27 HTTP/1.1" 200 None
2026-03-28 09:04:56 [auto1.it] INFO: Saving data for KA77498: {'auction_closing_time': 1774714043.0, 'created_time': 1774602140.167319, 'last_price_update_time': 1774688696.6406}
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KA77498') HTTP/1.1" 204 0
2026-03-28 09:04:56 [auto1.it] INFO: Found listing with ID: KD87590
2026-03-28 09:04:56 [auto1.it] INFO: Found listing with ID: TD38619
2026-03-28 09:04:56 [auto1.it] INFO: Found listing with ID: XC14615
2026-03-28 09:04:56 [auto1.it] INFO: Found listing with ID: TH24600
2026-03-28 09:04:56 [auto1.it] INFO: Found listing with ID: PV59173
2026-03-28 09:04:56 [auto1.it] INFO: Found listing with ID: GU05332
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU05332%27 HTTP/1.1" 200 None
2026-03-28 09:04:56 [auto1.it] INFO: Scrape type for GU05332: 2
2026-03-28 09:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 935e956d-7404-540d-8122-8c226e96a5d3 with identifier: GU05332
2026-03-28 09:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 935e956d-7404-540d-8122-8c226e96a5d3 with scrape type 2
2026-03-28 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 935e956d-7404-540d-8122-8c226e96a5d3 with scrape type 2
2026-03-28 09:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 935e956d-7404-540d-8122-8c226e96a5d3, identifier: GU05332
2026-03-28 09:04:56 [auto1.it] INFO: Found listing with ID: CN88471
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN88471%27 HTTP/1.1" 200 None
2026-03-28 09:04:56 [auto1.it] INFO: Scrape type for CN88471: 0
2026-03-28 09:04:56 [auto1.it] INFO: Found listing with ID: HY34989
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY34989%27 HTTP/1.1" 200 None
2026-03-28 09:04:56 [auto1.it] INFO: Scrape type for HY34989: 0
2026-03-28 09:04:56 [auto1.it] INFO: Found listing with ID: EN53386
2026-03-28 09:04:56 [auto1.it] INFO: Found listing with ID: CV81447
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV81447%27 HTTP/1.1" 200 None
2026-03-28 09:04:56 [auto1.it] INFO: Scrape type for CV81447: 2
2026-03-28 09:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5913539e-3156-588d-880a-cc9b6c28d5c8 with identifier: CV81447
2026-03-28 09:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5913539e-3156-588d-880a-cc9b6c28d5c8 with scrape type 2
2026-03-28 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5913539e-3156-588d-880a-cc9b6c28d5c8 with scrape type 2
2026-03-28 09:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5913539e-3156-588d-880a-cc9b6c28d5c8, identifier: CV81447
2026-03-28 09:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 935e956d-7404-540d-8122-8c226e96a5d3 with identifier: GU05332
2026-03-28 09:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 935e956d-7404-540d-8122-8c226e96a5d3 with identifier: GU05332
2026-03-28 09:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 935e956d-7404-540d-8122-8c226e96a5d3 with identifier: GU05332 to the API
2026-03-28 09:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:47:49Z',
 'fuel_type': 'petrol',
 'id': '935e956d-7404-540d-8122-8c226e96a5d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU05332',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 26273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-28',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2019}
2026-03-28 09:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU05332%27 HTTP/1.1" 200 None
2026-03-28 09:04:57 [auto1.it] INFO: Saving data for GU05332: {'auction_closing_time': 1774716469.0, 'created_time': 1774602124.497629, 'last_price_update_time': 1774688697.180938}
2026-03-28 09:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GU05332') HTTP/1.1" 204 0
2026-03-28 09:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5913539e-3156-588d-880a-cc9b6c28d5c8 with identifier: CV81447
2026-03-28 09:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5913539e-3156-588d-880a-cc9b6c28d5c8 with identifier: CV81447
2026-03-28 09:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5913539e-3156-588d-880a-cc9b6c28d5c8 with identifier: CV81447 to the API
2026-03-28 09:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:17:31Z',
 'fuel_type': 'petrol',
 'id': '5913539e-3156-588d-880a-cc9b6c28d5c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV81447',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 113390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-21',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-28 09:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV81447%27 HTTP/1.1" 200 None
2026-03-28 09:04:57 [auto1.it] INFO: Saving data for CV81447: {'auction_closing_time': 1774714651.0, 'created_time': 1773129929.478881, 'last_price_update_time': 1774688697.55155}
2026-03-28 09:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CV81447') HTTP/1.1" 204 0
2026-03-28 09:04:57 [auto1.it] INFO: Found listing with ID: KY69981
2026-03-28 09:04:57 [auto1.it] INFO: Found listing with ID: GW90153
2026-03-28 09:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW90153%27 HTTP/1.1" 200 None
2026-03-28 09:04:57 [auto1.it] INFO: Scrape type for GW90153: 2
2026-03-28 09:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4cffae4-43ef-580d-ae70-f01209fddbc6 with identifier: GW90153
2026-03-28 09:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4cffae4-43ef-580d-ae70-f01209fddbc6 with scrape type 2
2026-03-28 09:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4cffae4-43ef-580d-ae70-f01209fddbc6 with scrape type 2
2026-03-28 09:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e4cffae4-43ef-580d-ae70-f01209fddbc6, identifier: GW90153
2026-03-28 09:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e4cffae4-43ef-580d-ae70-f01209fddbc6 with identifier: GW90153
2026-03-28 09:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e4cffae4-43ef-580d-ae70-f01209fddbc6 with identifier: GW90153
2026-03-28 09:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e4cffae4-43ef-580d-ae70-f01209fddbc6 with identifier: GW90153 to the API
2026-03-28 09:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:45:22Z',
 'fuel_type': 'petrol',
 'id': 'e4cffae4-43ef-580d-ae70-f01209fddbc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW90153',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 63489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-28 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW90153%27 HTTP/1.1" 200 None
2026-03-28 09:04:58 [auto1.it] INFO: Saving data for GW90153: {'auction_closing_time': 1774716322.0, 'created_time': 1772785093.762132, 'last_price_update_time': 1774688698.234765}
2026-03-28 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GW90153') HTTP/1.1" 204 0
2026-03-28 09:04:58 [auto1.it] INFO: Found listing with ID: KC73163
2026-03-28 09:04:58 [auto1.it] INFO: Found listing with ID: GC28590
2026-03-28 09:04:58 [auto1.it] INFO: Found listing with ID: LH97251
2026-03-28 09:04:58 [auto1.it] INFO: Found listing with ID: ND06570
2026-03-28 09:04:58 [auto1.it] INFO: Found listing with ID: FT76605
2026-03-28 09:04:58 [auto1.it] INFO: Found listing with ID: UT43750
2026-03-28 09:04:58 [auto1.it] INFO: Found listing with ID: TZ23741
2026-03-28 09:04:58 [auto1.it] INFO: Found listing with ID: VR70375
2026-03-28 09:04:58 [auto1.it] INFO: Found listing with ID: RR03246
2026-03-28 09:04:58 [auto1.it] INFO: Found listing with ID: ZM66429
2026-03-28 09:04:58 [auto1.it] INFO: Found listing with ID: MS79311
2026-03-28 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS79311%27 HTTP/1.1" 200 None
2026-03-28 09:04:58 [auto1.it] INFO: Scrape type for MS79311: 2
2026-03-28 09:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce13ae7f-ee95-563f-9e56-9532f4de3b92 with identifier: MS79311
2026-03-28 09:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce13ae7f-ee95-563f-9e56-9532f4de3b92 with scrape type 2
2026-03-28 09:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce13ae7f-ee95-563f-9e56-9532f4de3b92 with scrape type 2
2026-03-28 09:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ce13ae7f-ee95-563f-9e56-9532f4de3b92, identifier: MS79311
2026-03-28 09:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ce13ae7f-ee95-563f-9e56-9532f4de3b92 with identifier: MS79311
2026-03-28 09:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ce13ae7f-ee95-563f-9e56-9532f4de3b92 with identifier: MS79311
2026-03-28 09:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ce13ae7f-ee95-563f-9e56-9532f4de3b92 with identifier: MS79311 to the API
2026-03-28 09:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:24:50Z',
 'fuel_type': 'diesel',
 'id': 'ce13ae7f-ee95-563f-9e56-9532f4de3b92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS79311',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 168619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-30',
 'seller_name': None,
 'title': 'Fiat 500L 1.3 JTD Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2014}
2026-03-28 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS79311%27 HTTP/1.1" 200 None
2026-03-28 09:04:58 [auto1.it] INFO: Saving data for MS79311: {'auction_closing_time': 1774715090.0, 'created_time': 1774602117.309227, 'last_price_update_time': 1774688698.721553}
2026-03-28 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MS79311') HTTP/1.1" 204 0
2026-03-28 09:04:58 [auto1.it] INFO: Found listing with ID: YL87875
2026-03-28 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL87875%27 HTTP/1.1" 200 None
2026-03-28 09:04:58 [auto1.it] INFO: Scrape type for YL87875: 2
2026-03-28 09:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffa08c9f-17c5-5632-96f2-e99fc8ff78a6 with identifier: YL87875
2026-03-28 09:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffa08c9f-17c5-5632-96f2-e99fc8ff78a6 with scrape type 2
2026-03-28 09:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffa08c9f-17c5-5632-96f2-e99fc8ff78a6 with scrape type 2
2026-03-28 09:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ffa08c9f-17c5-5632-96f2-e99fc8ff78a6, identifier: YL87875
2026-03-28 09:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ffa08c9f-17c5-5632-96f2-e99fc8ff78a6 with identifier: YL87875
2026-03-28 09:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ffa08c9f-17c5-5632-96f2-e99fc8ff78a6 with identifier: YL87875
2026-03-28 09:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ffa08c9f-17c5-5632-96f2-e99fc8ff78a6 with identifier: YL87875 to the API
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:47:21Z',
 'fuel_type': 'diesel',
 'id': 'ffa08c9f-17c5-5632-96f2-e99fc8ff78a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL87875',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Freemont',
 'odometer': 154845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-28',
 'seller_name': None,
 'title': 'Fiat Freemont 2.0 Multijet Black Code AWD',
 'transmission': 'automatic',
 'trim': 'Black Code AWD',
 'year': 2014}
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL87875%27 HTTP/1.1" 200 None
2026-03-28 09:04:59 [auto1.it] INFO: Saving data for YL87875: {'auction_closing_time': 1774716441.0, 'created_time': 1774602116.876837, 'last_price_update_time': 1774688699.189864}
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YL87875') HTTP/1.1" 204 0
2026-03-28 09:04:59 [auto1.it] INFO: Found listing with ID: RJ76809
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ76809%27 HTTP/1.1" 200 None
2026-03-28 09:04:59 [auto1.it] INFO: Scrape type for RJ76809: 2
2026-03-28 09:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26d0e73a-d56a-549a-959f-a8ff434af0ab with identifier: RJ76809
2026-03-28 09:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26d0e73a-d56a-549a-959f-a8ff434af0ab with scrape type 2
2026-03-28 09:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26d0e73a-d56a-549a-959f-a8ff434af0ab with scrape type 2
2026-03-28 09:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 26d0e73a-d56a-549a-959f-a8ff434af0ab, identifier: RJ76809
2026-03-28 09:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 26d0e73a-d56a-549a-959f-a8ff434af0ab with identifier: RJ76809
2026-03-28 09:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 26d0e73a-d56a-549a-959f-a8ff434af0ab with identifier: RJ76809
2026-03-28 09:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 26d0e73a-d56a-549a-959f-a8ff434af0ab with identifier: RJ76809 to the API
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:24:50Z',
 'fuel_type': 'diesel',
 'id': '26d0e73a-d56a-549a-959f-a8ff434af0ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ76809',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 167082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-16',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2011}
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ76809%27 HTTP/1.1" 200 None
2026-03-28 09:04:59 [auto1.it] INFO: Saving data for RJ76809: {'auction_closing_time': 1774715090.0, 'created_time': 1773130398.588452, 'last_price_update_time': 1774688699.568377}
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RJ76809') HTTP/1.1" 204 0
2026-03-28 09:04:59 [auto1.it] INFO: Found listing with ID: UU69652
2026-03-28 09:04:59 [auto1.it] INFO: Found listing with ID: BH88586
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH88586%27 HTTP/1.1" 200 None
2026-03-28 09:04:59 [auto1.it] INFO: Scrape type for BH88586: 2
2026-03-28 09:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e44d3279-3e9d-5f1c-9e6f-9bc50faab620 with identifier: BH88586
2026-03-28 09:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e44d3279-3e9d-5f1c-9e6f-9bc50faab620 with scrape type 2
2026-03-28 09:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e44d3279-3e9d-5f1c-9e6f-9bc50faab620 with scrape type 2
2026-03-28 09:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e44d3279-3e9d-5f1c-9e6f-9bc50faab620, identifier: BH88586
2026-03-28 09:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e44d3279-3e9d-5f1c-9e6f-9bc50faab620 with identifier: BH88586
2026-03-28 09:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e44d3279-3e9d-5f1c-9e6f-9bc50faab620 with identifier: BH88586
2026-03-28 09:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e44d3279-3e9d-5f1c-9e6f-9bc50faab620 with identifier: BH88586 to the API
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:47:57Z',
 'fuel_type': 'diesel',
 'id': 'e44d3279-3e9d-5f1c-9e6f-9bc50faab620',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH88586',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 257661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-26',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'manual',
 'trim': 'Ultra',
 'year': 2016}
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH88586%27 HTTP/1.1" 200 None
2026-03-28 09:04:59 [auto1.it] INFO: Saving data for BH88586: {'auction_closing_time': 1774716477.0, 'created_time': 1774602142.199011, 'last_price_update_time': 1774688699.962396}
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BH88586') HTTP/1.1" 204 0
2026-03-28 09:04:59 [auto1.it] INFO: Found listing with ID: PL71131
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL71131%27 HTTP/1.1" 200 None
2026-03-28 09:04:59 [auto1.it] INFO: Scrape type for PL71131: 0
2026-03-28 09:04:59 [auto1.it] INFO: Found listing with ID: SL84548
2026-03-28 09:04:59 [auto1.it] INFO: Found listing with ID: NV14531
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV14531%27 HTTP/1.1" 200 None
2026-03-28 09:05:00 [auto1.it] INFO: Scrape type for NV14531: 0
2026-03-28 09:05:00 [auto1.it] INFO: Found listing with ID: GA45330
2026-03-28 09:05:00 [auto1.it] INFO: Found listing with ID: FG22478
2026-03-28 09:05:00 [auto1.it] INFO: Found listing with ID: PK65337
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK65337%27 HTTP/1.1" 200 None
2026-03-28 09:05:00 [auto1.it] INFO: Scrape type for PK65337: 0
2026-03-28 09:05:00 [auto1.it] INFO: Found listing with ID: AU70551
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU70551%27 HTTP/1.1" 200 None
2026-03-28 09:05:00 [auto1.it] INFO: Scrape type for AU70551: 2
2026-03-28 09:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14ed3d2f-8385-5f96-b246-5eae73b6e038 with identifier: AU70551
2026-03-28 09:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14ed3d2f-8385-5f96-b246-5eae73b6e038 with scrape type 2
2026-03-28 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14ed3d2f-8385-5f96-b246-5eae73b6e038 with scrape type 2
2026-03-28 09:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 14ed3d2f-8385-5f96-b246-5eae73b6e038, identifier: AU70551
2026-03-28 09:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 14ed3d2f-8385-5f96-b246-5eae73b6e038 with identifier: AU70551
2026-03-28 09:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 14ed3d2f-8385-5f96-b246-5eae73b6e038 with identifier: AU70551
2026-03-28 09:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 14ed3d2f-8385-5f96-b246-5eae73b6e038 with identifier: AU70551 to the API
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 09:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:26:02Z',
 'fuel_type': 'petrol',
 'id': '14ed3d2f-8385-5f96-b246-5eae73b6e038',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU70551',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 101954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-25',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU70551%27 HTTP/1.1" 200 None
2026-03-28 09:05:00 [auto1.it] INFO: Saving data for AU70551: {'auction_closing_time': 1774715162.0, 'created_time': 1774602120.970286, 'last_price_update_time': 1774688700.470563}
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AU70551') HTTP/1.1" 204 0
2026-03-28 09:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 09:05:00 [auto1.it] INFO: Channel: 24h | Page: 87 | totalHits: 3436 | hits on page: 0
2026-03-28 09:05:00 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 09:05:00 [auto1.it] INFO: auto1.it Batch config: batch 1/2
2026-03-28 09:05:00 [auto1.it] INFO: auto1.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20last_price_update_time%20lt%201774256700 HTTP/1.1" 200 None
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='AS11505') HTTP/1.1" 204 0
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='BF12859') HTTP/1.1" 204 0
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CJ86238') HTTP/1.1" 204 0
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='DG89440') HTTP/1.1" 204 0
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='DR86004') HTTP/1.1" 204 0
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='FD84567') HTTP/1.1" 204 0
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='FR70695') HTTP/1.1" 204 0
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='GK84881') HTTP/1.1" 204 0
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='HC40975') HTTP/1.1" 204 0
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='HW83105') HTTP/1.1" 204 0
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JG88260') HTTP/1.1" 204 0
2026-03-28 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JR05068') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JZ43630') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KC08332') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KG26461') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KN28324') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LE25949') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LR19944') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LX17163') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='MW26308') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NM63603') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ73460') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RX80413') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RY74496') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SC57434') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SH27035') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SM78375') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SZ75393') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TH60548') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TK68364') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UF53486') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='US58030') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VA45287') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VH76433') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VS82727') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WA03106') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WD28338') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WK49232') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YB07214') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YB66894') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YT31818') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZU21710') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZX69560') HTTP/1.1" 204 0
2026-03-28 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ41756') HTTP/1.1" 204 0
2026-03-28 09:05:01 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (242 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.it/task_24_2026-03-28T09_00_00.jl
2026-03-28 09:05:01 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 739068,
 'downloader/request_count': 373,
 'downloader/request_method_count/GET': 284,
 'downloader/request_method_count/POST': 89,
 'downloader/response_bytes': 93785658,
 'downloader/response_count': 373,
 'downloader/response_status_count/200': 373,
 'dupefilter/filtered': 5,
 'elapsed_time_seconds': 295.853037,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 9, 5, 1, 308576, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 242,
 'log_count/DEBUG': 7282,
 'log_count/INFO': 8861,
 'memusage/max': 199864320,
 'memusage/startup': 150069248,
 'photo_download_count': 200,
 'request_depth_max': 90,
 'response_received_count': 173,
 'scheduler/dequeued': 373,
 'scheduler/dequeued/memory': 373,
 'scheduler/enqueued': 373,
 'scheduler/enqueued/memory': 373,
 'scrape_type/batch_skipped': 1771,
 'scrape_type/new': 41,
 'scrape_type/price_update': 201,
 'scrape_type/skipped': 1458,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 173,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.5136155078639795,
 'scrapy-zyte-api/mean_response_seconds': 2.580540683979137,
 'scrapy-zyte-api/processed': 173,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 173,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 172,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 173,
 'scrapy-zyte-api/request_args/httpRequestBody': 89,
 'scrapy-zyte-api/request_args/httpRequestMethod': 89,
 'scrapy-zyte-api/request_args/httpResponseBody': 173,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 173,
 'scrapy-zyte-api/request_args/sessionContext': 173,
 'scrapy-zyte-api/request_args/url': 173,
 'scrapy-zyte-api/status_codes/200': 173,
 'scrapy-zyte-api/success': 173,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 3476,
 'source/total_available': 3436,
 'start_time': datetime.datetime(2026, 3, 28, 9, 0, 5, 455539, tzinfo=datetime.timezone.utc)}
2026-03-28 09:05:01 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 09:05:01 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fab1c59a2d0>
2026-03-28 09:05:01 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fab1c6c7d90>